-- Logs begin at Thu 2022-08-18 20:51:53 UTC, end at Thu 2022-08-18 22:24:39 UTC. -- Aug 18 21:40:18.697641 dv-cinder-853678-3-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 18 21:40:18.704981 dv-cinder-853678-3-smb devstack@keystone.service[88083]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 18 21:40:18.707011 dv-cinder-853678-3-smb devstack@keystone.service[88083]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Aug 18 21:40:18 2022] *** Aug 18 21:40:18.707011 dv-cinder-853678-3-smb devstack@keystone.service[88083]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 18 21:40:18.707011 dv-cinder-853678-3-smb devstack@keystone.service[88083]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 18 21:40:18.707011 dv-cinder-853678-3-smb devstack@keystone.service[88083]: nodename: dv-cinder-853678-3-smb Aug 18 21:40:18.707011 dv-cinder-853678-3-smb devstack@keystone.service[88083]: machine: x86_64 Aug 18 21:40:18.707011 dv-cinder-853678-3-smb devstack@keystone.service[88083]: clock source: unix Aug 18 21:40:18.707011 dv-cinder-853678-3-smb devstack@keystone.service[88083]: pcre jit disabled Aug 18 21:40:18.707011 dv-cinder-853678-3-smb devstack@keystone.service[88083]: detected number of CPU cores: 4 Aug 18 21:40:18.707543 dv-cinder-853678-3-smb devstack@keystone.service[88083]: current working directory: / Aug 18 21:40:18.707543 dv-cinder-853678-3-smb devstack@keystone.service[88083]: detected binary path: /usr/bin/uwsgi-core Aug 18 21:40:18.707543 dv-cinder-853678-3-smb devstack@keystone.service[88083]: your processes number limit is 47680 Aug 18 21:40:18.707543 dv-cinder-853678-3-smb devstack@keystone.service[88083]: your memory page size is 4096 bytes Aug 18 21:40:18.707543 dv-cinder-853678-3-smb devstack@keystone.service[88083]: detected max file descriptor number: 2048 Aug 18 21:40:18.707543 dv-cinder-853678-3-smb devstack@keystone.service[88083]: lock engine: pthread robust mutexes Aug 18 21:40:18.707543 dv-cinder-853678-3-smb devstack@keystone.service[88083]: thunder lock: enabled Aug 18 21:40:18.707543 dv-cinder-853678-3-smb devstack@keystone.service[88083]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 18 21:40:18.707543 dv-cinder-853678-3-smb devstack@keystone.service[88083]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 18 21:40:18.747419 dv-cinder-853678-3-smb devstack@keystone.service[88083]: Python main interpreter initialized at 0x562f61ba39c0 Aug 18 21:40:18.747419 dv-cinder-853678-3-smb devstack@keystone.service[88083]: python threads support enabled Aug 18 21:40:18.747419 dv-cinder-853678-3-smb devstack@keystone.service[88083]: your server socket listen backlog is limited to 100 connections Aug 18 21:40:18.747419 dv-cinder-853678-3-smb devstack@keystone.service[88083]: your mercy for graceful operations on workers is 90 seconds Aug 18 21:40:18.747780 dv-cinder-853678-3-smb devstack@keystone.service[88083]: mapped 403077 bytes (393 KB) for 2 cores Aug 18 21:40:18.747878 dv-cinder-853678-3-smb devstack@keystone.service[88083]: *** Operational MODE: preforking *** Aug 18 21:40:18.748153 dv-cinder-853678-3-smb devstack@keystone.service[88083]: *** uWSGI is running in multiple interpreter mode *** Aug 18 21:40:18.748153 dv-cinder-853678-3-smb devstack@keystone.service[88083]: spawned uWSGI master process (pid: 88083) Aug 18 21:40:18.748362 dv-cinder-853678-3-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 18 21:40:18.752624 dv-cinder-853678-3-smb devstack@keystone.service[88083]: spawned uWSGI worker 1 (pid: 88096, cores: 1) Aug 18 21:40:18.752624 dv-cinder-853678-3-smb devstack@keystone.service[88083]: spawned uWSGI worker 2 (pid: 88097, cores: 1) Aug 18 21:40:18.752624 dv-cinder-853678-3-smb devstack@keystone.service[88083]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 18 21:40:23.116354 dv-cinder-853678-3-smb devstack@keystone.service[88096]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 18 21:40:23.116354 dv-cinder-853678-3-smb devstack@keystone.service[88096]: from cryptography.utils import int_from_bytes Aug 18 21:40:23.117177 dv-cinder-853678-3-smb devstack@keystone.service[88096]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 18 21:40:23.117177 dv-cinder-853678-3-smb devstack@keystone.service[88096]: from cryptography.utils import int_from_bytes Aug 18 21:40:23.117315 dv-cinder-853678-3-smb devstack@keystone.service[88097]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 18 21:40:23.117315 dv-cinder-853678-3-smb devstack@keystone.service[88097]: from cryptography.utils import int_from_bytes Aug 18 21:40:23.117756 dv-cinder-853678-3-smb devstack@keystone.service[88097]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 18 21:40:23.117756 dv-cinder-853678-3-smb devstack@keystone.service[88097]: from cryptography.utils import int_from_bytes Aug 18 21:40:23.173355 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 18 21:40:23.173542 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 18 21:40:23.173633 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 18 21:40:23.173730 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 18 21:40:23.173812 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] command line args: [] {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 18 21:40:23.173891 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] command line args: [] {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 18 21:40:23.173967 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 18 21:40:23.174120 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 18 21:40:23.174213 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] ================================================================================ {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 18 21:40:23.174275 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] ================================================================================ {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 18 21:40:23.174382 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] admin_token = **** {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:40:23.174536 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] admin_token = **** {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:40:23.174633 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] config_dir = [] {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:40:23.174779 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] config_dir = [] {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:40:23.174870 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:40:23.174947 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] config_source = [] {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:40:23.175016 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:40:23.175125 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] debug = True {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:40:23.175209 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] config_source = [] {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:40:23.175291 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] debug = True {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:40:23.175365 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:40:23.175561 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:40:23.175697 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:40:23.175808 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:40:23.175914 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] insecure_debug = False {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:40:23.176007 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] insecure_debug = False {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:40:23.176111 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:40:23.176205 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:40:23.176302 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:40:23.176403 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:40:23.176723 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] list_limit = None {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:40:23.176866 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] list_limit = None {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:40:23.176866 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] log_config_append = None {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:40:23.177139 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] log_config_append = None {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:40:23.177308 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:40:23.177479 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:40:23.177639 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] log_dir = None {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:40:23.177722 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] log_dir = None {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:40:23.177832 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] log_file = None {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:40:23.177900 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] log_file = None {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:40:23.177973 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:40:23.178085 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:40:23.178169 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:40:23.178247 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:40:23.178367 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:40:23.178447 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:40:23.178522 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:40:23.178595 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:40:23.178705 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:40:23.178789 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:40:23.178896 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:40:23.178980 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:40:23.179051 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:40:23.179188 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:40:23.179304 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:40:23.179378 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:40:23.179494 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:40:23.179573 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:40:23.179644 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:40:23.179768 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:40:23.179847 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:40:23.179918 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:40:23.180037 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:40:23.180110 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:40:23.180223 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:40:23.180303 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:40:23.180379 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] notification_format = cadf {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:40:23.180448 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] notification_format = cadf {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:40:23.180562 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:40:23.180672 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:40:23.181076 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.27/identity {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:40:23.181173 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.27/identity {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:40:23.181247 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] publish_errors = False {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:40:23.181411 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] publish_errors = False {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:40:23.181493 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:40:23.181613 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:40:23.181693 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:40:23.181811 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:40:23.181898 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:40:23.181975 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:40:23.182091 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:40:23.182186 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:40:23.182324 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:40:23.182412 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:40:23.182557 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] standard_threads = False {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:40:23.182640 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] standard_threads = False {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:40:23.182784 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] strict_password_check = False {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:40:23.182865 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] strict_password_check = False {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:40:23.183025 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:40:23.183121 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:40:23.183199 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] use_eventlog = False {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:40:23.183275 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] use_eventlog = False {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:40:23.183397 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] use_journal = False {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:40:23.183510 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] use_journal = False {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:40:23.183621 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] use_json = False {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:40:23.183742 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] use_json = False {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:40:23.183855 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] use_stderr = False {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:40:23.183967 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] use_stderr = False {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:40:23.184083 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] use_syslog = False {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:40:23.184201 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] use_syslog = False {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:40:23.184318 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] watch_log_file = False {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:40:23.184507 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] watch_log_file = False {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:40:23.184656 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.184772 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.184884 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.184995 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.185105 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.185229 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.185342 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.185459 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.185571 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.185682 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.185798 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.185918 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.186031 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.186147 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.186266 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.186378 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.186489 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.186608 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.186727 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.186837 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.186948 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.187064 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.187217 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.187343 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.187990 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.188153 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.188308 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.188428 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.188545 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.188685 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.188799 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.188917 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.189030 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.189141 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.189259 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.189377 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.189490 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.189606 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.189718 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.189828 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.189950 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.190069 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.190182 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.190306 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.190419 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.190528 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.190716 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.190837 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.190949 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.191062 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.191179 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.191297 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.191416 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.191529 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.191646 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.191763 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.191875 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.191992 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.192116 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.192228 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.192343 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.192455 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.192571 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.192708 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.192830 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.192942 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.193058 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.193172 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.193282 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.193392 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.193510 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.193622 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.193769 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.193883 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.193999 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.194110 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.194216 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.194311 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.194403 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.194403 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.194605 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.194707 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.194810 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.194910 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.195004 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.195097 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.195197 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.195291 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.195392 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.195487 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.195579 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.195691 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.195817 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.195939 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.196050 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.196168 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.196290 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.196398 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.196510 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.196654 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.196777 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.196898 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.197016 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.197128 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.197239 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.197335 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.197434 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.197543 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.197638 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.197732 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.197824 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.197918 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.198011 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.198118 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.198214 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.198313 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.198413 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.198512 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.198614 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.198716 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.198816 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.198916 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.199015 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.199115 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.199223 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.199326 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.199442 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.199516 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.199642 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.199756 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.199868 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.199987 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.200100 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.200218 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.200331 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.200449 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.200563 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.200704 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.200819 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.200930 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.201042 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.201153 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.201264 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.201453 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.201576 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.201690 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.201801 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.201913 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.202024 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.202143 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] cache.enabled = True {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.202256 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.202367 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.202478 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] cache.enabled = True {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.202591 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.202713 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.202831 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.202959 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.203073 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.203185 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.203296 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.203409 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.203520 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.203641 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.203755 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.203867 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.203979 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.204090 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.204202 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.204320 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.204434 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.204546 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.204713 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.204827 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.204939 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.205063 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.205177 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.205296 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.205409 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.205521 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.205633 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.205758 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.205873 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.205991 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.206104 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.206216 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.206328 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.206447 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.206561 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.206674 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.206787 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.206900 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.207011 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.207131 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.207245 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.207357 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.207469 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.207581 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.207693 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.207814 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.207928 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.208047 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.208047 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.208264 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.208378 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.208498 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.208626 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.208739 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.208852 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] auth.external = None {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.208963 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.209075 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] auth.mapped = None {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.209200 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] auth.external = None {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.209305 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] auth.mapped = None {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.209397 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.209519 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.209640 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.209755 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] auth.password = None {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.209868 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.209982 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] auth.token = None {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.210102 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] auth.password = None {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.210216 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.210329 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] auth.token = None {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.210441 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] catalog.caching = True {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.210553 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.210665 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] catalog.caching = True {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.210783 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.210897 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.211010 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.211123 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.211236 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.211347 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.211467 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.211581 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.211700 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.211821 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] credential.caching = True {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.211935 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.212050 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] credential.driver = sql {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.212170 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] credential.caching = True {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.212284 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.212397 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] credential.driver = sql {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.212517 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.212653 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.212769 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.212893 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.213014 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.213129 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.213241 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.213354 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.213466 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.213587 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.213706 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.213820 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.213941 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.214055 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.214177 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.214291 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.214404 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.214515 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.214628 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.214740 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.214926 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.215043 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.215166 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.215280 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.215392 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.215505 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.215628 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] federation.caching = True {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.215746 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.215860 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.215972 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] federation.caching = True {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.216084 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] federation.driver = sql {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.216197 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.216320 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.216447 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] federation.driver = sql {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.216561 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.216703 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.216818 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.216931 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.217100 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.217210 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.217311 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.217422 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.217518 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.217629 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.217750 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.217865 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.217977 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.218159 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.218276 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.218432 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.218615 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] identity.caching = True {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.218735 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.218848 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.218959 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] identity.caching = True {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.219070 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.219183 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.219303 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.219418 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.219530 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.219642 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.219754 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] identity.driver = sql {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.219873 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.219994 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.220107 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] identity.driver = sql {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.220219 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.220330 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.220444 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.220555 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.220698 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.220814 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.220928 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.221041 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.221160 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.221280 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.221402 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.221518 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.221637 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.221751 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.221864 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.221977 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.222098 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.222213 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.222325 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.222439 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.222552 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.222665 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.222665 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.222876 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.222876 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.223085 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.223197 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.223318 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.223432 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.223546 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.223659 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.223771 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.223884 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.223994 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.224090 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.224184 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.224286 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.224382 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.224476 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.224578 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.224704 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.224799 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.224893 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.224986 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.225127 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.227862 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.227972 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.228053 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.228124 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.228194 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.228194 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.228333 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.228333 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.228461 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.228537 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.228714 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.228792 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.228875 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.228949 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] ldap.password = **** {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.229019 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.229089 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.229159 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] ldap.password = **** {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.229228 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.229306 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.229377 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.229447 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.229517 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.229587 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.229657 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.229734 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.229807 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.229883 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.229954 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.230024 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.230094 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.230165 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.230237 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.230309 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.230379 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.230449 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.230518 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.230596 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.230668 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.230738 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.230807 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.230877 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.230946 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.231023 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.231095 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] ldap.user = None {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.231164 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.231234 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.231303 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] ldap.user = None {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.231373 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.231450 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.231522 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.231592 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.231663 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.231732 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.231801 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.231962 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.232041 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.232118 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.232190 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.232261 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.232331 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.232409 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.232482 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.232552 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.232638 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.232711 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.232782 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.232864 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.232965 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.233079 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.233210 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.233309 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.233454 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.233543 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.233696 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.233775 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.233939 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.234574 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.234794 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.234897 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.235032 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.235114 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.235261 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.235339 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.235508 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.235594 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.235745 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.235866 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.235980 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.236094 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.236208 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.236329 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.236444 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.236558 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.236693 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.236808 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.236921 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.237047 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.237164 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.237277 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] policy.driver = sql {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.237390 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] policy.driver = sql {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.237504 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.237617 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.237804 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.237921 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.238034 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.238147 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.238269 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] receipt.caching = True {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.238391 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] receipt.caching = True {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.238507 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.238620 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.238733 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.238846 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.238965 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.239087 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.239202 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.239317 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.239433 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.239547 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.239660 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] resource.caching = True {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.239660 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.239883 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] resource.caching = True {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.239996 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] resource.driver = sql {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.240109 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.240222 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.240337 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] resource.driver = sql {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.240462 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.240577 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.240746 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.240860 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.240973 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] revoke.caching = True {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.241086 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.241211 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.241328 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] revoke.caching = True {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.241442 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.241556 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.241668 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] role.cache_time = None {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.241781 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.241902 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] role.caching = True {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.242018 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] role.cache_time = None {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.242131 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] role.driver = sql {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.242244 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] role.caching = True {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.242357 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] role.list_limit = None {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.242472 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] role.driver = sql {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.242593 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.242707 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] role.list_limit = None {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.242821 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.242934 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.243079 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.243201 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.243324 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.243440 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.243554 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.243667 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.243780 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.243893 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.244014 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.244129 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.244242 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.244354 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.244467 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.244581 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.244726 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.244842 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.244945 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.245063 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.245177 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.245290 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.245412 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.245528 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.245528 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.245740 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.245842 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.245944 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.246060 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.246157 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.246269 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.246389 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.246504 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.246626 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.246741 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.246855 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.246968 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.247082 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.247195 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.247316 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.247430 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.247543 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.247664 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.247778 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.247891 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.248012 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.248127 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.248241 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.248354 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.248467 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.248580 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.248727 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.248842 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.248956 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.249075 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.249188 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.249301 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.249424 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.249539 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.249730 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.250380 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] token.cache_time = None {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.250499 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.250613 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] token.caching = True {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.250736 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.250852 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] token.cache_time = None {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.250966 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] token.provider = fernet {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.251079 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] token.caching = True {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.251193 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.251306 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.251428 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.251543 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] token.provider = fernet {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.251656 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.251768 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.251883 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.251997 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.252109 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.252222 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.252335 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.252448 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.252550 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] trust.driver = sql {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.252671 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.262468 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.262665 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.262834 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.262978 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] trust.driver = sql {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.263081 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.263177 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.263287 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.263386 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.263481 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.263576 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.263671 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.263766 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.263870 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.264232 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.264328 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.264423 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.264517 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] database.connection = **** {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.264651 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.264764 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.264870 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.264967 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.265063 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] database.connection = **** {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.265166 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.265317 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.265430 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.265509 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.265581 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.265661 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.265735 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.265808 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.265893 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.266013 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.266195 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.266274 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.266347 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.266419 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.266492 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.266563 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.266635 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.266714 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.266787 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.266859 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.266931 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.267002 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.267081 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.267155 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.267226 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.267297 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.267376 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.267449 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.267527 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.267601 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.267672 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.267743 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.267814 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 18 21:40:23.267885 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.267885 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:40:23.267885 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 18 21:40:23.318995 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=88097) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 21:40:23.319758 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=88097) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 21:40:23.319856 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=88096) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 21:40:23.319950 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=88097) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 21:40:23.320033 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=88096) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 21:40:23.320033 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=88096) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 21:40:23.328118 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=88096) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 21:40:23.329709 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=88097) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 21:40:23.356456 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=88096) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 21:40:23.356711 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=88096) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 21:40:23.357810 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=88097) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 21:40:23.358046 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=88097) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 21:40:23.412164 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=88096) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 21:40:23.412391 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=88097) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 21:40:23.464520 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=88097) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 21:40:23.464816 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=88097) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 21:40:23.469697 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=88096) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 21:40:23.469932 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=88096) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 21:40:23.630624 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88097) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 21:40:23.630851 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=88097) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 21:40:23.631077 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=88097) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 21:40:23.631247 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88096) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 21:40:23.631339 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=88097) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 21:40:23.631486 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=88096) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 21:40:23.631599 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=88097) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 21:40:23.631707 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=88097) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 21:40:23.631792 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=88096) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 21:40:23.631929 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=88096) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 21:40:23.632148 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=88096) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 21:40:23.632366 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=88096) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 21:40:23.657822 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88096) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 21:40:23.657996 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88097) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 21:40:23.658092 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=88096) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 21:40:23.658235 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=88097) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 21:40:23.658348 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=88096) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 21:40:23.658461 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=88097) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 21:40:23.658624 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=88096) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 21:40:23.658707 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=88097) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 21:40:23.658783 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=88096) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 21:40:23.658885 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=88097) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 21:40:23.658982 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=88096) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 21:40:23.659139 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88096) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 21:40:23.659223 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=88097) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 21:40:23.659365 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88097) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 21:40:23.676426 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=88096) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 21:40:23.676561 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=88097) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 21:40:23.688746 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88097) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 21:40:23.688977 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88096) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 21:40:23.689070 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=88097) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 21:40:23.689201 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=88097) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 21:40:23.689303 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=88096) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 21:40:23.689421 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=88097) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 21:40:23.689507 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=88096) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 21:40:23.689636 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=88097) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 21:40:23.689720 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=88096) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 21:40:23.689849 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=88097) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 21:40:23.689936 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=88096) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 21:40:23.690063 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=88096) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 21:40:23.690147 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88097) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 21:40:23.690281 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88096) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 21:40:23.707321 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=88097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.707532 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=88097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 18 21:40:23.707621 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=88096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.707759 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=88096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 18 21:40:23.707877 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=88097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.708082 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=88097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 18 21:40:23.708174 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=88096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.708292 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=88096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 18 21:40:23.708376 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=88097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.708567 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=88096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.708678 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=88097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.708853 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=88096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.709140 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=88097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.709376 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=88096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.709467 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=88097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.709641 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=88096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.719740 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=88097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.719863 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=88096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.720015 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=88096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.720100 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=88097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.720288 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=88097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.720372 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=88096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.720572 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=88096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.720743 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=88097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.727680 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=88096) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 21:40:23.727773 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=88097) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 21:40:23.730631 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=88096) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 21:40:23.730718 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=88097) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 21:40:23.730917 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=88096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.731001 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=88097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.731199 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=88097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.731284 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=88096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.731486 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=88096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.731577 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=88097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.731770 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=88097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.731852 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=88096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.732029 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=88096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.732112 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=88097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.732296 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=88097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.732385 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=88096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.732569 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=88096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.732722 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=88097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.732977 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=88097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.733089 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=88096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.733309 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=88097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.733420 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=88096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.733548 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=88097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.733631 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=88096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.756398 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=88097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.756857 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=88096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.757902 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=88097) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 21:40:23.758188 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=88097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.758333 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=88096) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 21:40:23.758618 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=88096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.763017 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=88097) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 21:40:23.763309 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=88097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.763393 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=88096) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 21:40:23.763592 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=88096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.763675 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=88097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.763874 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=88096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.770813 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=88097) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 21:40:23.771100 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=88097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.771285 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=88096) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 21:40:23.771574 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=88096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.775245 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=88097) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 21:40:23.775535 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=88097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.775820 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=88097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.775902 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=88096) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 21:40:23.776106 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=88097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.776191 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=88096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.776387 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=88097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.776485 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=88096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.776692 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=88097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.776780 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=88096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.776965 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=88097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.777048 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=88096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.777234 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=88097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.777319 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=88096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.777505 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=88096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.777774 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=88096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.794616 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=88097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.797461 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=88097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.797616 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=88096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.797616 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=88096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.799466 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=88097) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 21:40:23.800088 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=88096) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 21:40:23.802755 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=88097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.803060 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=88097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.803383 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=88096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.803685 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=88096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.807308 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=88097) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 21:40:23.808089 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=88096) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 21:40:23.810496 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=88097) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 21:40:23.811282 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=88096) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 21:40:23.814455 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=88097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.814749 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=88097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.815033 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=88097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.815315 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=88097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.815441 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=88096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.815593 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=88097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.815680 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=88096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.815873 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=88097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.815967 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=88096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.816226 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=88096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.816506 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=88096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.816813 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=88096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.832150 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=88097) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 21:40:23.832439 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=88097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.832742 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=88097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.832888 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=88096) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 21:40:23.833011 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=88097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.833110 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=88096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.833373 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=88096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.833638 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=88096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.839916 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=88097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.840713 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=88096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.841535 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=88097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.841767 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=88097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.842300 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=88096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.842581 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=88096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.844439 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=88097) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 21:40:23.844751 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=88097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.845036 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=88097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.845335 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=88097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.845506 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=88096) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 21:40:23.845614 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=88097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.845796 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=88096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.846082 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=88096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.846387 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=88096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.846666 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=88096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.857090 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=88097) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 21:40:23.857466 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=88097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.857893 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=88097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.858328 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=88097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.858470 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=88096) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 21:40:23.858760 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=88096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.858846 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=88097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.859609 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=88097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.859799 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=88096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.859884 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=88097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.860071 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=88096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.860364 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=88096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.860683 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=88096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.864623 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=88096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.876168 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=88097) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 21:40:23.877221 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=88096) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 21:40:23.879253 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=88097) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 21:40:23.880280 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=88096) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 21:40:23.882216 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=88097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.883338 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=88096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.883665 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=88097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.884726 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=88096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.885177 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=88097) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 21:40:23.885462 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=88097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.885758 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=88097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.886210 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=88096) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 21:40:23.886504 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=88096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.886803 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=88096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.892777 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=88097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.893875 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=88096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.894294 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=88097) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 21:40:23.895345 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=88096) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 21:40:23.897225 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=88097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.897525 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=88097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.897822 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=88097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.898103 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=88097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.898360 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=88096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.898669 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=88096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.898959 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=88096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.899240 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=88096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.906219 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=88097) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 21:40:23.906508 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=88097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.906790 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=88097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.907343 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=88096) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 21:40:23.907640 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=88096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.907924 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=88096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.913788 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=88097) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 21:40:23.914076 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=88097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.914358 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=88097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.914638 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=88097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.914915 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=88097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.914996 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=88096) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 21:40:23.915188 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=88097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.915271 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=88096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.915471 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=88096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.915564 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=88097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.915737 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=88097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.915819 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=88096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.916008 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=88096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.916088 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=88097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.916283 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=88096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.916409 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=88097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.916553 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=88097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.916704 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=88096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.916849 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=88097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.916981 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=88096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.917137 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=88097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.917266 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=88096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.917401 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=88097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.917540 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=88096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.917825 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=88096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.918091 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=88096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.918381 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=88096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.918644 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=88096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 21:40:23.953039 dv-cinder-853678-3-smb devstack@keystone.service[88097]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x562f61ba39c0 pid: 88097 (default app) Aug 18 21:40:23.954736 dv-cinder-853678-3-smb devstack@keystone.service[88096]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x562f61ba39c0 pid: 88096 (default app) Aug 18 21:40:23.956396 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732a97ee-64ca-4615-9981-4fd3b667cde4 None None] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:40:23.956726 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732a97ee-64ca-4615-9981-4fd3b667cde4 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:40:23.957001 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732a97ee-64ca-4615-9981-4fd3b667cde4 None None] PATH_INFO: `/v3` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:40:23.961139 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1/1] 10.222.0.27 () {50 vars in 791 bytes} [Thu Aug 18 21:40:23 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:40:31.436732 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f2ef12-4a20-41ad-8975-131bb591ba5d None None] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:40:31.437904 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f2ef12-4a20-41ad-8975-131bb591ba5d None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:40:31.437904 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f2ef12-4a20-41ad-8975-131bb591ba5d None None] PATH_INFO: `/` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:40:31.442150 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1/2] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:40:31 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:40:31.447364 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ccab46-e0ac-4590-ad99-f0495a5137b2 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:40:31.447800 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ccab46-e0ac-4590-ad99-f0495a5137b2 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:40:31.447900 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ccab46-e0ac-4590-ad99-f0495a5137b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:40:31.519302 dv-cinder-853678-3-smb devstack@keystone.service[88097]: INFO dbcounter [None req-f6ccab46-e0ac-4590-ad99-f0495a5137b2 None None] Registered counter for database keystone Aug 18 21:40:31.540148 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG oslo_db.sqlalchemy.engines [None req-f6ccab46-e0ac-4590-ad99-f0495a5137b2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88097) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 21:40:31.546350 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writer thread running {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 21:40:31.726942 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG passlib.handlers.bcrypt [None req-f6ccab46-e0ac-4590-ad99-f0495a5137b2 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=88097) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 18 21:40:31.727365 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG passlib.handlers.bcrypt [None req-f6ccab46-e0ac-4590-ad99-f0495a5137b2 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=88097) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 18 21:40:31.782142 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-f6ccab46-e0ac-4590-ad99-f0495a5137b2 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:40:31.783742 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-f6ccab46-e0ac-4590-ad99-f0495a5137b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:40:31.913567 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 2/3] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:40:31 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 467 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Aug 18 21:40:32.365926 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f2ef12-4a20-41ad-8975-131bb591ba5d None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:40:32.434909 dv-cinder-853678-3-smb devstack@keystone.service[88096]: INFO dbcounter [None req-a5f2ef12-4a20-41ad-8975-131bb591ba5d None None] Registered counter for database keystone Aug 18 21:40:32.454091 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG oslo_db.sqlalchemy.engines [None req-a5f2ef12-4a20-41ad-8975-131bb591ba5d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88096) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 21:40:32.460291 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writer thread running {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 21:40:32.581372 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f2ef12-4a20-41ad-8975-131bb591ba5d None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:40:32.585740 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8d2e97-6b53-4b4a-bd89-97f31baa72aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:40:32.586363 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8d2e97-6b53-4b4a-bd89-97f31baa72aa admin admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:40:32.586643 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8d2e97-6b53-4b4a-bd89-97f31baa72aa admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:40:32.586910 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8d2e97-6b53-4b4a-bd89-97f31baa72aa admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:40:32.595454 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8d2e97-6b53-4b4a-bd89-97f31baa72aa admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:40:32.647358 dv-cinder-853678-3-smb devstack@keystone.service[88096]: WARNING keystone.common.rbac_enforcer.enforcer [None req-fb8d2e97-6b53-4b4a-bd89-97f31baa72aa admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 18 21:40:32.647712 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8d2e97-6b53-4b4a-bd89-97f31baa72aa admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:40:32.657730 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 2/4] 10.222.0.27 () {58 vars in 1324 bytes} [Thu Aug 18 21:40:32 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 18 21:40:32.663743 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ccab46-e0ac-4590-ad99-f0495a5137b2 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:40:32.679014 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ccab46-e0ac-4590-ad99-f0495a5137b2 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:40:32.683672 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41c5ca5-b2bf-477e-9d88-b00a0223428a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:40:32.684811 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41c5ca5-b2bf-477e-9d88-b00a0223428a admin admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:40:32.685099 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41c5ca5-b2bf-477e-9d88-b00a0223428a admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:40:32.685371 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41c5ca5-b2bf-477e-9d88-b00a0223428a admin admin] PATH_INFO: `/v3/projects/c586edb6eda041a285eb97d5b15554f4` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:40:32.686934 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41c5ca5-b2bf-477e-9d88-b00a0223428a admin admin] RBAC: Authorizing `identity:get_project(project_id=c586edb6eda041a285eb97d5b15554f4)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:40:32.742055 dv-cinder-853678-3-smb devstack@keystone.service[88097]: WARNING keystone.common.rbac_enforcer.enforcer [None req-a41c5ca5-b2bf-477e-9d88-b00a0223428a admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 18 21:40:32.742396 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41c5ca5-b2bf-477e-9d88-b00a0223428a admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:40:32.746999 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 3/5] 10.222.0.27 () {56 vars in 1207 bytes} [Thu Aug 18 21:40:32 2022] GET /identity/v3/projects/c586edb6eda041a285eb97d5b15554f4 => generated 344 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:40:34.628069 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6161327c-f41b-4d8b-8f1a-273e76856962 None None] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:40:34.628585 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6161327c-f41b-4d8b-8f1a-273e76856962 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:40:34.628718 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6161327c-f41b-4d8b-8f1a-273e76856962 None None] PATH_INFO: `/` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:40:34.632718 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 3/6] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:40:34 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:40:34.638011 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997f4bb1-889f-4462-9370-c5d8a561a365 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:40:34.638443 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997f4bb1-889f-4462-9370-c5d8a561a365 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:40:34.638564 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997f4bb1-889f-4462-9370-c5d8a561a365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:40:34.659239 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-997f4bb1-889f-4462-9370-c5d8a561a365 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:40:34.660798 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-997f4bb1-889f-4462-9370-c5d8a561a365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:40:34.668608 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 4/7] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:40:34 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 18 21:40:34.943668 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6161327c-f41b-4d8b-8f1a-273e76856962 None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:40:34.955685 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6161327c-f41b-4d8b-8f1a-273e76856962 None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:40:34.959856 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f0d520-8083-41c0-a81e-8266861a2f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:40:34.960448 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f0d520-8083-41c0-a81e-8266861a2f8c admin admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:40:34.960762 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f0d520-8083-41c0-a81e-8266861a2f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:40:34.961032 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f0d520-8083-41c0-a81e-8266861a2f8c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:40:34.968712 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f0d520-8083-41c0-a81e-8266861a2f8c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:40:34.970428 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f0d520-8083-41c0-a81e-8266861a2f8c admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:40:34.978996 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 4/8] 10.222.0.27 () {58 vars in 1324 bytes} [Thu Aug 18 21:40:34 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 18 21:40:34.985223 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997f4bb1-889f-4462-9370-c5d8a561a365 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:40:34.994294 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997f4bb1-889f-4462-9370-c5d8a561a365 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:40:34.998724 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160b9974-d8df-4699-a100-f4d039f24236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:40:34.999347 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160b9974-d8df-4699-a100-f4d039f24236 admin admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:40:35.000222 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160b9974-d8df-4699-a100-f4d039f24236 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:40:35.000498 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160b9974-d8df-4699-a100-f4d039f24236 admin admin] PATH_INFO: `/v3/users/b468708457d44a0a864439dd99359654` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:40:35.001965 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160b9974-d8df-4699-a100-f4d039f24236 admin admin] RBAC: Authorizing `identity:get_user(user_id=b468708457d44a0a864439dd99359654)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:40:35.003789 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160b9974-d8df-4699-a100-f4d039f24236 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:40:35.005349 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 5/9] 10.222.0.27 () {56 vars in 1198 bytes} [Thu Aug 18 21:40:34 2022] GET /identity/v3/users/b468708457d44a0a864439dd99359654 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:40:37.002787 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1026f3-6d40-411c-bcb7-77b4e6633eca None None] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:40:37.003328 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1026f3-6d40-411c-bcb7-77b4e6633eca None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:40:37.003328 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1026f3-6d40-411c-bcb7-77b4e6633eca None None] PATH_INFO: `/` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:40:37.004918 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 5/10] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:40:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 21:40:37.006860 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589f8053-47dc-4569-87a0-cbfb605d425a None None] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:40:37.007253 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589f8053-47dc-4569-87a0-cbfb605d425a None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:40:37.007530 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589f8053-47dc-4569-87a0-cbfb605d425a None None] PATH_INFO: `/` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:40:37.008957 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 6/11] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:40:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:40:37.009592 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2559af89-2461-45fd-ae32-43b5bc0487ba None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:40:37.009873 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2559af89-2461-45fd-ae32-43b5bc0487ba None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:40:37.010147 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2559af89-2461-45fd-ae32-43b5bc0487ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:40:37.013915 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da55e199-51b9-4630-b327-081740c43382 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:40:37.014478 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da55e199-51b9-4630-b327-081740c43382 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:40:37.014757 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da55e199-51b9-4630-b327-081740c43382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:40:37.035602 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-da55e199-51b9-4630-b327-081740c43382 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:40:37.036841 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-da55e199-51b9-4630-b327-081740c43382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:40:37.052978 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG passlib.handlers.bcrypt [None req-2559af89-2461-45fd-ae32-43b5bc0487ba None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=88096) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 18 21:40:37.053407 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG passlib.handlers.bcrypt [None req-2559af89-2461-45fd-ae32-43b5bc0487ba None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=88096) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 18 21:40:37.098908 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-2559af89-2461-45fd-ae32-43b5bc0487ba None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:40:37.100500 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-2559af89-2461-45fd-ae32-43b5bc0487ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:40:37.119870 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 7/12] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:40:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 21:40:37.198845 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 6/13] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:40:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 21:40:37.385662 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da55e199-51b9-4630-b327-081740c43382 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:40:37.410699 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:40:37.467822 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2559af89-2461-45fd-ae32-43b5bc0487ba None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:40:37.490705 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da55e199-51b9-4630-b327-081740c43382 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:40:37.524196 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e0f6be-90c7-47e0-bcae-6f6b364a201a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:40:37.524840 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e0f6be-90c7-47e0-bcae-6f6b364a201a None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:40:37.525128 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e0f6be-90c7-47e0-bcae-6f6b364a201a None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:40:37.525409 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e0f6be-90c7-47e0-bcae-6f6b364a201a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:40:37.574425 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2559af89-2461-45fd-ae32-43b5bc0487ba None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:40:37.578028 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:40:37.600415 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e0f6be-90c7-47e0-bcae-6f6b364a201a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:40:37.601853 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e0f6be-90c7-47e0-bcae-6f6b364a201a None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:40:37.613123 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79868a57-9c01-4897-8144-81b3587eade9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:40:37.614229 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79868a57-9c01-4897-8144-81b3587eade9 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:40:37.614719 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79868a57-9c01-4897-8144-81b3587eade9 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:40:37.614997 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79868a57-9c01-4897-8144-81b3587eade9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:40:37.626488 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:40:37.627214 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79868a57-9c01-4897-8144-81b3587eade9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:40:37.635857 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application [None req-79868a57-9c01-4897-8144-81b3587eade9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 21:40:37.635857 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:40:37.635857 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:40:37.635857 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:40:37.635857 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:40:37.635857 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:40:37.635857 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:40:37.635857 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:40:37.635857 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:40:37.635857 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:40:37.635857 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:40:37.635857 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:40:37.635857 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:40:37.635857 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:40:37.635857 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:40:37.635857 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:40:37.636781 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:40:37.636781 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:40:37.636781 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:40:37.636781 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:40:37.636781 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:40:37.636781 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:40:37.636781 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:40:37.636781 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:40:37.636781 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:40:37.636781 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:40:37.636781 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:40:37.636781 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application with Lock( Aug 18 21:40:37.636781 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:40:37.636781 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:40:37.636781 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:40:37.636781 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:40:37.637611 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:40:37.637611 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:40:37.637611 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:40:37.637611 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:40:37.637611 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:40:37.637611 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:40:37.637611 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:40:37.637611 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:40:37.637611 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:40:37.637611 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:40:37.637611 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 21:40:37.637611 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:40:37.637611 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 7/14] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Aug 18 21:40:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 21:40:37.643761 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79868a57-9c01-4897-8144-81b3587eade9 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:40:37.707509 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 8/15] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Aug 18 21:40:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 21:40:37.713403 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e0f6be-90c7-47e0-bcae-6f6b364a201a None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:40:37.747091 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79868a57-9c01-4897-8144-81b3587eade9 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:40:37.780255 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75faccd7-ba5e-4aed-b3ac-2c5bcaf7d2c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:40:37.781515 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75faccd7-ba5e-4aed-b3ac-2c5bcaf7d2c2 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:40:37.782333 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75faccd7-ba5e-4aed-b3ac-2c5bcaf7d2c2 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:40:37.782605 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75faccd7-ba5e-4aed-b3ac-2c5bcaf7d2c2 None admin] PATH_INFO: `/v3/roles` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:40:37.783305 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75faccd7-ba5e-4aed-b3ac-2c5bcaf7d2c2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:40:37.783613 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75faccd7-ba5e-4aed-b3ac-2c5bcaf7d2c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:40:37.785080 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75faccd7-ba5e-4aed-b3ac-2c5bcaf7d2c2 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:40:37.797748 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 8/16] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Aug 18 21:40:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 21:40:37.803921 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75faccd7-ba5e-4aed-b3ac-2c5bcaf7d2c2 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:40:37.814987 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e0f6be-90c7-47e0-bcae-6f6b364a201a None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:40:37.830746 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:40:37.837155 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:40:37.848926 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fec2075-c579-424e-9f3c-8056a2989b7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:40:37.849562 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fec2075-c579-424e-9f3c-8056a2989b7d None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:40:37.849839 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fec2075-c579-424e-9f3c-8056a2989b7d None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:40:37.850162 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fec2075-c579-424e-9f3c-8056a2989b7d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:40:37.861440 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fec2075-c579-424e-9f3c-8056a2989b7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:40:37.862928 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fec2075-c579-424e-9f3c-8056a2989b7d None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:40:37.881456 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application [None req-4fec2075-c579-424e-9f3c-8056a2989b7d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:40:37.881456 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:40:37.881456 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:40:37.881456 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:40:37.881456 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:40:37.881456 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:40:37.881456 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:40:37.881456 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:40:37.881456 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:40:37.881456 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:40:37.881456 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:40:37.881456 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:40:37.881456 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 21:40:37.881456 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 21:40:37.881456 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 21:40:37.881456 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 21:40:37.882462 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:40:37.882462 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:40:37.882462 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:40:37.882462 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:40:37.882462 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:40:37.882462 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:40:37.882462 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:40:37.882462 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application with Lock( Aug 18 21:40:37.882462 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:40:37.882462 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:40:37.882462 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:40:37.882462 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:40:37.882462 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:40:37.882462 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:40:37.882462 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:40:37.882462 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:40:37.882462 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 21:40:37.885348 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 21:40:37.885348 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:40:37.885348 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:40:37.885348 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 9/17] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 18 21:40:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 21:40:37.888564 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fec2075-c579-424e-9f3c-8056a2989b7d None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:40:37.905691 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75faccd7-ba5e-4aed-b3ac-2c5bcaf7d2c2 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:40:37.940482 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c3e290-73a9-4050-a86f-4c976143e03d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:40:37.941140 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c3e290-73a9-4050-a86f-4c976143e03d None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:40:37.941422 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c3e290-73a9-4050-a86f-4c976143e03d None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:40:37.941694 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c3e290-73a9-4050-a86f-4c976143e03d None admin] PATH_INFO: `/v3/users/b468708457d44a0a864439dd99359654` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:40:37.943196 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c3e290-73a9-4050-a86f-4c976143e03d None admin] RBAC: Authorizing `identity:get_user(user_id=b468708457d44a0a864439dd99359654)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:40:37.944669 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c3e290-73a9-4050-a86f-4c976143e03d None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:40:37.946252 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 9/18] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Aug 18 21:40:37 2022] GET /identity/v3/users/b468708457d44a0a864439dd99359654 => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:40:37.951755 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c3e290-73a9-4050-a86f-4c976143e03d None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:40:37.991164 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fec2075-c579-424e-9f3c-8056a2989b7d None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:40:38.024207 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5ffdf1-121d-4bc8-b658-c4f61fe2cfc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:40:38.024855 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5ffdf1-121d-4bc8-b658-c4f61fe2cfc0 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:40:38.025110 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5ffdf1-121d-4bc8-b658-c4f61fe2cfc0 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:40:38.025381 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5ffdf1-121d-4bc8-b658-c4f61fe2cfc0 None admin] PATH_INFO: `/v3/domains` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:40:38.026026 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5ffdf1-121d-4bc8-b658-c4f61fe2cfc0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:40:38.026327 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5ffdf1-121d-4bc8-b658-c4f61fe2cfc0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:40:38.027711 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5ffdf1-121d-4bc8-b658-c4f61fe2cfc0 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:40:38.044191 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:40:38.044655 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 10/19] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 18 21:40:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 21:40:38.052352 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c3e290-73a9-4050-a86f-4c976143e03d None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:40:38.092553 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7e0df3-941e-4461-93dc-cb1d2cc7eaef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:40:38.093154 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7e0df3-941e-4461-93dc-cb1d2cc7eaef None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:40:38.093508 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7e0df3-941e-4461-93dc-cb1d2cc7eaef None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:40:38.094281 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7e0df3-941e-4461-93dc-cb1d2cc7eaef None admin] PATH_INFO: `/v3/domains/default` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:40:38.095630 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7e0df3-941e-4461-93dc-cb1d2cc7eaef None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:40:38.097186 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7e0df3-941e-4461-93dc-cb1d2cc7eaef None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:40:38.099028 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 10/20] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 18 21:40:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 21:40:38.104902 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5ffdf1-121d-4bc8-b658-c4f61fe2cfc0 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:40:38.142568 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:40:38.212125 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5ffdf1-121d-4bc8-b658-c4f61fe2cfc0 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:40:38.246717 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986f856b-cd75-479c-b057-8fe80292a293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:40:38.247326 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986f856b-cd75-479c-b057-8fe80292a293 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:40:38.247604 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986f856b-cd75-479c-b057-8fe80292a293 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:40:38.247881 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986f856b-cd75-479c-b057-8fe80292a293 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:40:38.248630 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986f856b-cd75-479c-b057-8fe80292a293 None admin] RBAC: Adding query filter params (role.id=0833202e2a3d47d1b6b3af57006641b1, scope.domain.id=default, user.id=b468708457d44a0a864439dd99359654) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:40:38.248940 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986f856b-cd75-479c-b057-8fe80292a293 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:40:38.250436 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986f856b-cd75-479c-b057-8fe80292a293 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:40:38.258148 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 11/21] 10.222.0.27 () {56 vars in 1322 bytes} [Thu Aug 18 21:40:38 2022] GET /identity/v3/role_assignments?user.id=b468708457d44a0a864439dd99359654&scope.domain.id=default&role.id=0833202e2a3d47d1b6b3af57006641b1 => generated 233 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:40:40.237935 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9baf73b-f266-4ccb-8661-3165d159b4b8 None None] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:40:40.239017 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9baf73b-f266-4ccb-8661-3165d159b4b8 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:40:40.239507 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9baf73b-f266-4ccb-8661-3165d159b4b8 None None] PATH_INFO: `/` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:40:40.241392 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 11/22] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:40:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:40:40.262609 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364b41bf-fc4c-42da-9585-470050fd6e55 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:40:40.263078 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364b41bf-fc4c-42da-9585-470050fd6e55 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:40:40.263181 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364b41bf-fc4c-42da-9585-470050fd6e55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:40:40.294093 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-364b41bf-fc4c-42da-9585-470050fd6e55 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:40:40.295463 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-364b41bf-fc4c-42da-9585-470050fd6e55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:40:40.372498 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d262ab-f830-47bd-9dcc-834a4403e306 None None] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:40:40.373191 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d262ab-f830-47bd-9dcc-834a4403e306 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:40:40.373685 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d262ab-f830-47bd-9dcc-834a4403e306 None None] PATH_INFO: `/` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:40:40.380919 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 12/23] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:40:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:40:40.388448 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd94d9b4-e528-44cb-89a9-3064cc7f007a None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:40:40.389334 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd94d9b4-e528-44cb-89a9-3064cc7f007a None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:40:40.389803 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 12/24] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:40:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 21:40:40.390098 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd94d9b4-e528-44cb-89a9-3064cc7f007a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:40:40.420710 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-bd94d9b4-e528-44cb-89a9-3064cc7f007a None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:40:40.422913 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-bd94d9b4-e528-44cb-89a9-3064cc7f007a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:40:40.497306 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c5f45a-09f6-421d-ae04-8643dae16431 None None] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:40:40.497609 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c5f45a-09f6-421d-ae04-8643dae16431 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:40:40.497791 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c5f45a-09f6-421d-ae04-8643dae16431 None None] PATH_INFO: `/` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:40:40.499246 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 13/25] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:40:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 21:40:40.504940 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924efaac-cc3a-4538-8350-5a9bf1e09d78 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:40:40.505220 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924efaac-cc3a-4538-8350-5a9bf1e09d78 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:40:40.505490 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924efaac-cc3a-4538-8350-5a9bf1e09d78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:40:40.518726 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 13/26] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:40:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 21:40:40.524821 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-924efaac-cc3a-4538-8350-5a9bf1e09d78 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:40:40.526010 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-924efaac-cc3a-4538-8350-5a9bf1e09d78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:40:40.561027 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:40:40.614468 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 14/27] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:40:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 21:40:40.854910 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd94d9b4-e528-44cb-89a9-3064cc7f007a None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:40:40.951002 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:40:40.960279 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd94d9b4-e528-44cb-89a9-3064cc7f007a None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:40:40.993134 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924efaac-cc3a-4538-8350-5a9bf1e09d78 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:40:40.995702 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88fd004-fbae-45fe-9f2c-ab6c9c65b910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:40:40.996336 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88fd004-fbae-45fe-9f2c-ab6c9c65b910 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:40:40.996633 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88fd004-fbae-45fe-9f2c-ab6c9c65b910 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:40:40.996910 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88fd004-fbae-45fe-9f2c-ab6c9c65b910 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:40:41.019169 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88fd004-fbae-45fe-9f2c-ab6c9c65b910 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:40:41.020260 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88fd004-fbae-45fe-9f2c-ab6c9c65b910 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:40:41.037693 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application [None req-d88fd004-fbae-45fe-9f2c-ab6c9c65b910 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:40:41.037693 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:40:41.037693 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:40:41.037693 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:40:41.037693 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:40:41.037693 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:40:41.037693 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:40:41.037693 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:40:41.037693 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:40:41.037693 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:40:41.037693 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:40:41.037693 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:40:41.037693 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 21:40:41.037693 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 21:40:41.037693 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 21:40:41.037693 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 21:40:41.038622 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:40:41.038622 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:40:41.038622 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:40:41.038622 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:40:41.038622 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:40:41.038622 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:40:41.038622 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:40:41.038622 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application with Lock( Aug 18 21:40:41.038622 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:40:41.038622 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:40:41.038622 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:40:41.038622 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:40:41.038622 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:40:41.038622 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:40:41.038622 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:40:41.038622 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:40:41.038622 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 21:40:41.039413 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 21:40:41.039413 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:40:41.039413 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:40:41.039413 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 14/28] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 18 21:40:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:40:41.045503 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88fd004-fbae-45fe-9f2c-ab6c9c65b910 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:40:41.158711 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88fd004-fbae-45fe-9f2c-ab6c9c65b910 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:40:41.195239 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7bb539-6100-4543-8c61-1c666cf041b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:40:41.196626 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7bb539-6100-4543-8c61-1c666cf041b5 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:40:41.196626 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7bb539-6100-4543-8c61-1c666cf041b5 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:40:41.196626 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7bb539-6100-4543-8c61-1c666cf041b5 None admin] PATH_INFO: `/v3/domains` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:40:41.197223 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7bb539-6100-4543-8c61-1c666cf041b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:40:41.197516 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7bb539-6100-4543-8c61-1c666cf041b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:40:41.199021 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7bb539-6100-4543-8c61-1c666cf041b5 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:40:41.219597 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 15/29] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 18 21:40:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:40:41.220230 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7bb539-6100-4543-8c61-1c666cf041b5 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:40:41.228927 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:40:41.233625 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924efaac-cc3a-4538-8350-5a9bf1e09d78 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:40:41.292973 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee693bc6-be4a-4ea9-9426-3bd3f380fb78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:40:41.293587 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee693bc6-be4a-4ea9-9426-3bd3f380fb78 None admin] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:40:41.293881 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee693bc6-be4a-4ea9-9426-3bd3f380fb78 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:40:41.294389 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee693bc6-be4a-4ea9-9426-3bd3f380fb78 None admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:40:41.295075 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee693bc6-be4a-4ea9-9426-3bd3f380fb78 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:40:41.297725 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee693bc6-be4a-4ea9-9426-3bd3f380fb78 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:40:41.340519 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7bb539-6100-4543-8c61-1c666cf041b5 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:40:41.378490 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfe4905-05d0-4418-b8cc-b13add858524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:40:41.379125 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfe4905-05d0-4418-b8cc-b13add858524 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:40:41.379408 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfe4905-05d0-4418-b8cc-b13add858524 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:40:41.379684 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfe4905-05d0-4418-b8cc-b13add858524 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:40:41.394239 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfe4905-05d0-4418-b8cc-b13add858524 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:40:41.399281 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application [None req-ccfe4905-05d0-4418-b8cc-b13add858524 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 21:40:41.399281 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:40:41.399281 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:40:41.399281 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:40:41.399281 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:40:41.399281 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:40:41.399281 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:40:41.399281 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:40:41.399281 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:40:41.399281 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:40:41.399281 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:40:41.399281 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:40:41.399281 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:40:41.399281 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:40:41.399281 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:40:41.399281 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:40:41.400100 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:40:41.400100 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:40:41.400100 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:40:41.400100 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:40:41.400100 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:40:41.400100 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:40:41.400100 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:40:41.400100 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:40:41.400100 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:40:41.400100 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:40:41.400100 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:40:41.400100 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application with Lock( Aug 18 21:40:41.400100 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:40:41.400100 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:40:41.400100 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:40:41.400100 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:40:41.400903 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:40:41.400903 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:40:41.400903 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:40:41.400903 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:40:41.400903 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:40:41.400903 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:40:41.400903 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:40:41.400903 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:40:41.400903 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:40:41.400903 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:40:41.400903 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 21:40:41.400903 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:40:41.400903 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 16/30] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Aug 18 21:40:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:40:41.406982 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc405b9-ae7d-4ef8-b2fc-052c3cb0793e None None] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:40:41.406982 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc405b9-ae7d-4ef8-b2fc-052c3cb0793e None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:40:41.406982 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc405b9-ae7d-4ef8-b2fc-052c3cb0793e None None] PATH_INFO: `/` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:40:41.406982 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 17/31] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:40:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:40:41.406982 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc405b9-ae7d-4ef8-b2fc-052c3cb0793e None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:40:41.482070 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:40:41.515038 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 15/32] 10.222.0.27 () {60 vars in 1131 bytes} [Thu Aug 18 21:40:40 2022] POST /identity/v3/roles => generated 219 bytes in 522 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 21:40:41.516673 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee693bc6-be4a-4ea9-9426-3bd3f380fb78 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:40:41.525979 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc405b9-ae7d-4ef8-b2fc-052c3cb0793e None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:40:41.538844 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:40:41.565580 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ef8e9b-32b9-4fa6-b376-3c90ab779f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:40:41.566630 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ef8e9b-32b9-4fa6-b376-3c90ab779f95 None admin] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:40:41.567169 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ef8e9b-32b9-4fa6-b376-3c90ab779f95 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:40:41.567647 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ef8e9b-32b9-4fa6-b376-3c90ab779f95 None admin] PATH_INFO: `/v3/projects` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:40:41.568518 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ef8e9b-32b9-4fa6-b376-3c90ab779f95 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:40:41.570346 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ef8e9b-32b9-4fa6-b376-3c90ab779f95 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:40:41.638401 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee693bc6-be4a-4ea9-9426-3bd3f380fb78 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:40:41.677900 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8652ca45-a0f1-48c3-ad55-217a30ac4e1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:40:41.678534 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8652ca45-a0f1-48c3-ad55-217a30ac4e1e None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:40:41.678818 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8652ca45-a0f1-48c3-ad55-217a30ac4e1e None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:40:41.679100 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8652ca45-a0f1-48c3-ad55-217a30ac4e1e None admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:40:41.679888 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8652ca45-a0f1-48c3-ad55-217a30ac4e1e None admin] RBAC: Adding query filter params (name=admin) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:40:41.680195 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8652ca45-a0f1-48c3-ad55-217a30ac4e1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:40:41.681791 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8652ca45-a0f1-48c3-ad55-217a30ac4e1e None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:40:41.695727 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 16/33] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Aug 18 21:40:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:40:41.699252 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40458026-da3d-46bd-916c-606ed83bf3eb None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:40:41.699252 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40458026-da3d-46bd-916c-606ed83bf3eb None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:40:41.699252 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40458026-da3d-46bd-916c-606ed83bf3eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:40:41.720016 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-40458026-da3d-46bd-916c-606ed83bf3eb None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:40:41.721768 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-40458026-da3d-46bd-916c-606ed83bf3eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:40:41.801674 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 17/34] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:40:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 21:40:41.802462 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40458026-da3d-46bd-916c-606ed83bf3eb None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:40:41.818705 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:40:41.866705 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 18/35] 10.222.0.27 () {60 vars in 1141 bytes} [Thu Aug 18 21:40:41 2022] POST /identity/v3/projects => generated 301 bytes in 460 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:40:41.951038 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40458026-da3d-46bd-916c-606ed83bf3eb None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:40:41.996568 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a598dbec-f846-4f3f-82f4-b9c3a0870091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:40:41.997235 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a598dbec-f846-4f3f-82f4-b9c3a0870091 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:40:41.997519 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a598dbec-f846-4f3f-82f4-b9c3a0870091 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:40:41.997797 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a598dbec-f846-4f3f-82f4-b9c3a0870091 None admin] PATH_INFO: `/v3/users/b468708457d44a0a864439dd99359654` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:40:41.998995 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a598dbec-f846-4f3f-82f4-b9c3a0870091 None admin] RBAC: Authorizing `identity:get_user(user_id=b468708457d44a0a864439dd99359654)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:40:42.000796 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a598dbec-f846-4f3f-82f4-b9c3a0870091 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:40:42.002555 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 18/36] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Aug 18 21:40:41 2022] GET /identity/v3/users/b468708457d44a0a864439dd99359654 => generated 247 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:40:42.003725 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809bba22-3164-4b04-adbc-b0e4ff6a827a None None] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:40:42.004232 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809bba22-3164-4b04-adbc-b0e4ff6a827a None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:40:42.005451 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809bba22-3164-4b04-adbc-b0e4ff6a827a None None] PATH_INFO: `/` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:40:42.006116 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 19/37] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:40:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 21:40:42.011617 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a598dbec-f846-4f3f-82f4-b9c3a0870091 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:40:42.016912 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea829d1-ccd6-4562-a958-8f4bf9719b29 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:40:42.017308 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea829d1-ccd6-4562-a958-8f4bf9719b29 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:40:42.017707 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea829d1-ccd6-4562-a958-8f4bf9719b29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:40:42.039097 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-8ea829d1-ccd6-4562-a958-8f4bf9719b29 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:40:42.040879 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-8ea829d1-ccd6-4562-a958-8f4bf9719b29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:40:42.153522 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:40:42.163079 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 20/38] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:40:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 21:40:42.164051 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea829d1-ccd6-4562-a958-8f4bf9719b29 None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:40:42.178574 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a598dbec-f846-4f3f-82f4-b9c3a0870091 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:40:42.219173 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de73cd3a-2fb9-4291-bedc-0ee500ab03e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:40:42.220118 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de73cd3a-2fb9-4291-bedc-0ee500ab03e4 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:40:42.220407 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de73cd3a-2fb9-4291-bedc-0ee500ab03e4 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:40:42.220722 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de73cd3a-2fb9-4291-bedc-0ee500ab03e4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:40:42.221896 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de73cd3a-2fb9-4291-bedc-0ee500ab03e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:40:42.222266 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:40:42.223367 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de73cd3a-2fb9-4291-bedc-0ee500ab03e4 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:40:42.225163 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 19/39] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 18 21:40:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:40:42.226297 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94aa872-7a67-4922-a6f7-f933b74b7172 None None] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:40:42.226587 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94aa872-7a67-4922-a6f7-f933b74b7172 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:40:42.226863 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94aa872-7a67-4922-a6f7-f933b74b7172 None None] PATH_INFO: `/` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:40:42.228070 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 20/40] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:40:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:40:42.232504 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94aa872-7a67-4922-a6f7-f933b74b7172 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:40:42.298445 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea829d1-ccd6-4562-a958-8f4bf9719b29 None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:40:42.334604 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd618c9-262a-4008-82a7-6a06fedac2e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:40:42.335219 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd618c9-262a-4008-82a7-6a06fedac2e5 None admin] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:40:42.335508 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd618c9-262a-4008-82a7-6a06fedac2e5 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:40:42.335782 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd618c9-262a-4008-82a7-6a06fedac2e5 None admin] PATH_INFO: `/v3/roles` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:40:42.336450 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd618c9-262a-4008-82a7-6a06fedac2e5 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:40:42.337996 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd618c9-262a-4008-82a7-6a06fedac2e5 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:40:42.358855 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94aa872-7a67-4922-a6f7-f933b74b7172 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:40:42.393561 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a4072e-420c-409a-874f-c007057e8ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:40:42.394215 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a4072e-420c-409a-874f-c007057e8ad1 None admin] REQUEST_METHOD: `PUT` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:40:42.394495 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a4072e-420c-409a-874f-c007057e8ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:40:42.394770 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a4072e-420c-409a-874f-c007057e8ad1 None admin] PATH_INFO: `/v3/domains/default/users/b468708457d44a0a864439dd99359654/roles/0833202e2a3d47d1b6b3af57006641b1` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:40:42.396765 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a4072e-420c-409a-874f-c007057e8ad1 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=b468708457d44a0a864439dd99359654, role_id=0833202e2a3d47d1b6b3af57006641b1)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:40:42.398210 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a4072e-420c-409a-874f-c007057e8ad1 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:40:42.413490 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 21/41] 10.222.0.27 () {60 vars in 1131 bytes} [Thu Aug 18 21:40:42 2022] POST /identity/v3/roles => generated 225 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:40:42.414652 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfff1ea4-c771-4f70-ab07-ff35c323f65e None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:40:42.414940 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfff1ea4-c771-4f70-ab07-ff35c323f65e None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:40:42.415217 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfff1ea4-c771-4f70-ab07-ff35c323f65e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:40:42.435962 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-cfff1ea4-c771-4f70-ab07-ff35c323f65e None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:40:42.437909 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-cfff1ea4-c771-4f70-ab07-ff35c323f65e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:40:42.509998 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 21/42] 10.222.0.27 () {58 vars in 1361 bytes} [Thu Aug 18 21:40:42 2022] PUT /identity/v3/domains/default/users/b468708457d44a0a864439dd99359654/roles/0833202e2a3d47d1b6b3af57006641b1 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:40:42.510955 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a4072e-420c-409a-874f-c007057e8ad1 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:40:42.522153 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:40:42.528334 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 22/43] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:40:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 21:40:42.652304 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a4072e-420c-409a-874f-c007057e8ad1 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:40:42.691383 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39460af3-a4dc-4ce5-8b28-9d8d48d7fa34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:40:42.691932 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39460af3-a4dc-4ce5-8b28-9d8d48d7fa34 None admin] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:40:42.692218 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39460af3-a4dc-4ce5-8b28-9d8d48d7fa34 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:40:42.692497 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39460af3-a4dc-4ce5-8b28-9d8d48d7fa34 None admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:40:42.693202 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39460af3-a4dc-4ce5-8b28-9d8d48d7fa34 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:40:42.694605 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39460af3-a4dc-4ce5-8b28-9d8d48d7fa34 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:40:42.746307 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 22/44] 10.222.0.27 () {60 vars in 1131 bytes} [Thu Aug 18 21:40:42 2022] POST /identity/v3/roles => generated 223 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:40:42.810650 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfff1ea4-c771-4f70-ab07-ff35c323f65e None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:40:42.849045 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:40:42.918924 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfff1ea4-c771-4f70-ab07-ff35c323f65e None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:40:42.955212 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448194b3-7bf4-4fa7-9e7a-baf383a7d86f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:40:42.955780 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448194b3-7bf4-4fa7-9e7a-baf383a7d86f None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:40:42.956062 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448194b3-7bf4-4fa7-9e7a-baf383a7d86f None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:40:42.956335 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448194b3-7bf4-4fa7-9e7a-baf383a7d86f None admin] PATH_INFO: `/v3/domains/default` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:40:42.957472 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448194b3-7bf4-4fa7-9e7a-baf383a7d86f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:40:42.958930 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448194b3-7bf4-4fa7-9e7a-baf383a7d86f None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:40:42.960493 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 23/45] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 18 21:40:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:40:42.966146 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39460af3-a4dc-4ce5-8b28-9d8d48d7fa34 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:40:43.147341 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:40:43.181372 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39460af3-a4dc-4ce5-8b28-9d8d48d7fa34 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:40:43.215824 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4039a68-d1a5-4557-b78e-1aebf0aea9c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:40:43.216363 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4039a68-d1a5-4557-b78e-1aebf0aea9c1 None admin] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:40:43.216678 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4039a68-d1a5-4557-b78e-1aebf0aea9c1 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:40:43.216957 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4039a68-d1a5-4557-b78e-1aebf0aea9c1 None admin] PATH_INFO: `/v3/projects` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:40:43.217615 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4039a68-d1a5-4557-b78e-1aebf0aea9c1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:40:43.219271 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4039a68-d1a5-4557-b78e-1aebf0aea9c1 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:40:43.305523 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 23/46] 10.222.0.27 () {60 vars in 1141 bytes} [Thu Aug 18 21:40:42 2022] POST /identity/v3/projects => generated 312 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:40:44.493573 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d8132e-9e35-4c61-a3ef-f953ab1025be None None] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:40:44.494108 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d8132e-9e35-4c61-a3ef-f953ab1025be None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:40:44.494108 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d8132e-9e35-4c61-a3ef-f953ab1025be None None] PATH_INFO: `/` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:40:44.495473 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 24/47] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:40:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:40:44.501340 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105f1895-8da3-4ed0-a318-4663709c0909 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:40:44.501755 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105f1895-8da3-4ed0-a318-4663709c0909 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:40:44.501897 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105f1895-8da3-4ed0-a318-4663709c0909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:40:44.520537 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-105f1895-8da3-4ed0-a318-4663709c0909 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:40:44.521786 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-105f1895-8da3-4ed0-a318-4663709c0909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:40:44.586692 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 24/48] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:40:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 21:40:44.854898 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d8132e-9e35-4c61-a3ef-f953ab1025be None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:40:44.955606 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d8132e-9e35-4c61-a3ef-f953ab1025be None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:40:44.957890 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:40:44.989116 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30f4489-aa12-4a18-95bc-393ad2ea5cae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:40:44.989740 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30f4489-aa12-4a18-95bc-393ad2ea5cae None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:40:44.990030 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30f4489-aa12-4a18-95bc-393ad2ea5cae None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:40:44.990503 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30f4489-aa12-4a18-95bc-393ad2ea5cae None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:40:45.001589 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30f4489-aa12-4a18-95bc-393ad2ea5cae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:40:45.006271 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application [None req-f30f4489-aa12-4a18-95bc-393ad2ea5cae None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 21:40:45.006271 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:40:45.006271 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:40:45.006271 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:40:45.006271 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:40:45.006271 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:40:45.006271 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:40:45.006271 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:40:45.006271 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:40:45.006271 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:40:45.006271 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:40:45.006271 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:40:45.006271 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:40:45.006271 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:40:45.006271 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:40:45.006271 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:40:45.007103 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:40:45.007103 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:40:45.007103 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:40:45.007103 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:40:45.007103 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:40:45.007103 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:40:45.007103 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:40:45.007103 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:40:45.007103 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:40:45.007103 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:40:45.007103 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:40:45.007103 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application with Lock( Aug 18 21:40:45.007103 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:40:45.007103 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:40:45.007103 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:40:45.007103 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:40:45.007861 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:40:45.007861 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:40:45.007861 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:40:45.007861 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:40:45.007861 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:40:45.007861 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:40:45.007861 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:40:45.007861 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:40:45.007861 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:40:45.007861 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:40:45.007861 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 21:40:45.007861 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:40:45.007861 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 25/49] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Aug 18 21:40:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:40:45.013152 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105f1895-8da3-4ed0-a318-4663709c0909 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:40:45.059998 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:40:45.110349 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105f1895-8da3-4ed0-a318-4663709c0909 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:40:45.144887 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2344b955-902d-490f-b9f8-ed464b4e6f72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:40:45.145497 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2344b955-902d-490f-b9f8-ed464b4e6f72 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:40:45.145778 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2344b955-902d-490f-b9f8-ed464b4e6f72 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:40:45.146053 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2344b955-902d-490f-b9f8-ed464b4e6f72 None admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:40:45.146719 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2344b955-902d-490f-b9f8-ed464b4e6f72 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:40:45.147022 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2344b955-902d-490f-b9f8-ed464b4e6f72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:40:45.148403 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2344b955-902d-490f-b9f8-ed464b4e6f72 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:40:45.156739 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 25/50] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Aug 18 21:40:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:40:45.162055 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30f4489-aa12-4a18-95bc-393ad2ea5cae None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:40:45.233556 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a5afe7-2ceb-455d-a928-77457f8cd9ee None None] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:40:45.233848 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a5afe7-2ceb-455d-a928-77457f8cd9ee None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:40:45.234306 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a5afe7-2ceb-455d-a928-77457f8cd9ee None None] PATH_INFO: `/` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:40:45.235653 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 26/51] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:40:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 21:40:45.240524 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e5ccbe-5dfd-4e12-a75f-4990045eca9d None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:40:45.240830 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e5ccbe-5dfd-4e12-a75f-4990045eca9d None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:40:45.241102 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e5ccbe-5dfd-4e12-a75f-4990045eca9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:40:45.259529 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-74e5ccbe-5dfd-4e12-a75f-4990045eca9d None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:40:45.260776 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-74e5ccbe-5dfd-4e12-a75f-4990045eca9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:40:45.263059 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30f4489-aa12-4a18-95bc-393ad2ea5cae None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:40:45.299655 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c9150e-9e65-47f5-8353-d8631ee310f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:40:45.300288 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c9150e-9e65-47f5-8353-d8631ee310f1 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:40:45.300572 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c9150e-9e65-47f5-8353-d8631ee310f1 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:40:45.300871 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c9150e-9e65-47f5-8353-d8631ee310f1 None admin] PATH_INFO: `/v3/users/b468708457d44a0a864439dd99359654` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:40:45.301998 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c9150e-9e65-47f5-8353-d8631ee310f1 None admin] RBAC: Authorizing `identity:get_user(user_id=b468708457d44a0a864439dd99359654)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:40:45.303455 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c9150e-9e65-47f5-8353-d8631ee310f1 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:40:45.305065 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 26/52] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Aug 18 21:40:45 2022] GET /identity/v3/users/b468708457d44a0a864439dd99359654 => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:40:45.310657 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c9150e-9e65-47f5-8353-d8631ee310f1 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:40:45.328505 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 27/53] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:40:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 21:40:45.341876 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:40:45.410538 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c9150e-9e65-47f5-8353-d8631ee310f1 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:40:45.444478 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10260b5f-b194-4891-b8f7-901f6c6cf5da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:40:45.445144 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10260b5f-b194-4891-b8f7-901f6c6cf5da None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:40:45.445430 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10260b5f-b194-4891-b8f7-901f6c6cf5da None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:40:45.445708 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10260b5f-b194-4891-b8f7-901f6c6cf5da None admin] PATH_INFO: `/v3/domains/default` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:40:45.446832 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10260b5f-b194-4891-b8f7-901f6c6cf5da None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:40:45.448278 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10260b5f-b194-4891-b8f7-901f6c6cf5da None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:40:45.449880 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 27/54] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 18 21:40:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:40:45.456064 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e5ccbe-5dfd-4e12-a75f-4990045eca9d None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:40:45.498948 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:40:45.555436 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e5ccbe-5dfd-4e12-a75f-4990045eca9d None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:40:45.588878 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6b8016-13c0-4c4b-b509-1de783dc851a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:40:45.589486 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6b8016-13c0-4c4b-b509-1de783dc851a None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:40:45.589772 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6b8016-13c0-4c4b-b509-1de783dc851a None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:40:45.590050 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6b8016-13c0-4c4b-b509-1de783dc851a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:40:45.590780 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6b8016-13c0-4c4b-b509-1de783dc851a None admin] RBAC: Adding query filter params (role.id=0833202e2a3d47d1b6b3af57006641b1, scope.domain.id=default, user.id=b468708457d44a0a864439dd99359654) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:40:45.591091 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6b8016-13c0-4c4b-b509-1de783dc851a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:40:45.592557 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6b8016-13c0-4c4b-b509-1de783dc851a None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:40:45.597858 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10260b5f-b194-4891-b8f7-901f6c6cf5da None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:40:45.598392 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 28/55] 10.222.0.27 () {56 vars in 1322 bytes} [Thu Aug 18 21:40:45 2022] GET /identity/v3/role_assignments?user.id=b468708457d44a0a864439dd99359654&scope.domain.id=default&role.id=0833202e2a3d47d1b6b3af57006641b1 => generated 530 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:40:45.700964 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:40:45.704892 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10260b5f-b194-4891-b8f7-901f6c6cf5da None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:40:45.741024 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e42085-9133-418d-b6e0-5c925e8b81a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:40:45.741657 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e42085-9133-418d-b6e0-5c925e8b81a9 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:40:45.741935 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e42085-9133-418d-b6e0-5c925e8b81a9 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:40:45.742206 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e42085-9133-418d-b6e0-5c925e8b81a9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:40:45.743500 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e42085-9133-418d-b6e0-5c925e8b81a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:40:45.744757 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e42085-9133-418d-b6e0-5c925e8b81a9 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:40:45.746542 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 28/56] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 18 21:40:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 21:40:45.752050 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6b8016-13c0-4c4b-b509-1de783dc851a None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:40:45.854305 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6b8016-13c0-4c4b-b509-1de783dc851a None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:40:45.856560 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:40:45.887927 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910d5ef5-c951-4a9e-8a20-566a463f89f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:40:45.888527 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910d5ef5-c951-4a9e-8a20-566a463f89f9 None admin] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:40:45.888840 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910d5ef5-c951-4a9e-8a20-566a463f89f9 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:40:45.889375 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910d5ef5-c951-4a9e-8a20-566a463f89f9 None admin] PATH_INFO: `/v3/projects` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:40:45.890022 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910d5ef5-c951-4a9e-8a20-566a463f89f9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:40:45.892264 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910d5ef5-c951-4a9e-8a20-566a463f89f9 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:40:45.973390 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 29/57] 10.222.0.27 () {60 vars in 1140 bytes} [Thu Aug 18 21:40:45 2022] POST /identity/v3/projects => generated 298 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:40:47.866461 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2fb096-b85f-4a37-b13f-9041d2623deb None None] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:40:47.866977 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2fb096-b85f-4a37-b13f-9041d2623deb None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:40:47.867063 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2fb096-b85f-4a37-b13f-9041d2623deb None None] PATH_INFO: `/` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:40:47.868376 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 29/58] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:40:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:40:47.873363 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eb37e8-0fe5-4ef3-a73b-800d1549db51 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:40:47.873812 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eb37e8-0fe5-4ef3-a73b-800d1549db51 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:40:47.873901 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eb37e8-0fe5-4ef3-a73b-800d1549db51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:40:47.892232 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-b5eb37e8-0fe5-4ef3-a73b-800d1549db51 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:40:47.893453 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-b5eb37e8-0fe5-4ef3-a73b-800d1549db51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:40:47.956774 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 30/59] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:40:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 21:40:48.233427 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2fb096-b85f-4a37-b13f-9041d2623deb None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:40:48.442835 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2fb096-b85f-4a37-b13f-9041d2623deb None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:40:48.475616 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f65c627-3c58-4bd7-9277-723bd7cdbf3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:40:48.476236 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f65c627-3c58-4bd7-9277-723bd7cdbf3e None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:40:48.476771 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f65c627-3c58-4bd7-9277-723bd7cdbf3e None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:40:48.477056 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f65c627-3c58-4bd7-9277-723bd7cdbf3e None admin] PATH_INFO: `/v3/domains/default` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:40:48.478316 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f65c627-3c58-4bd7-9277-723bd7cdbf3e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:40:48.479737 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f65c627-3c58-4bd7-9277-723bd7cdbf3e None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:40:48.481324 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 30/60] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 18 21:40:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:40:48.488503 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eb37e8-0fe5-4ef3-a73b-800d1549db51 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:40:48.570560 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:40:48.584787 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eb37e8-0fe5-4ef3-a73b-800d1549db51 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:40:48.617572 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6b25e5-c108-49f2-abc6-243836db9f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:40:48.618168 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6b25e5-c108-49f2-abc6-243836db9f24 None admin] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:40:48.618450 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6b25e5-c108-49f2-abc6-243836db9f24 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:40:48.618725 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6b25e5-c108-49f2-abc6-243836db9f24 None admin] PATH_INFO: `/v3/users` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:40:48.619373 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6b25e5-c108-49f2-abc6-243836db9f24 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:40:48.620843 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6b25e5-c108-49f2-abc6-243836db9f24 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:40:48.774042 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 31/61] 10.222.0.27 () {60 vars in 1132 bytes} [Thu Aug 18 21:40:48 2022] POST /identity/v3/users => generated 275 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 21:40:51.804068 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e356aef3-9b0b-4020-ab32-619bb15b5c15 None None] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:40:51.804934 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e356aef3-9b0b-4020-ab32-619bb15b5c15 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:40:51.805359 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e356aef3-9b0b-4020-ab32-619bb15b5c15 None None] PATH_INFO: `/` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:40:51.806880 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 31/62] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:40:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:40:51.813064 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9429fd0-9997-43e3-ad3d-4f6fcfc2cd91 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:40:51.813506 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9429fd0-9997-43e3-ad3d-4f6fcfc2cd91 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:40:51.813577 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9429fd0-9997-43e3-ad3d-4f6fcfc2cd91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:40:51.836838 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-c9429fd0-9997-43e3-ad3d-4f6fcfc2cd91 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:40:51.838326 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-c9429fd0-9997-43e3-ad3d-4f6fcfc2cd91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:40:51.932430 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 32/63] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:40:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 21:40:52.017016 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9f270f-138d-46b7-9101-8ac77ab0ed50 None None] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:40:52.017615 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9f270f-138d-46b7-9101-8ac77ab0ed50 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:40:52.018072 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9f270f-138d-46b7-9101-8ac77ab0ed50 None None] PATH_INFO: `/` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:40:52.019596 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 32/64] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:40:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:40:52.024843 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828b46e6-f722-48c2-a517-38d94cfb1901 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:40:52.025398 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828b46e6-f722-48c2-a517-38d94cfb1901 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:40:52.025856 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828b46e6-f722-48c2-a517-38d94cfb1901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:40:52.052077 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-828b46e6-f722-48c2-a517-38d94cfb1901 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:40:52.053618 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-828b46e6-f722-48c2-a517-38d94cfb1901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:40:52.120810 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce54469-1166-4c14-8d91-3270e42c69e6 None None] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:40:52.121381 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce54469-1166-4c14-8d91-3270e42c69e6 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:40:52.121854 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce54469-1166-4c14-8d91-3270e42c69e6 None None] PATH_INFO: `/` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:40:52.123424 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 33/65] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:40:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:40:52.142518 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd02c25-f1df-4be3-a611-89698f2cc53c None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:40:52.143109 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd02c25-f1df-4be3-a611-89698f2cc53c None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:40:52.143464 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd02c25-f1df-4be3-a611-89698f2cc53c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:40:52.146835 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 33/66] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:40:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 21:40:52.173648 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-bcd02c25-f1df-4be3-a611-89698f2cc53c None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:40:52.175088 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-bcd02c25-f1df-4be3-a611-89698f2cc53c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:40:52.214988 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:40:52.229566 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100a3f7c-cb65-4504-910a-e1283b2db556 None None] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:40:52.230155 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100a3f7c-cb65-4504-910a-e1283b2db556 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:40:52.237862 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100a3f7c-cb65-4504-910a-e1283b2db556 None None] PATH_INFO: `/` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:40:52.237862 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 34/67] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:40:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 21:40:52.237862 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc82a7a-f732-42cf-880a-73dced8b2eb3 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:40:52.237862 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc82a7a-f732-42cf-880a-73dced8b2eb3 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:40:52.237862 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc82a7a-f732-42cf-880a-73dced8b2eb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:40:52.244511 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:40:52.258914 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-fbc82a7a-f732-42cf-880a-73dced8b2eb3 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:40:52.261233 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-fbc82a7a-f732-42cf-880a-73dced8b2eb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:40:52.292084 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 34/68] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:40:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 21:40:52.309062 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd02c25-f1df-4be3-a611-89698f2cc53c None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:40:52.355639 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 35/69] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:40:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 21:40:52.444548 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd02c25-f1df-4be3-a611-89698f2cc53c None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:40:52.489838 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9780973-78b9-41fa-94b4-172dc79ee2e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:40:52.490474 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9780973-78b9-41fa-94b4-172dc79ee2e8 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:40:52.490754 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9780973-78b9-41fa-94b4-172dc79ee2e8 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:40:52.491030 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9780973-78b9-41fa-94b4-172dc79ee2e8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:40:52.506667 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9780973-78b9-41fa-94b4-172dc79ee2e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:40:52.509788 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc82a7a-f732-42cf-880a-73dced8b2eb3 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:40:52.513510 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application [None req-c9780973-78b9-41fa-94b4-172dc79ee2e8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 21:40:52.513510 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:40:52.513510 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:40:52.513510 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:40:52.513510 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:40:52.513510 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:40:52.513510 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:40:52.513510 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:40:52.513510 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:40:52.513510 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:40:52.513510 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:40:52.513510 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:40:52.513510 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:40:52.513510 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:40:52.513510 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:40:52.513510 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:40:52.514621 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:40:52.514621 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:40:52.514621 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:40:52.514621 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:40:52.514621 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:40:52.514621 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:40:52.514621 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:40:52.514621 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:40:52.514621 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:40:52.514621 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:40:52.514621 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:40:52.514621 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application with Lock( Aug 18 21:40:52.514621 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:40:52.514621 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:40:52.514621 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:40:52.514621 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:40:52.515484 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:40:52.515484 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:40:52.515484 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:40:52.515484 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:40:52.515484 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:40:52.515484 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:40:52.515484 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:40:52.515484 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:40:52.515484 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:40:52.515484 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:40:52.515484 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 21:40:52.515484 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:40:52.515484 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 35/70] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Aug 18 21:40:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 21:40:52.521260 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9780973-78b9-41fa-94b4-172dc79ee2e8 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:40:52.580997 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:40:52.658112 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc82a7a-f732-42cf-880a-73dced8b2eb3 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:40:52.674526 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9780973-78b9-41fa-94b4-172dc79ee2e8 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:40:52.689772 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:40:52.695282 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df3d864-c595-4404-9e2b-e5bf82e30a23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:40:52.696088 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df3d864-c595-4404-9e2b-e5bf82e30a23 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:40:52.696514 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df3d864-c595-4404-9e2b-e5bf82e30a23 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:40:52.696952 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df3d864-c595-4404-9e2b-e5bf82e30a23 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:40:52.709003 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c6d575-9683-4e83-9477-b5c09c19f46e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:40:52.709615 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c6d575-9683-4e83-9477-b5c09c19f46e None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:40:52.710001 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c6d575-9683-4e83-9477-b5c09c19f46e None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:40:52.710099 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df3d864-c595-4404-9e2b-e5bf82e30a23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:40:52.710286 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c6d575-9683-4e83-9477-b5c09c19f46e None admin] PATH_INFO: `/v3/roles` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:40:52.710957 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c6d575-9683-4e83-9477-b5c09c19f46e None admin] RBAC: Adding query filter params (name=member) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:40:52.711261 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c6d575-9683-4e83-9477-b5c09c19f46e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:40:52.712651 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c6d575-9683-4e83-9477-b5c09c19f46e None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:40:52.716828 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application [None req-1df3d864-c595-4404-9e2b-e5bf82e30a23 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 21:40:52.716828 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:40:52.716828 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:40:52.716828 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:40:52.716828 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:40:52.716828 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:40:52.716828 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:40:52.716828 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:40:52.716828 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:40:52.716828 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:40:52.716828 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:40:52.716828 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:40:52.716828 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:40:52.716828 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:40:52.716828 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:40:52.716828 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:40:52.717664 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:40:52.717664 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:40:52.717664 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:40:52.717664 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:40:52.717664 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:40:52.717664 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:40:52.717664 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:40:52.717664 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:40:52.717664 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:40:52.717664 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:40:52.717664 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:40:52.717664 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application with Lock( Aug 18 21:40:52.717664 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:40:52.717664 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:40:52.717664 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:40:52.717664 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:40:52.718982 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:40:52.718982 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:40:52.718982 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:40:52.718982 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:40:52.718982 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:40:52.718982 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:40:52.718982 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:40:52.718982 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:40:52.718982 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:40:52.718982 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:40:52.718982 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 21:40:52.718982 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:40:52.718982 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 36/71] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Aug 18 21:40:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:40:52.720391 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df3d864-c595-4404-9e2b-e5bf82e30a23 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:40:52.731243 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 36/72] 10.222.0.27 () {56 vars in 1101 bytes} [Thu Aug 18 21:40:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 21:40:52.731243 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6335fa-bd89-4604-b712-ba6f9167ce0b None None] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:40:52.731243 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6335fa-bd89-4604-b712-ba6f9167ce0b None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:40:52.731243 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6335fa-bd89-4604-b712-ba6f9167ce0b None None] PATH_INFO: `/` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:40:52.731243 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 37/73] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:40:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:40:52.731243 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6335fa-bd89-4604-b712-ba6f9167ce0b None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:40:52.823342 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:40:52.826154 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df3d864-c595-4404-9e2b-e5bf82e30a23 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:40:52.837521 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6335fa-bd89-4604-b712-ba6f9167ce0b None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:40:52.860304 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6445fe2-be66-471a-aba8-faed55400e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:40:52.860981 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6445fe2-be66-471a-aba8-faed55400e69 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:40:52.861262 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6445fe2-be66-471a-aba8-faed55400e69 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:40:52.861536 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6445fe2-be66-471a-aba8-faed55400e69 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:40:52.871422 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf5629e-ae73-4add-ba31-a78b7ac4d002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:40:52.871563 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6445fe2-be66-471a-aba8-faed55400e69 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:40:52.872031 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf5629e-ae73-4add-ba31-a78b7ac4d002 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:40:52.872319 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf5629e-ae73-4add-ba31-a78b7ac4d002 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:40:52.872628 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf5629e-ae73-4add-ba31-a78b7ac4d002 None admin] PATH_INFO: `/v3/roles` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:40:52.873287 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf5629e-ae73-4add-ba31-a78b7ac4d002 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:40:52.873595 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf5629e-ae73-4add-ba31-a78b7ac4d002 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:40:52.875513 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf5629e-ae73-4add-ba31-a78b7ac4d002 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:40:52.877445 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application [None req-f6445fe2-be66-471a-aba8-faed55400e69 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 21:40:52.877445 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:40:52.877445 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:40:52.877445 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:40:52.877445 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:40:52.877445 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:40:52.877445 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:40:52.877445 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:40:52.877445 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:40:52.877445 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:40:52.877445 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:40:52.877445 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:40:52.877445 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:40:52.877445 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:40:52.877445 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:40:52.877445 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:40:52.878432 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:40:52.878432 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:40:52.878432 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:40:52.878432 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:40:52.878432 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:40:52.878432 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:40:52.878432 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:40:52.878432 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:40:52.878432 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:40:52.878432 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:40:52.878432 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:40:52.878432 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application with Lock( Aug 18 21:40:52.878432 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:40:52.878432 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:40:52.878432 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:40:52.878432 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:40:52.879217 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:40:52.879217 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:40:52.879217 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:40:52.879217 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:40:52.879217 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:40:52.879217 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:40:52.879217 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:40:52.879217 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:40:52.879217 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:40:52.879217 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:40:52.879217 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 21:40:52.879217 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:40:52.879217 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 37/74] 10.222.0.27 () {56 vars in 1114 bytes} [Thu Aug 18 21:40:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:40:52.879839 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6445fe2-be66-471a-aba8-faed55400e69 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:40:52.886411 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 38/75] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Aug 18 21:40:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:40:52.887861 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e66235a-78f5-46ab-9a5d-163e046a5054 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:40:52.888152 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e66235a-78f5-46ab-9a5d-163e046a5054 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:40:52.888427 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e66235a-78f5-46ab-9a5d-163e046a5054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:40:52.906533 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-6e66235a-78f5-46ab-9a5d-163e046a5054 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:40:52.907714 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-6e66235a-78f5-46ab-9a5d-163e046a5054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:40:52.935127 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:40:52.975791 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 39/76] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:40:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 21:40:52.976563 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e66235a-78f5-46ab-9a5d-163e046a5054 None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:40:52.982656 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6445fe2-be66-471a-aba8-faed55400e69 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:40:53.018041 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31905d7-bc78-48dd-a6c1-3b20a402d0d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:40:53.018673 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31905d7-bc78-48dd-a6c1-3b20a402d0d1 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:40:53.018968 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31905d7-bc78-48dd-a6c1-3b20a402d0d1 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:40:53.019243 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31905d7-bc78-48dd-a6c1-3b20a402d0d1 None admin] PATH_INFO: `/v3/users/5935b35ad1844f5c827a7303ed74c83d` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:40:53.035029 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31905d7-bc78-48dd-a6c1-3b20a402d0d1 None admin] RBAC: Authorizing `identity:get_user(user_id=5935b35ad1844f5c827a7303ed74c83d)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:40:53.036512 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31905d7-bc78-48dd-a6c1-3b20a402d0d1 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:40:53.038195 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 38/77] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Aug 18 21:40:52 2022] GET /identity/v3/users/5935b35ad1844f5c827a7303ed74c83d => generated 275 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:40:53.038960 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31905d7-bc78-48dd-a6c1-3b20a402d0d1 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:40:53.076190 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:40:53.097763 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e66235a-78f5-46ab-9a5d-163e046a5054 None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:40:53.132166 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a19ec13-4577-46b8-a235-5316cf3d3eed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:40:53.132822 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a19ec13-4577-46b8-a235-5316cf3d3eed None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:40:53.133104 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a19ec13-4577-46b8-a235-5316cf3d3eed None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:40:53.133374 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a19ec13-4577-46b8-a235-5316cf3d3eed None admin] PATH_INFO: `/v3/roles/member` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:40:53.145120 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a19ec13-4577-46b8-a235-5316cf3d3eed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:40:53.147167 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31905d7-bc78-48dd-a6c1-3b20a402d0d1 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:40:53.149739 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application [None req-3a19ec13-4577-46b8-a235-5316cf3d3eed None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 21:40:53.149739 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:40:53.149739 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:40:53.149739 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:40:53.149739 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:40:53.149739 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:40:53.149739 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:40:53.149739 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:40:53.149739 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:40:53.149739 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:40:53.149739 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:40:53.149739 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:40:53.149739 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:40:53.149739 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:40:53.149739 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:40:53.149739 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:40:53.150600 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:40:53.150600 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:40:53.150600 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:40:53.150600 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:40:53.150600 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:40:53.150600 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:40:53.150600 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:40:53.150600 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:40:53.150600 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:40:53.150600 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:40:53.150600 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:40:53.150600 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application with Lock( Aug 18 21:40:53.150600 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:40:53.150600 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:40:53.150600 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:40:53.150600 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:40:53.151349 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:40:53.151349 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:40:53.151349 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:40:53.151349 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:40:53.151349 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:40:53.151349 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:40:53.151349 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:40:53.151349 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:40:53.151349 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:40:53.151349 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:40:53.151349 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 21:40:53.151349 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:40:53.151349 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 40/78] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Aug 18 21:40:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:40:53.156883 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a19ec13-4577-46b8-a235-5316cf3d3eed None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:40:53.161274 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:40:53.187610 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b28c96-8f62-43a8-97be-c22fb5d9d38d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:40:53.188307 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b28c96-8f62-43a8-97be-c22fb5d9d38d None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:40:53.188608 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b28c96-8f62-43a8-97be-c22fb5d9d38d None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:40:53.189138 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b28c96-8f62-43a8-97be-c22fb5d9d38d None admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:40:53.189554 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b28c96-8f62-43a8-97be-c22fb5d9d38d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:40:53.189856 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b28c96-8f62-43a8-97be-c22fb5d9d38d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:40:53.191359 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b28c96-8f62-43a8-97be-c22fb5d9d38d None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:40:53.200038 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 39/79] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Aug 18 21:40:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:40:53.200668 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b28c96-8f62-43a8-97be-c22fb5d9d38d None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:40:53.264493 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a19ec13-4577-46b8-a235-5316cf3d3eed None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:40:53.299419 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad79994b-4483-48a0-a0ec-292ecd39e7f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:40:53.300057 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad79994b-4483-48a0-a0ec-292ecd39e7f4 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:40:53.300341 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad79994b-4483-48a0-a0ec-292ecd39e7f4 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:40:53.300644 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad79994b-4483-48a0-a0ec-292ecd39e7f4 None admin] PATH_INFO: `/v3/users/b468708457d44a0a864439dd99359654` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:40:53.301781 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad79994b-4483-48a0-a0ec-292ecd39e7f4 None admin] RBAC: Authorizing `identity:get_user(user_id=b468708457d44a0a864439dd99359654)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:40:53.303216 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad79994b-4483-48a0-a0ec-292ecd39e7f4 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:40:53.304835 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 41/80] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Aug 18 21:40:53 2022] GET /identity/v3/users/b468708457d44a0a864439dd99359654 => generated 247 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:40:53.305603 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad79994b-4483-48a0-a0ec-292ecd39e7f4 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:40:53.309342 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b28c96-8f62-43a8-97be-c22fb5d9d38d None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:40:53.317793 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:40:53.343826 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d86c9e7-2eae-4fe3-9aa5-6e49aabbe377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:40:53.344659 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d86c9e7-2eae-4fe3-9aa5-6e49aabbe377 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:40:53.344952 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d86c9e7-2eae-4fe3-9aa5-6e49aabbe377 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:40:53.345231 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d86c9e7-2eae-4fe3-9aa5-6e49aabbe377 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:40:53.385714 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:40:53.407750 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad79994b-4483-48a0-a0ec-292ecd39e7f4 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:40:53.412350 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d86c9e7-2eae-4fe3-9aa5-6e49aabbe377 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:40:53.413988 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d86c9e7-2eae-4fe3-9aa5-6e49aabbe377 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:40:53.441583 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9808be-a8d9-4a92-a88e-bc37135c7019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:40:53.442198 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9808be-a8d9-4a92-a88e-bc37135c7019 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:40:53.442479 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9808be-a8d9-4a92-a88e-bc37135c7019 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:40:53.442753 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9808be-a8d9-4a92-a88e-bc37135c7019 None admin] PATH_INFO: `/v3/roles` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:40:53.443408 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9808be-a8d9-4a92-a88e-bc37135c7019 None admin] RBAC: Adding query filter params (name=member) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:40:53.443709 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9808be-a8d9-4a92-a88e-bc37135c7019 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:40:53.445113 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9808be-a8d9-4a92-a88e-bc37135c7019 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:40:53.453034 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 42/81] 10.222.0.27 () {56 vars in 1101 bytes} [Thu Aug 18 21:40:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:40:53.454957 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9808be-a8d9-4a92-a88e-bc37135c7019 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:40:53.513022 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 40/82] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Aug 18 21:40:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 21:40:53.513022 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d86c9e7-2eae-4fe3-9aa5-6e49aabbe377 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:40:53.526641 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:40:53.557790 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9808be-a8d9-4a92-a88e-bc37135c7019 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:40:53.584282 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:40:53.591644 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c505ff-f666-4613-a644-66421632cecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:40:53.592272 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c505ff-f666-4613-a644-66421632cecf None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:40:53.592557 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c505ff-f666-4613-a644-66421632cecf None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:40:53.596616 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c505ff-f666-4613-a644-66421632cecf None admin] PATH_INFO: `/v3/users/5935b35ad1844f5c827a7303ed74c83d` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:40:53.596616 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c505ff-f666-4613-a644-66421632cecf None admin] RBAC: Authorizing `identity:get_user(user_id=5935b35ad1844f5c827a7303ed74c83d)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:40:53.596616 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c505ff-f666-4613-a644-66421632cecf None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:40:53.597771 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 43/83] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Aug 18 21:40:53 2022] GET /identity/v3/users/5935b35ad1844f5c827a7303ed74c83d => generated 275 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:40:53.598527 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c505ff-f666-4613-a644-66421632cecf None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:40:53.614128 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d86c9e7-2eae-4fe3-9aa5-6e49aabbe377 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:40:53.650015 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf2ad75-e9fb-4817-be38-b166c5922f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:40:53.650639 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf2ad75-e9fb-4817-be38-b166c5922f63 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:40:53.650922 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf2ad75-e9fb-4817-be38-b166c5922f63 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:40:53.651196 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf2ad75-e9fb-4817-be38-b166c5922f63 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:40:53.652304 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf2ad75-e9fb-4817-be38-b166c5922f63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:40:53.653803 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf2ad75-e9fb-4817-be38-b166c5922f63 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:40:53.655367 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 41/84] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 18 21:40:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:40:53.656157 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf2ad75-e9fb-4817-be38-b166c5922f63 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:40:53.699961 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c505ff-f666-4613-a644-66421632cecf None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:40:53.731982 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae322ec-8af1-46e9-b1d5-cbeb29d4660b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:40:53.732586 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae322ec-8af1-46e9-b1d5-cbeb29d4660b None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:40:53.732898 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae322ec-8af1-46e9-b1d5-cbeb29d4660b None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:40:53.733177 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae322ec-8af1-46e9-b1d5-cbeb29d4660b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:40:53.742039 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:40:53.754719 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf2ad75-e9fb-4817-be38-b166c5922f63 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:40:53.789059 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec334787-9792-4f89-a011-bb0d2de81b6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:40:53.789941 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec334787-9792-4f89-a011-bb0d2de81b6b None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:40:53.790218 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec334787-9792-4f89-a011-bb0d2de81b6b None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:40:53.790491 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec334787-9792-4f89-a011-bb0d2de81b6b None admin] PATH_INFO: `/v3/users/5935b35ad1844f5c827a7303ed74c83d` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:40:53.791614 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec334787-9792-4f89-a011-bb0d2de81b6b None admin] RBAC: Authorizing `identity:get_user(user_id=5935b35ad1844f5c827a7303ed74c83d)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:40:53.793099 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec334787-9792-4f89-a011-bb0d2de81b6b None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:40:53.794670 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 42/85] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Aug 18 21:40:53 2022] GET /identity/v3/users/5935b35ad1844f5c827a7303ed74c83d => generated 275 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:40:53.795423 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec334787-9792-4f89-a011-bb0d2de81b6b None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:40:53.804569 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae322ec-8af1-46e9-b1d5-cbeb29d4660b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:40:53.806044 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae322ec-8af1-46e9-b1d5-cbeb29d4660b None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:40:53.810022 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:40:53.899070 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec334787-9792-4f89-a011-bb0d2de81b6b None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:40:53.904176 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 44/86] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Aug 18 21:40:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 21:40:53.905050 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae322ec-8af1-46e9-b1d5-cbeb29d4660b None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:40:53.937173 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbdbeab-7981-4035-b16d-bf2b7985eb41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:40:53.938421 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbdbeab-7981-4035-b16d-bf2b7985eb41 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:40:53.938712 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbdbeab-7981-4035-b16d-bf2b7985eb41 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:40:53.939640 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbdbeab-7981-4035-b16d-bf2b7985eb41 None admin] PATH_INFO: `/v3/projects/e475732a8fb6447b8d2ccca84af2071a` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:40:53.941814 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbdbeab-7981-4035-b16d-bf2b7985eb41 None admin] RBAC: Authorizing `identity:get_project(project_id=e475732a8fb6447b8d2ccca84af2071a)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:40:53.943331 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbdbeab-7981-4035-b16d-bf2b7985eb41 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:40:53.944280 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:40:53.945440 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 43/87] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Aug 18 21:40:53 2022] GET /identity/v3/projects/e475732a8fb6447b8d2ccca84af2071a => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:40:53.945440 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbdbeab-7981-4035-b16d-bf2b7985eb41 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:40:54.003885 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae322ec-8af1-46e9-b1d5-cbeb29d4660b None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:40:54.023820 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:40:54.038804 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaaece7-eb18-42d7-b20a-f26ced4a3d35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:40:54.039455 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaaece7-eb18-42d7-b20a-f26ced4a3d35 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:40:54.039681 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaaece7-eb18-42d7-b20a-f26ced4a3d35 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:40:54.039952 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaaece7-eb18-42d7-b20a-f26ced4a3d35 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:40:54.046026 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbdbeab-7981-4035-b16d-bf2b7985eb41 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:40:54.080743 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dbb1cd-2c9b-4325-b2dd-acb9ed99be66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:40:54.081347 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dbb1cd-2c9b-4325-b2dd-acb9ed99be66 None admin] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:40:54.081635 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dbb1cd-2c9b-4325-b2dd-acb9ed99be66 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:40:54.081904 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dbb1cd-2c9b-4325-b2dd-acb9ed99be66 None admin] PATH_INFO: `/v3/users` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:40:54.082545 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dbb1cd-2c9b-4325-b2dd-acb9ed99be66 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:40:54.083996 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dbb1cd-2c9b-4325-b2dd-acb9ed99be66 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:40:54.107077 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaaece7-eb18-42d7-b20a-f26ced4a3d35 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:40:54.108611 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaaece7-eb18-42d7-b20a-f26ced4a3d35 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:40:54.146367 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:40:54.196411 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 44/88] 10.222.0.27 () {60 vars in 1132 bytes} [Thu Aug 18 21:40:53 2022] POST /identity/v3/users => generated 289 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:40:54.197269 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dbb1cd-2c9b-4325-b2dd-acb9ed99be66 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:40:54.206180 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 45/89] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Aug 18 21:40:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 21:40:54.206890 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaaece7-eb18-42d7-b20a-f26ced4a3d35 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:40:54.327603 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dbb1cd-2c9b-4325-b2dd-acb9ed99be66 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:40:54.336173 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaaece7-eb18-42d7-b20a-f26ced4a3d35 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:40:54.365529 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:40:54.371116 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3d3748-953b-4f83-8f90-4608171de198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:40:54.371850 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3d3748-953b-4f83-8f90-4608171de198 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:40:54.372140 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3d3748-953b-4f83-8f90-4608171de198 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:40:54.372471 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3d3748-953b-4f83-8f90-4608171de198 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:40:54.377595 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eac0f6-e31a-44e1-b6eb-f3558bc3f326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:40:54.379863 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eac0f6-e31a-44e1-b6eb-f3558bc3f326 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:40:54.379863 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eac0f6-e31a-44e1-b6eb-f3558bc3f326 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:40:54.379863 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eac0f6-e31a-44e1-b6eb-f3558bc3f326 None admin] PATH_INFO: `/v3/projects/e475732a8fb6447b8d2ccca84af2071a` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:40:54.380066 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0eac0f6-e31a-44e1-b6eb-f3558bc3f326 None admin] RBAC: Authorizing `identity:get_project(project_id=e475732a8fb6447b8d2ccca84af2071a)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:40:54.381381 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0eac0f6-e31a-44e1-b6eb-f3558bc3f326 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:40:54.383177 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 46/90] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Aug 18 21:40:54 2022] GET /identity/v3/projects/e475732a8fb6447b8d2ccca84af2071a => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:40:54.385413 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eac0f6-e31a-44e1-b6eb-f3558bc3f326 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:40:54.395157 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:40:54.449223 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3d3748-953b-4f83-8f90-4608171de198 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:40:54.451110 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3d3748-953b-4f83-8f90-4608171de198 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:40:54.507408 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eac0f6-e31a-44e1-b6eb-f3558bc3f326 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:40:54.552801 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f2c360-0fcc-416e-bf1e-dc9fa8c18e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:40:54.553778 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f2c360-0fcc-416e-bf1e-dc9fa8c18e38 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:40:54.554682 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f2c360-0fcc-416e-bf1e-dc9fa8c18e38 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:40:54.555101 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f2c360-0fcc-416e-bf1e-dc9fa8c18e38 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:40:54.555841 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f2c360-0fcc-416e-bf1e-dc9fa8c18e38 None admin] RBAC: Adding query filter params (role.id=de8f2438056f4af9879423f8a59e0e0b, scope.project.id=e475732a8fb6447b8d2ccca84af2071a, user.id=5935b35ad1844f5c827a7303ed74c83d) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:40:54.556154 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f2c360-0fcc-416e-bf1e-dc9fa8c18e38 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:40:54.558202 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f2c360-0fcc-416e-bf1e-dc9fa8c18e38 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:40:54.572716 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 47/91] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Aug 18 21:40:54 2022] GET /identity/v3/role_assignments?user.id=5935b35ad1844f5c827a7303ed74c83d&scope.project.id=e475732a8fb6447b8d2ccca84af2071a&role.id=de8f2438056f4af9879423f8a59e0e0b => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:40:54.572716 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f2c360-0fcc-416e-bf1e-dc9fa8c18e38 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:40:54.588710 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 45/92] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Aug 18 21:40:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 21:40:54.588710 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3d3748-953b-4f83-8f90-4608171de198 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:40:54.632332 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:40:54.677292 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:40:54.719557 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f2c360-0fcc-416e-bf1e-dc9fa8c18e38 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:40:54.720765 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3d3748-953b-4f83-8f90-4608171de198 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:40:54.761623 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764b9863-cbd0-4d68-9ca2-08a01cc76db3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:40:54.762345 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764b9863-cbd0-4d68-9ca2-08a01cc76db3 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:40:54.762635 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764b9863-cbd0-4d68-9ca2-08a01cc76db3 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:40:54.762917 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764b9863-cbd0-4d68-9ca2-08a01cc76db3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:40:54.763804 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764b9863-cbd0-4d68-9ca2-08a01cc76db3 None admin] RBAC: Adding query filter params (role.id=0833202e2a3d47d1b6b3af57006641b1, scope.project.id=e475732a8fb6447b8d2ccca84af2071a, user.id=b468708457d44a0a864439dd99359654) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:40:54.764452 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764b9863-cbd0-4d68-9ca2-08a01cc76db3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:40:54.766210 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cff75cd-5a38-4c4f-b37c-07fc24e86f30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:40:54.766661 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764b9863-cbd0-4d68-9ca2-08a01cc76db3 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:40:54.767292 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cff75cd-5a38-4c4f-b37c-07fc24e86f30 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:40:54.767769 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cff75cd-5a38-4c4f-b37c-07fc24e86f30 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:40:54.768255 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cff75cd-5a38-4c4f-b37c-07fc24e86f30 None admin] PATH_INFO: `/v3/projects/e475732a8fb6447b8d2ccca84af2071a` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:40:54.770307 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cff75cd-5a38-4c4f-b37c-07fc24e86f30 None admin] RBAC: Authorizing `identity:get_project(project_id=e475732a8fb6447b8d2ccca84af2071a)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:40:54.772259 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cff75cd-5a38-4c4f-b37c-07fc24e86f30 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:40:54.772681 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 46/93] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Aug 18 21:40:54 2022] GET /identity/v3/role_assignments?user.id=b468708457d44a0a864439dd99359654&scope.project.id=e475732a8fb6447b8d2ccca84af2071a&role.id=0833202e2a3d47d1b6b3af57006641b1 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:40:54.773574 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764b9863-cbd0-4d68-9ca2-08a01cc76db3 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:40:54.774710 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 48/94] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Aug 18 21:40:54 2022] GET /identity/v3/projects/e475732a8fb6447b8d2ccca84af2071a => generated 298 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:40:54.784755 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cff75cd-5a38-4c4f-b37c-07fc24e86f30 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:40:54.926214 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:40:54.934117 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764b9863-cbd0-4d68-9ca2-08a01cc76db3 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:40:54.975925 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c942f86-367c-4ba1-bec4-69adee69b0e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:40:54.976996 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c942f86-367c-4ba1-bec4-69adee69b0e1 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:40:54.977484 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c942f86-367c-4ba1-bec4-69adee69b0e1 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:40:54.977962 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c942f86-367c-4ba1-bec4-69adee69b0e1 None admin] PATH_INFO: `/v3/projects/6655909799ae40b28b20bbe95d7bc6be` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:40:54.979319 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c942f86-367c-4ba1-bec4-69adee69b0e1 None admin] RBAC: Authorizing `identity:get_project(project_id=6655909799ae40b28b20bbe95d7bc6be)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:40:54.981028 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c942f86-367c-4ba1-bec4-69adee69b0e1 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:40:54.982927 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 47/95] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Aug 18 21:40:54 2022] GET /identity/v3/projects/6655909799ae40b28b20bbe95d7bc6be => generated 312 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:40:54.993573 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c942f86-367c-4ba1-bec4-69adee69b0e1 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:40:55.010255 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cff75cd-5a38-4c4f-b37c-07fc24e86f30 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:40:55.053014 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5779f0-9032-4fa8-bc71-73a133b32b8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:40:55.053691 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5779f0-9032-4fa8-bc71-73a133b32b8e None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:40:55.053979 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5779f0-9032-4fa8-bc71-73a133b32b8e None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:40:55.054258 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5779f0-9032-4fa8-bc71-73a133b32b8e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:40:55.055461 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5779f0-9032-4fa8-bc71-73a133b32b8e None admin] RBAC: Adding query filter params (role.id=66171a9efb5344c7a903946f238a3808, scope.project.id=e475732a8fb6447b8d2ccca84af2071a, user.id=5935b35ad1844f5c827a7303ed74c83d) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:40:55.055778 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5779f0-9032-4fa8-bc71-73a133b32b8e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:40:55.057515 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5779f0-9032-4fa8-bc71-73a133b32b8e None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:40:55.064674 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 49/96] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Aug 18 21:40:54 2022] GET /identity/v3/role_assignments?user.id=5935b35ad1844f5c827a7303ed74c83d&scope.project.id=e475732a8fb6447b8d2ccca84af2071a&role.id=66171a9efb5344c7a903946f238a3808 => generated 259 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 21:40:55.190822 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c942f86-367c-4ba1-bec4-69adee69b0e1 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:40:55.238921 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6f73bd-f92d-4d6f-955b-029a2e779a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:40:55.239904 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6f73bd-f92d-4d6f-955b-029a2e779a79 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:40:55.240387 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6f73bd-f92d-4d6f-955b-029a2e779a79 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:40:55.240905 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6f73bd-f92d-4d6f-955b-029a2e779a79 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:40:55.241848 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6f73bd-f92d-4d6f-955b-029a2e779a79 None admin] RBAC: Adding query filter params (role.id=de8f2438056f4af9879423f8a59e0e0b, scope.project.id=6655909799ae40b28b20bbe95d7bc6be, user.id=5935b35ad1844f5c827a7303ed74c83d) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:40:55.242362 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6f73bd-f92d-4d6f-955b-029a2e779a79 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:40:55.244031 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6f73bd-f92d-4d6f-955b-029a2e779a79 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:40:55.251242 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 48/97] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Aug 18 21:40:54 2022] GET /identity/v3/role_assignments?user.id=5935b35ad1844f5c827a7303ed74c83d&scope.project.id=6655909799ae40b28b20bbe95d7bc6be&role.id=de8f2438056f4af9879423f8a59e0e0b => generated 259 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:40:56.985057 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bbb7ca-d98b-4e37-b5ac-58c26a2d9a93 None None] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:40:56.986082 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bbb7ca-d98b-4e37-b5ac-58c26a2d9a93 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:40:56.986570 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bbb7ca-d98b-4e37-b5ac-58c26a2d9a93 None None] PATH_INFO: `/` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:40:56.988154 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 50/98] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:40:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:40:56.993772 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0be861-59f0-439f-8b8e-b22fa4dc594f None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:40:56.994618 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0be861-59f0-439f-8b8e-b22fa4dc594f None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:40:56.995110 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0be861-59f0-439f-8b8e-b22fa4dc594f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:40:57.015013 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-af0be861-59f0-439f-8b8e-b22fa4dc594f None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:40:57.017262 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-af0be861-59f0-439f-8b8e-b22fa4dc594f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:40:57.042861 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:40:57.091661 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 49/99] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:40:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 21:40:57.344055 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23362ebb-efff-419c-a2fc-70499a465818 None None] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:40:57.344710 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23362ebb-efff-419c-a2fc-70499a465818 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:40:57.345226 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23362ebb-efff-419c-a2fc-70499a465818 None None] PATH_INFO: `/` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:40:57.346846 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 51/100] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:40:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:40:57.352398 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbe6f4d-68d7-4658-87f0-a62f977544b7 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:40:57.352935 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbe6f4d-68d7-4658-87f0-a62f977544b7 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:40:57.353419 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbe6f4d-68d7-4658-87f0-a62f977544b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:40:57.377625 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-0fbe6f4d-68d7-4658-87f0-a62f977544b7 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:40:57.379174 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-0fbe6f4d-68d7-4658-87f0-a62f977544b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:40:57.419420 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23362ebb-efff-419c-a2fc-70499a465818 None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:40:57.423451 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:40:57.462383 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 50/101] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:40:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 21:40:57.565041 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23362ebb-efff-419c-a2fc-70499a465818 None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:40:57.567659 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3cf6e4-b707-420e-ac1f-ab9a7b18f807 None None] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:40:57.568207 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3cf6e4-b707-420e-ac1f-ab9a7b18f807 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:40:57.568723 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3cf6e4-b707-420e-ac1f-ab9a7b18f807 None None] PATH_INFO: `/` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:40:57.570275 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 51/102] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:40:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 21:40:57.575395 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2447b41-e3a2-4fa5-ac84-c8c2051eb757 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:40:57.575924 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2447b41-e3a2-4fa5-ac84-c8c2051eb757 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:40:57.576467 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2447b41-e3a2-4fa5-ac84-c8c2051eb757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:40:57.604112 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-b2447b41-e3a2-4fa5-ac84-c8c2051eb757 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:40:57.605733 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-b2447b41-e3a2-4fa5-ac84-c8c2051eb757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:40:57.626030 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e11fc89-d2c1-468c-8d11-775db9ead014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:40:57.626676 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e11fc89-d2c1-468c-8d11-775db9ead014 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:40:57.626962 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e11fc89-d2c1-468c-8d11-775db9ead014 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:40:57.627242 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e11fc89-d2c1-468c-8d11-775db9ead014 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:40:57.629869 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e11fc89-d2c1-468c-8d11-775db9ead014 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:40:57.632232 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e11fc89-d2c1-468c-8d11-775db9ead014 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:40:57.634000 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 52/103] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 18 21:40:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:40:57.634971 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beffc74-0b1a-4232-a5d5-41dead303193 None None] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:40:57.635262 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beffc74-0b1a-4232-a5d5-41dead303193 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:40:57.635543 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beffc74-0b1a-4232-a5d5-41dead303193 None None] PATH_INFO: `/` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:40:57.636766 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 53/104] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:40:57 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:40:57.644131 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beffc74-0b1a-4232-a5d5-41dead303193 None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:40:57.727154 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 52/105] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:40:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 21:40:57.728799 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af98a57-f10b-4fa1-a98e-ce35d80aac2a None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:40:57.729279 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af98a57-f10b-4fa1-a98e-ce35d80aac2a None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:40:57.729784 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af98a57-f10b-4fa1-a98e-ce35d80aac2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:40:57.749221 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-9af98a57-f10b-4fa1-a98e-ce35d80aac2a None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:40:57.751728 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-9af98a57-f10b-4fa1-a98e-ce35d80aac2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:40:57.760466 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:40:57.768335 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:40:57.797794 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beffc74-0b1a-4232-a5d5-41dead303193 None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:40:57.839645 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46ce2f2-f3e0-45ca-864f-314782a969dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:40:57.839645 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46ce2f2-f3e0-45ca-864f-314782a969dc None admin] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:40:57.839645 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46ce2f2-f3e0-45ca-864f-314782a969dc None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:40:57.839645 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46ce2f2-f3e0-45ca-864f-314782a969dc None admin] PATH_INFO: `/v3/projects` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:40:57.839988 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46ce2f2-f3e0-45ca-864f-314782a969dc None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:40:57.839988 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46ce2f2-f3e0-45ca-864f-314782a969dc None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:40:57.870495 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 53/106] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:40:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 21:40:57.871373 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af98a57-f10b-4fa1-a98e-ce35d80aac2a None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:40:57.931612 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 54/107] 10.222.0.27 () {60 vars in 1141 bytes} [Thu Aug 18 21:40:57 2022] POST /identity/v3/projects => generated 302 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:40:57.971077 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2608800e-3a30-45f1-a1e1-ba7dc7096e07 None None] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:40:57.971413 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2608800e-3a30-45f1-a1e1-ba7dc7096e07 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:40:57.971737 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2608800e-3a30-45f1-a1e1-ba7dc7096e07 None None] PATH_INFO: `/` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:40:57.973491 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 55/108] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:40:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 21:40:57.982392 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c57ae03-ef5e-41e6-a171-2008b9cfe5e3 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:40:57.982709 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c57ae03-ef5e-41e6-a171-2008b9cfe5e3 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:40:57.982949 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c57ae03-ef5e-41e6-a171-2008b9cfe5e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:40:58.010548 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-6c57ae03-ef5e-41e6-a171-2008b9cfe5e3 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:40:58.011856 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-6c57ae03-ef5e-41e6-a171-2008b9cfe5e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:40:58.043182 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af98a57-f10b-4fa1-a98e-ce35d80aac2a None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:40:58.116042 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6ef95a-61ae-4b82-bfd4-3d7328814255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:40:58.117239 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6ef95a-61ae-4b82-bfd4-3d7328814255 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:40:58.117521 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6ef95a-61ae-4b82-bfd4-3d7328814255 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:40:58.118623 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6ef95a-61ae-4b82-bfd4-3d7328814255 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:40:58.149614 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6ef95a-61ae-4b82-bfd4-3d7328814255 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:40:58.155550 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application [None req-2a6ef95a-61ae-4b82-bfd4-3d7328814255 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 21:40:58.155550 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:40:58.155550 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:40:58.155550 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:40:58.155550 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:40:58.155550 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:40:58.155550 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:40:58.155550 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:40:58.155550 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:40:58.155550 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:40:58.155550 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:40:58.155550 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:40:58.155550 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:40:58.155550 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:40:58.155550 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:40:58.155550 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:40:58.156445 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:40:58.156445 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:40:58.156445 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:40:58.156445 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:40:58.156445 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:40:58.156445 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:40:58.156445 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:40:58.156445 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:40:58.156445 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:40:58.156445 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:40:58.156445 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:40:58.156445 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application with Lock( Aug 18 21:40:58.156445 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:40:58.156445 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:40:58.156445 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:40:58.156445 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:40:58.157315 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:40:58.157315 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:40:58.157315 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:40:58.157315 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:40:58.157315 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:40:58.157315 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:40:58.157315 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:40:58.157315 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:40:58.157315 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:40:58.157315 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:40:58.157315 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 21:40:58.157315 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:40:58.162044 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 54/109] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Aug 18 21:40:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:40:58.166499 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 56/110] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:40:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 21:40:58.173234 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6ef95a-61ae-4b82-bfd4-3d7328814255 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:40:58.177945 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c57ae03-ef5e-41e6-a171-2008b9cfe5e3 None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:40:58.212999 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:40:58.298313 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:40:58.314181 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6ef95a-61ae-4b82-bfd4-3d7328814255 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:40:58.351547 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c57ae03-ef5e-41e6-a171-2008b9cfe5e3 None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:40:58.354019 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1a360e-dc72-46a6-8a25-905d3ed6b201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:40:58.354873 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1a360e-dc72-46a6-8a25-905d3ed6b201 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:40:58.355375 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1a360e-dc72-46a6-8a25-905d3ed6b201 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:40:58.355849 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1a360e-dc72-46a6-8a25-905d3ed6b201 None admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:40:58.356754 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1a360e-dc72-46a6-8a25-905d3ed6b201 None admin] RBAC: Adding query filter params (name=member) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:40:58.357261 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1a360e-dc72-46a6-8a25-905d3ed6b201 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:40:58.358860 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1a360e-dc72-46a6-8a25-905d3ed6b201 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:40:58.368783 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 55/111] 10.222.0.27 () {56 vars in 1101 bytes} [Thu Aug 18 21:40:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:40:58.369851 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1a360e-dc72-46a6-8a25-905d3ed6b201 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:40:58.391109 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536e205d-b449-4d5c-946b-d78b7c9eb29d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:40:58.391755 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536e205d-b449-4d5c-946b-d78b7c9eb29d None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:40:58.392036 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536e205d-b449-4d5c-946b-d78b7c9eb29d None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:40:58.392311 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536e205d-b449-4d5c-946b-d78b7c9eb29d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:40:58.403798 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536e205d-b449-4d5c-946b-d78b7c9eb29d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:40:58.409917 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application [None req-536e205d-b449-4d5c-946b-d78b7c9eb29d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 21:40:58.409917 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:40:58.409917 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:40:58.409917 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:40:58.409917 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:40:58.409917 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:40:58.409917 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:40:58.409917 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:40:58.409917 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:40:58.409917 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:40:58.409917 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:40:58.409917 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:40:58.409917 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:40:58.409917 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:40:58.409917 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:40:58.409917 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:40:58.410805 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:40:58.410805 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:40:58.410805 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:40:58.410805 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:40:58.410805 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:40:58.410805 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:40:58.410805 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:40:58.410805 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:40:58.410805 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:40:58.410805 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:40:58.410805 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:40:58.410805 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application with Lock( Aug 18 21:40:58.410805 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:40:58.410805 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:40:58.410805 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:40:58.410805 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:40:58.411553 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:40:58.411553 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:40:58.411553 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:40:58.411553 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:40:58.411553 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:40:58.411553 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:40:58.411553 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:40:58.411553 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:40:58.411553 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:40:58.411553 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:40:58.411553 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 21:40:58.411553 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:40:58.411553 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 57/112] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Aug 18 21:40:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:40:58.412196 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536e205d-b449-4d5c-946b-d78b7c9eb29d None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:40:58.448692 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:40:58.482808 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1a360e-dc72-46a6-8a25-905d3ed6b201 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:40:58.521505 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7964c371-984d-45e9-bc57-1db4a04f6325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:40:58.522557 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7964c371-984d-45e9-bc57-1db4a04f6325 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:40:58.523075 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7964c371-984d-45e9-bc57-1db4a04f6325 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:40:58.523551 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7964c371-984d-45e9-bc57-1db4a04f6325 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:40:58.541203 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7964c371-984d-45e9-bc57-1db4a04f6325 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:40:58.548628 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536e205d-b449-4d5c-946b-d78b7c9eb29d None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:40:58.554474 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application [None req-7964c371-984d-45e9-bc57-1db4a04f6325 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 21:40:58.554474 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:40:58.554474 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:40:58.554474 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:40:58.554474 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:40:58.554474 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:40:58.554474 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:40:58.554474 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:40:58.554474 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:40:58.554474 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:40:58.554474 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:40:58.554474 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:40:58.554474 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:40:58.554474 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:40:58.554474 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:40:58.554474 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:40:58.555378 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:40:58.555378 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:40:58.555378 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:40:58.555378 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:40:58.555378 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:40:58.555378 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:40:58.555378 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:40:58.555378 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:40:58.555378 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:40:58.555378 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:40:58.555378 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:40:58.555378 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application with Lock( Aug 18 21:40:58.555378 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:40:58.555378 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:40:58.555378 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:40:58.555378 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:40:58.556140 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:40:58.556140 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:40:58.556140 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:40:58.556140 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:40:58.556140 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:40:58.556140 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:40:58.556140 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:40:58.556140 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:40:58.556140 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:40:58.556140 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:40:58.556140 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 21:40:58.556140 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:40:58.556140 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 56/113] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Aug 18 21:40:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:40:58.556804 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7964c371-984d-45e9-bc57-1db4a04f6325 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:40:58.560915 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:40:58.583520 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f33cef-0311-4e1d-a9fc-800aeaf9c27b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:40:58.596248 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f33cef-0311-4e1d-a9fc-800aeaf9c27b None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:40:58.596248 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f33cef-0311-4e1d-a9fc-800aeaf9c27b None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:40:58.596248 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f33cef-0311-4e1d-a9fc-800aeaf9c27b None admin] PATH_INFO: `/v3/users/5935b35ad1844f5c827a7303ed74c83d` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:40:58.596248 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f33cef-0311-4e1d-a9fc-800aeaf9c27b None admin] RBAC: Authorizing `identity:get_user(user_id=5935b35ad1844f5c827a7303ed74c83d)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:40:58.596248 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f33cef-0311-4e1d-a9fc-800aeaf9c27b None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:40:58.596248 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 58/114] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Aug 18 21:40:58 2022] GET /identity/v3/users/5935b35ad1844f5c827a7303ed74c83d => generated 275 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:40:58.596707 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2082bc-5379-4f59-b217-715041f43310 None None] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:40:58.596707 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2082bc-5379-4f59-b217-715041f43310 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:40:58.596707 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2082bc-5379-4f59-b217-715041f43310 None None] PATH_INFO: `/` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:40:58.596707 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 59/115] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:40:58 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:40:58.596707 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2082bc-5379-4f59-b217-715041f43310 None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:40:58.680994 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7964c371-984d-45e9-bc57-1db4a04f6325 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:40:58.707087 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2082bc-5379-4f59-b217-715041f43310 None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:40:58.710695 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:40:58.718794 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce234eb4-481d-40ac-a0b1-1da978389bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:40:58.719814 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce234eb4-481d-40ac-a0b1-1da978389bd8 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:40:58.724571 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce234eb4-481d-40ac-a0b1-1da978389bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:40:58.724571 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce234eb4-481d-40ac-a0b1-1da978389bd8 None admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:40:58.724571 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce234eb4-481d-40ac-a0b1-1da978389bd8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:40:58.724571 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce234eb4-481d-40ac-a0b1-1da978389bd8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:40:58.724571 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce234eb4-481d-40ac-a0b1-1da978389bd8 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:40:58.742061 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 57/116] 10.222.0.27 () {56 vars in 1101 bytes} [Thu Aug 18 21:40:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:40:58.742061 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce234eb4-481d-40ac-a0b1-1da978389bd8 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:40:58.750836 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2004dc09-39f2-48cc-8a0d-0499cbd77e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:40:58.751484 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2004dc09-39f2-48cc-8a0d-0499cbd77e16 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:40:58.751805 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2004dc09-39f2-48cc-8a0d-0499cbd77e16 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:40:58.752089 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2004dc09-39f2-48cc-8a0d-0499cbd77e16 None admin] PATH_INFO: `/v3/roles` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:40:58.753219 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2004dc09-39f2-48cc-8a0d-0499cbd77e16 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:40:58.753729 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2004dc09-39f2-48cc-8a0d-0499cbd77e16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:40:58.755554 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2004dc09-39f2-48cc-8a0d-0499cbd77e16 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:40:58.766006 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 60/117] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Aug 18 21:40:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:40:58.766689 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2004dc09-39f2-48cc-8a0d-0499cbd77e16 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:40:58.814508 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:40:58.865386 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce234eb4-481d-40ac-a0b1-1da978389bd8 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:40:58.884464 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2004dc09-39f2-48cc-8a0d-0499cbd77e16 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:40:58.914455 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc56ba15-5467-43c8-9455-83e93cb8039a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:40:58.915104 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc56ba15-5467-43c8-9455-83e93cb8039a None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:40:58.915416 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc56ba15-5467-43c8-9455-83e93cb8039a None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:40:58.915672 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc56ba15-5467-43c8-9455-83e93cb8039a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:40:58.928239 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc56ba15-5467-43c8-9455-83e93cb8039a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:40:58.932378 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ca59a8-3195-4f36-8de2-c79a760bc232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:40:58.933136 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application [None req-fc56ba15-5467-43c8-9455-83e93cb8039a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 21:40:58.933136 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:40:58.933136 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:40:58.933136 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:40:58.933136 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:40:58.933136 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:40:58.933136 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:40:58.933136 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:40:58.933136 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:40:58.933136 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:40:58.933136 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:40:58.933136 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:40:58.933136 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:40:58.933136 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:40:58.933136 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:40:58.933136 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:40:58.934156 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:40:58.934156 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:40:58.934156 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:40:58.934156 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:40:58.934156 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:40:58.934156 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:40:58.934156 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:40:58.934156 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:40:58.934156 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:40:58.934156 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:40:58.934156 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:40:58.934156 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application with Lock( Aug 18 21:40:58.934156 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:40:58.934156 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:40:58.934156 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:40:58.934156 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:40:58.939995 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:40:58.939995 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:40:58.939995 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:40:58.939995 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:40:58.939995 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:40:58.939995 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:40:58.939995 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:40:58.939995 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:40:58.939995 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:40:58.939995 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:40:58.939995 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 21:40:58.939995 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:40:58.939995 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 58/118] 10.222.0.27 () {56 vars in 1114 bytes} [Thu Aug 18 21:40:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:40:58.939995 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b165a6c-9423-44b2-a2e0-9f9fe421c899 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:40:58.940799 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b165a6c-9423-44b2-a2e0-9f9fe421c899 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:40:58.940799 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b165a6c-9423-44b2-a2e0-9f9fe421c899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:40:58.941251 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ca59a8-3195-4f36-8de2-c79a760bc232 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:40:58.943461 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ca59a8-3195-4f36-8de2-c79a760bc232 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:40:58.943886 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ca59a8-3195-4f36-8de2-c79a760bc232 None admin] PATH_INFO: `/v3/projects/e475732a8fb6447b8d2ccca84af2071a` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:40:58.945484 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ca59a8-3195-4f36-8de2-c79a760bc232 None admin] RBAC: Authorizing `identity:get_project(project_id=e475732a8fb6447b8d2ccca84af2071a)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:40:58.947187 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ca59a8-3195-4f36-8de2-c79a760bc232 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:40:58.954207 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 61/119] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Aug 18 21:40:58 2022] GET /identity/v3/projects/e475732a8fb6447b8d2ccca84af2071a => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:40:58.955232 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ca59a8-3195-4f36-8de2-c79a760bc232 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:40:58.958855 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-2b165a6c-9423-44b2-a2e0-9f9fe421c899 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:40:58.960060 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-2b165a6c-9423-44b2-a2e0-9f9fe421c899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:40:59.027920 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:40:59.051807 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 59/120] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:40:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 21:40:59.053508 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b165a6c-9423-44b2-a2e0-9f9fe421c899 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:40:59.089901 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ca59a8-3195-4f36-8de2-c79a760bc232 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:40:59.105053 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:40:59.132662 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b47c4ea-e152-4858-9506-91eb3aef8bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:40:59.133406 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b47c4ea-e152-4858-9506-91eb3aef8bc7 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:40:59.133777 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b47c4ea-e152-4858-9506-91eb3aef8bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:40:59.134572 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b47c4ea-e152-4858-9506-91eb3aef8bc7 None admin] PATH_INFO: `/v3/users/d0f5f98e8dd94128a35862081afb409a` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:40:59.152767 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b47c4ea-e152-4858-9506-91eb3aef8bc7 None admin] RBAC: Authorizing `identity:get_user(user_id=d0f5f98e8dd94128a35862081afb409a)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:40:59.154475 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b47c4ea-e152-4858-9506-91eb3aef8bc7 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:40:59.161132 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 62/121] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Aug 18 21:40:58 2022] GET /identity/v3/users/d0f5f98e8dd94128a35862081afb409a => generated 289 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:40:59.162411 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b47c4ea-e152-4858-9506-91eb3aef8bc7 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:40:59.170893 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b165a6c-9423-44b2-a2e0-9f9fe421c899 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:40:59.212629 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aec5e1-1680-46cc-825c-a439518ae38a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:40:59.213657 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aec5e1-1680-46cc-825c-a439518ae38a None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:40:59.214157 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aec5e1-1680-46cc-825c-a439518ae38a None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:40:59.214627 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aec5e1-1680-46cc-825c-a439518ae38a None admin] PATH_INFO: `/v3/users/b468708457d44a0a864439dd99359654` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:40:59.217046 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5aec5e1-1680-46cc-825c-a439518ae38a None admin] RBAC: Authorizing `identity:get_user(user_id=b468708457d44a0a864439dd99359654)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:40:59.219322 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5aec5e1-1680-46cc-825c-a439518ae38a None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:40:59.221340 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 60/122] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Aug 18 21:40:59 2022] GET /identity/v3/users/b468708457d44a0a864439dd99359654 => generated 247 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:40:59.226998 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aec5e1-1680-46cc-825c-a439518ae38a None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:40:59.283033 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b47c4ea-e152-4858-9506-91eb3aef8bc7 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:40:59.284771 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:40:59.325076 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dab577-f9da-45e9-8ee7-cf2a28950875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:40:59.325735 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dab577-f9da-45e9-8ee7-cf2a28950875 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:40:59.326020 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dab577-f9da-45e9-8ee7-cf2a28950875 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:40:59.326395 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dab577-f9da-45e9-8ee7-cf2a28950875 None admin] PATH_INFO: `/v3/roles` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:40:59.327066 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dab577-f9da-45e9-8ee7-cf2a28950875 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:40:59.327374 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dab577-f9da-45e9-8ee7-cf2a28950875 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:40:59.329606 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dab577-f9da-45e9-8ee7-cf2a28950875 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:40:59.342912 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 63/123] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Aug 18 21:40:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:40:59.342912 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dab577-f9da-45e9-8ee7-cf2a28950875 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:40:59.349385 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aec5e1-1680-46cc-825c-a439518ae38a None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:40:59.376410 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:40:59.389928 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559793e7-3579-4df0-8c62-3dfdba1aac3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:40:59.451925 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559793e7-3579-4df0-8c62-3dfdba1aac3a None admin] REQUEST_METHOD: `PUT` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:40:59.451925 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559793e7-3579-4df0-8c62-3dfdba1aac3a None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:40:59.451925 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559793e7-3579-4df0-8c62-3dfdba1aac3a None admin] PATH_INFO: `/v3/projects/e475732a8fb6447b8d2ccca84af2071a/users/5935b35ad1844f5c827a7303ed74c83d/roles/de8f2438056f4af9879423f8a59e0e0b` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:40:59.451925 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559793e7-3579-4df0-8c62-3dfdba1aac3a None admin] RBAC: Authorizing `identity:create_grant(project_id=e475732a8fb6447b8d2ccca84af2071a, user_id=5935b35ad1844f5c827a7303ed74c83d, role_id=de8f2438056f4af9879423f8a59e0e0b)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:40:59.451925 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559793e7-3579-4df0-8c62-3dfdba1aac3a None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:40:59.452306 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dab577-f9da-45e9-8ee7-cf2a28950875 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:40:59.487495 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f780b2-b7e8-43d9-a456-d15477f2a660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:40:59.488024 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f780b2-b7e8-43d9-a456-d15477f2a660 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:40:59.488303 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f780b2-b7e8-43d9-a456-d15477f2a660 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:40:59.488576 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f780b2-b7e8-43d9-a456-d15477f2a660 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:40:59.570018 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f780b2-b7e8-43d9-a456-d15477f2a660 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:40:59.572231 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f780b2-b7e8-43d9-a456-d15477f2a660 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:40:59.605163 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:40:59.625194 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 61/124] 10.222.0.27 () {58 vars in 1439 bytes} [Thu Aug 18 21:40:59 2022] PUT /identity/v3/projects/e475732a8fb6447b8d2ccca84af2071a/users/5935b35ad1844f5c827a7303ed74c83d/roles/de8f2438056f4af9879423f8a59e0e0b => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:40:59.625194 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559793e7-3579-4df0-8c62-3dfdba1aac3a None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:40:59.731223 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 64/125] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Aug 18 21:40:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 21:40:59.732202 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f780b2-b7e8-43d9-a456-d15477f2a660 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:40:59.782085 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559793e7-3579-4df0-8c62-3dfdba1aac3a None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:40:59.795936 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:40:59.829262 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d170a6a-e4ab-4077-94c9-a22540d4ffc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:40:59.830344 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d170a6a-e4ab-4077-94c9-a22540d4ffc1 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:40:59.831613 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d170a6a-e4ab-4077-94c9-a22540d4ffc1 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:40:59.832036 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d170a6a-e4ab-4077-94c9-a22540d4ffc1 None admin] PATH_INFO: `/v3/projects/e475732a8fb6447b8d2ccca84af2071a` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:40:59.833672 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d170a6a-e4ab-4077-94c9-a22540d4ffc1 None admin] RBAC: Authorizing `identity:get_project(project_id=e475732a8fb6447b8d2ccca84af2071a)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:40:59.835308 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d170a6a-e4ab-4077-94c9-a22540d4ffc1 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:40:59.838383 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 62/126] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Aug 18 21:40:59 2022] GET /identity/v3/projects/e475732a8fb6447b8d2ccca84af2071a => generated 298 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:40:59.844813 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d170a6a-e4ab-4077-94c9-a22540d4ffc1 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:40:59.883538 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f780b2-b7e8-43d9-a456-d15477f2a660 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:40:59.914248 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:40:59.920469 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a6882e-fb1c-4fcb-883f-94cee87b5df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:40:59.920999 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a6882e-fb1c-4fcb-883f-94cee87b5df1 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:40:59.921285 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a6882e-fb1c-4fcb-883f-94cee87b5df1 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:40:59.922105 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a6882e-fb1c-4fcb-883f-94cee87b5df1 None admin] PATH_INFO: `/v3/users/5935b35ad1844f5c827a7303ed74c83d` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:40:59.923285 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a6882e-fb1c-4fcb-883f-94cee87b5df1 None admin] RBAC: Authorizing `identity:get_user(user_id=5935b35ad1844f5c827a7303ed74c83d)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:40:59.925045 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a6882e-fb1c-4fcb-883f-94cee87b5df1 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:40:59.931106 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 65/127] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Aug 18 21:40:59 2022] GET /identity/v3/users/5935b35ad1844f5c827a7303ed74c83d => generated 275 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:40:59.931106 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a6882e-fb1c-4fcb-883f-94cee87b5df1 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:40:59.982866 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d170a6a-e4ab-4077-94c9-a22540d4ffc1 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:00.027706 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a0c7a6-8c93-4f8e-b241-01557d4fb3db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:00.028791 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a0c7a6-8c93-4f8e-b241-01557d4fb3db None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:00.029240 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a0c7a6-8c93-4f8e-b241-01557d4fb3db None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:00.029988 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a0c7a6-8c93-4f8e-b241-01557d4fb3db None admin] PATH_INFO: `/v3/roles/member` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:00.039878 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a6882e-fb1c-4fcb-883f-94cee87b5df1 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:00.044891 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a0c7a6-8c93-4f8e-b241-01557d4fb3db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:41:00.052607 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application [None req-67a0c7a6-8c93-4f8e-b241-01557d4fb3db None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 21:41:00.052607 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:41:00.052607 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:41:00.052607 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:41:00.052607 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:41:00.052607 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:41:00.052607 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:41:00.052607 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:41:00.052607 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:41:00.052607 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:41:00.052607 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:41:00.052607 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:41:00.052607 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:41:00.052607 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:41:00.052607 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:41:00.052607 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:41:00.054169 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:41:00.054169 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:41:00.054169 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:41:00.054169 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:41:00.054169 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:41:00.054169 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:41:00.054169 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:41:00.054169 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:41:00.054169 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:41:00.054169 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:41:00.054169 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:41:00.054169 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application with Lock( Aug 18 21:41:00.054169 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:41:00.054169 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:41:00.054169 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:41:00.054169 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:41:00.055175 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:41:00.055175 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:41:00.055175 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:41:00.055175 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:41:00.055175 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:41:00.055175 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:41:00.055175 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:41:00.055175 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:41:00.055175 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:41:00.055175 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:41:00.055175 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 21:41:00.055175 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:41:00.057770 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 63/128] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Aug 18 21:40:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:41:00.058763 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a0c7a6-8c93-4f8e-b241-01557d4fb3db None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:00.088782 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28ca527-9e0a-4cd4-bd64-17975515a9e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:00.089693 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28ca527-9e0a-4cd4-bd64-17975515a9e8 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:00.090378 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28ca527-9e0a-4cd4-bd64-17975515a9e8 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:00.091263 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28ca527-9e0a-4cd4-bd64-17975515a9e8 None admin] PATH_INFO: `/v3/projects/e475732a8fb6447b8d2ccca84af2071a` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:00.094596 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28ca527-9e0a-4cd4-bd64-17975515a9e8 None admin] RBAC: Authorizing `identity:get_project(project_id=e475732a8fb6447b8d2ccca84af2071a)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:00.096989 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28ca527-9e0a-4cd4-bd64-17975515a9e8 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:00.100167 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 66/129] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Aug 18 21:40:59 2022] GET /identity/v3/projects/e475732a8fb6447b8d2ccca84af2071a => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:00.101645 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28ca527-9e0a-4cd4-bd64-17975515a9e8 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:00.112230 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:00.181627 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:00.206315 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a0c7a6-8c93-4f8e-b241-01557d4fb3db None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:00.221584 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28ca527-9e0a-4cd4-bd64-17975515a9e8 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:00.255672 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba375a8-f92f-44fd-ae94-da399d46e75e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:00.256624 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba375a8-f92f-44fd-ae94-da399d46e75e None admin] REQUEST_METHOD: `PUT` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:00.257050 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba375a8-f92f-44fd-ae94-da399d46e75e None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:00.257490 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba375a8-f92f-44fd-ae94-da399d46e75e None admin] PATH_INFO: `/v3/projects/e475732a8fb6447b8d2ccca84af2071a/users/b468708457d44a0a864439dd99359654/roles/0833202e2a3d47d1b6b3af57006641b1` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:00.258778 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3147c5-3765-4a21-8084-3ec845c62cac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:00.259614 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3147c5-3765-4a21-8084-3ec845c62cac None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:00.259908 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba375a8-f92f-44fd-ae94-da399d46e75e None admin] RBAC: Authorizing `identity:create_grant(project_id=e475732a8fb6447b8d2ccca84af2071a, user_id=b468708457d44a0a864439dd99359654, role_id=0833202e2a3d47d1b6b3af57006641b1)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:00.260066 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3147c5-3765-4a21-8084-3ec845c62cac None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:00.260457 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3147c5-3765-4a21-8084-3ec845c62cac None admin] PATH_INFO: `/v3/projects/e475732a8fb6447b8d2ccca84af2071a` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:00.261707 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3147c5-3765-4a21-8084-3ec845c62cac None admin] RBAC: Authorizing `identity:get_project(project_id=e475732a8fb6447b8d2ccca84af2071a)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:00.262013 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba375a8-f92f-44fd-ae94-da399d46e75e None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:00.263337 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3147c5-3765-4a21-8084-3ec845c62cac None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:00.270213 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 67/130] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Aug 18 21:41:00 2022] GET /identity/v3/projects/e475732a8fb6447b8d2ccca84af2071a => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:00.270213 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3147c5-3765-4a21-8084-3ec845c62cac None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:00.379051 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3147c5-3765-4a21-8084-3ec845c62cac None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:00.395447 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 64/131] 10.222.0.27 () {58 vars in 1439 bytes} [Thu Aug 18 21:41:00 2022] PUT /identity/v3/projects/e475732a8fb6447b8d2ccca84af2071a/users/b468708457d44a0a864439dd99359654/roles/0833202e2a3d47d1b6b3af57006641b1 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:41:00.396725 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba375a8-f92f-44fd-ae94-da399d46e75e None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:00.419581 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439ae7db-1566-4b81-8db6-d71322f6aa98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:00.420755 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439ae7db-1566-4b81-8db6-d71322f6aa98 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:00.421297 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439ae7db-1566-4b81-8db6-d71322f6aa98 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:00.422348 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439ae7db-1566-4b81-8db6-d71322f6aa98 None admin] PATH_INFO: `/v3/roles` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:00.423452 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439ae7db-1566-4b81-8db6-d71322f6aa98 None admin] RBAC: Adding query filter params (name=member) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:41:00.424139 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439ae7db-1566-4b81-8db6-d71322f6aa98 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:00.425882 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439ae7db-1566-4b81-8db6-d71322f6aa98 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:00.428485 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:00.438093 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 68/132] 10.222.0.27 () {56 vars in 1101 bytes} [Thu Aug 18 21:41:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:00.443889 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439ae7db-1566-4b81-8db6-d71322f6aa98 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:00.537075 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:00.541823 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba375a8-f92f-44fd-ae94-da399d46e75e None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:00.570283 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439ae7db-1566-4b81-8db6-d71322f6aa98 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:00.589662 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2ed7cb-3272-4da5-aaa1-518fde494d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:00.590763 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2ed7cb-3272-4da5-aaa1-518fde494d98 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:00.591559 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2ed7cb-3272-4da5-aaa1-518fde494d98 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:00.592003 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2ed7cb-3272-4da5-aaa1-518fde494d98 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:00.592941 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2ed7cb-3272-4da5-aaa1-518fde494d98 None admin] RBAC: Adding query filter params (role.id=a1ecfacad5ac443db590b35c86cd49e2, scope.project.id=e475732a8fb6447b8d2ccca84af2071a, user.id=d0f5f98e8dd94128a35862081afb409a) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:41:00.593446 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2ed7cb-3272-4da5-aaa1-518fde494d98 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:00.595681 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2ed7cb-3272-4da5-aaa1-518fde494d98 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:00.603407 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 65/133] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Aug 18 21:41:00 2022] GET /identity/v3/role_assignments?user.id=d0f5f98e8dd94128a35862081afb409a&scope.project.id=e475732a8fb6447b8d2ccca84af2071a&role.id=a1ecfacad5ac443db590b35c86cd49e2 => generated 259 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:00.605051 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5443dcd8-37d3-4956-a31a-10d091d77f59 None None] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:00.605823 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5443dcd8-37d3-4956-a31a-10d091d77f59 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:00.606539 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5443dcd8-37d3-4956-a31a-10d091d77f59 None None] PATH_INFO: `/` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:00.608571 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 66/134] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:41:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:41:00.610192 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5443dcd8-37d3-4956-a31a-10d091d77f59 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:00.616745 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bfac1d-4147-4c22-a814-14ecdf2f71e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:00.617630 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bfac1d-4147-4c22-a814-14ecdf2f71e5 None admin] REQUEST_METHOD: `PUT` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:00.618016 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bfac1d-4147-4c22-a814-14ecdf2f71e5 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:00.618396 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bfac1d-4147-4c22-a814-14ecdf2f71e5 None admin] PATH_INFO: `/v3/projects/e475732a8fb6447b8d2ccca84af2071a/users/5935b35ad1844f5c827a7303ed74c83d/roles/66171a9efb5344c7a903946f238a3808` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:00.621008 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bfac1d-4147-4c22-a814-14ecdf2f71e5 None admin] RBAC: Authorizing `identity:create_grant(project_id=e475732a8fb6447b8d2ccca84af2071a, user_id=5935b35ad1844f5c827a7303ed74c83d, role_id=66171a9efb5344c7a903946f238a3808)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:00.623616 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bfac1d-4147-4c22-a814-14ecdf2f71e5 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:00.736954 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 69/135] 10.222.0.27 () {58 vars in 1439 bytes} [Thu Aug 18 21:41:00 2022] PUT /identity/v3/projects/e475732a8fb6447b8d2ccca84af2071a/users/5935b35ad1844f5c827a7303ed74c83d/roles/66171a9efb5344c7a903946f238a3808 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:41:00.738502 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7295b732-7ab9-4523-ab9f-e42f4907fee5 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:00.739035 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7295b732-7ab9-4523-ab9f-e42f4907fee5 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:00.739432 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7295b732-7ab9-4523-ab9f-e42f4907fee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:00.741664 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5443dcd8-37d3-4956-a31a-10d091d77f59 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:00.783902 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-7295b732-7ab9-4523-ab9f-e42f4907fee5 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:41:00.787118 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-7295b732-7ab9-4523-ab9f-e42f4907fee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:41:00.804486 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2394e15d-d91d-4d74-9021-33bde748d1d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:00.805486 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2394e15d-d91d-4d74-9021-33bde748d1d0 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:00.805922 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2394e15d-d91d-4d74-9021-33bde748d1d0 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:00.806692 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2394e15d-d91d-4d74-9021-33bde748d1d0 None admin] PATH_INFO: `/v3/users/5935b35ad1844f5c827a7303ed74c83d` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:00.809450 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2394e15d-d91d-4d74-9021-33bde748d1d0 None admin] RBAC: Authorizing `identity:get_user(user_id=5935b35ad1844f5c827a7303ed74c83d)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:00.814378 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2394e15d-d91d-4d74-9021-33bde748d1d0 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:00.817225 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 67/136] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Aug 18 21:41:00 2022] GET /identity/v3/users/5935b35ad1844f5c827a7303ed74c83d => generated 275 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:00.828507 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2394e15d-d91d-4d74-9021-33bde748d1d0 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:00.878567 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:00.954025 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2394e15d-d91d-4d74-9021-33bde748d1d0 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:00.964991 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:00.997089 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84f3e07-a691-43e6-9288-9fb6cbf527ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:00.998043 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84f3e07-a691-43e6-9288-9fb6cbf527ff None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:00.998472 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84f3e07-a691-43e6-9288-9fb6cbf527ff None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:00.998952 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84f3e07-a691-43e6-9288-9fb6cbf527ff None admin] PATH_INFO: `/v3/projects/6655909799ae40b28b20bbe95d7bc6be` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:01.000320 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84f3e07-a691-43e6-9288-9fb6cbf527ff None admin] RBAC: Authorizing `identity:get_project(project_id=6655909799ae40b28b20bbe95d7bc6be)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:01.002020 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84f3e07-a691-43e6-9288-9fb6cbf527ff None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:01.002333 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 70/137] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:41:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 21:41:01.004174 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 68/138] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Aug 18 21:41:00 2022] GET /identity/v3/projects/6655909799ae40b28b20bbe95d7bc6be => generated 312 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:01.010037 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7295b732-7ab9-4523-ab9f-e42f4907fee5 None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:01.139851 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7295b732-7ab9-4523-ab9f-e42f4907fee5 None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:01.181705 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4688b0-2f0a-469d-9a07-f85a3700ccfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:01.182635 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4688b0-2f0a-469d-9a07-f85a3700ccfe None admin] REQUEST_METHOD: `PUT` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:01.183077 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4688b0-2f0a-469d-9a07-f85a3700ccfe None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:01.183573 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4688b0-2f0a-469d-9a07-f85a3700ccfe None admin] PATH_INFO: `/v3/projects/6655909799ae40b28b20bbe95d7bc6be/users/5935b35ad1844f5c827a7303ed74c83d/roles/de8f2438056f4af9879423f8a59e0e0b` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:01.185690 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4688b0-2f0a-469d-9a07-f85a3700ccfe None admin] RBAC: Authorizing `identity:create_grant(project_id=6655909799ae40b28b20bbe95d7bc6be, user_id=5935b35ad1844f5c827a7303ed74c83d, role_id=de8f2438056f4af9879423f8a59e0e0b)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:01.188053 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4688b0-2f0a-469d-9a07-f85a3700ccfe None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:01.266586 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 71/139] 10.222.0.27 () {58 vars in 1439 bytes} [Thu Aug 18 21:41:01 2022] PUT /identity/v3/projects/6655909799ae40b28b20bbe95d7bc6be/users/5935b35ad1844f5c827a7303ed74c83d/roles/de8f2438056f4af9879423f8a59e0e0b => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:41:01.442364 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84f3e07-a691-43e6-9288-9fb6cbf527ff None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:01.574274 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:01.579187 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84f3e07-a691-43e6-9288-9fb6cbf527ff None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:01.618760 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3057a160-2e73-4560-b0cf-3a8b0b0880f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:01.619399 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3057a160-2e73-4560-b0cf-3a8b0b0880f6 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:01.619687 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3057a160-2e73-4560-b0cf-3a8b0b0880f6 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:01.619959 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3057a160-2e73-4560-b0cf-3a8b0b0880f6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:01.622289 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3057a160-2e73-4560-b0cf-3a8b0b0880f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:01.623607 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3057a160-2e73-4560-b0cf-3a8b0b0880f6 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:01.627296 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 69/140] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 18 21:41:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:01.631877 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4688b0-2f0a-469d-9a07-f85a3700ccfe None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:01.709656 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:01.780738 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4688b0-2f0a-469d-9a07-f85a3700ccfe None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:01.826801 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac64e404-530c-4d23-98ba-94cf99623a41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:01.827348 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac64e404-530c-4d23-98ba-94cf99623a41 None admin] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:01.827635 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac64e404-530c-4d23-98ba-94cf99623a41 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:01.828019 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac64e404-530c-4d23-98ba-94cf99623a41 None admin] PATH_INFO: `/v3/users` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:01.828702 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac64e404-530c-4d23-98ba-94cf99623a41 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:01.830157 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac64e404-530c-4d23-98ba-94cf99623a41 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:01.924644 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 72/141] 10.222.0.27 () {60 vars in 1132 bytes} [Thu Aug 18 21:41:01 2022] POST /identity/v3/users => generated 283 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:41:02.466806 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cdb3d9-3d43-4d00-8cf1-64ad46e0eea5 None None] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:02.467303 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cdb3d9-3d43-4d00-8cf1-64ad46e0eea5 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:02.467374 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cdb3d9-3d43-4d00-8cf1-64ad46e0eea5 None None] PATH_INFO: `/` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:02.469639 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 70/142] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:41:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:41:02.486765 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c67fcf0-bd58-4212-a805-ad481c205074 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:02.487296 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c67fcf0-bd58-4212-a805-ad481c205074 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:02.487296 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c67fcf0-bd58-4212-a805-ad481c205074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:02.511332 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-3c67fcf0-bd58-4212-a805-ad481c205074 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:41:02.512550 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-3c67fcf0-bd58-4212-a805-ad481c205074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:41:02.598314 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 73/143] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:41:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 21:41:02.884923 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cdb3d9-3d43-4d00-8cf1-64ad46e0eea5 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:02.904319 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5dec0b-34e3-43b1-b895-f19431a707bb None None] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:02.904656 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5dec0b-34e3-43b1-b895-f19431a707bb None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:02.904927 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5dec0b-34e3-43b1-b895-f19431a707bb None None] PATH_INFO: `/` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:02.907141 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 74/144] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:41:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:41:02.912216 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cca361-08e6-44a8-882b-eeb4152f127b None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:02.912501 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cca361-08e6-44a8-882b-eeb4152f127b None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:02.912825 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cca361-08e6-44a8-882b-eeb4152f127b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:02.943400 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-16cca361-08e6-44a8-882b-eeb4152f127b None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:41:02.946092 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-16cca361-08e6-44a8-882b-eeb4152f127b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:41:02.990510 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:03.053841 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 75/145] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:41:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 21:41:03.055646 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9816f40f-a505-406f-8b8c-95c629848af1 None None] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:03.056183 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9816f40f-a505-406f-8b8c-95c629848af1 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:03.056541 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cdb3d9-3d43-4d00-8cf1-64ad46e0eea5 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:03.056874 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9816f40f-a505-406f-8b8c-95c629848af1 None None] PATH_INFO: `/` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:03.058486 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 76/146] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:41:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:41:03.064937 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46134cef-3c7a-47df-9d1d-852cc59aa3fa None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:03.065502 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46134cef-3c7a-47df-9d1d-852cc59aa3fa None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:03.065993 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46134cef-3c7a-47df-9d1d-852cc59aa3fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:03.084990 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-46134cef-3c7a-47df-9d1d-852cc59aa3fa None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:41:03.086661 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-46134cef-3c7a-47df-9d1d-852cc59aa3fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:41:03.098480 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b4c5e8-f560-4984-8594-dc29a7175607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:03.099118 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b4c5e8-f560-4984-8594-dc29a7175607 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:03.099400 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b4c5e8-f560-4984-8594-dc29a7175607 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:03.099688 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b4c5e8-f560-4984-8594-dc29a7175607 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:03.113224 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b4c5e8-f560-4984-8594-dc29a7175607 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:41:03.118627 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application [None req-f5b4c5e8-f560-4984-8594-dc29a7175607 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 21:41:03.118627 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:41:03.118627 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:41:03.118627 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:41:03.118627 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:41:03.118627 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:41:03.118627 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:41:03.118627 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:41:03.118627 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:41:03.118627 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:41:03.118627 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:41:03.118627 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:41:03.118627 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:41:03.118627 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:41:03.118627 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:41:03.118627 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:41:03.119739 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:41:03.119739 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:41:03.119739 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:41:03.119739 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:41:03.119739 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:41:03.119739 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:41:03.119739 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:41:03.119739 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:41:03.119739 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:41:03.119739 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:41:03.119739 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:41:03.119739 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application with Lock( Aug 18 21:41:03.119739 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:41:03.119739 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:41:03.119739 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:41:03.119739 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:41:03.120524 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:41:03.120524 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:41:03.120524 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:41:03.120524 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:41:03.120524 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:41:03.120524 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:41:03.120524 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:41:03.120524 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:41:03.120524 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:41:03.120524 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:41:03.120524 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 21:41:03.120524 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:41:03.120524 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 71/147] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Aug 18 21:41:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:41:03.126445 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b4c5e8-f560-4984-8594-dc29a7175607 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:03.159712 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:03.167555 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 77/148] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:41:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 21:41:03.240426 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b4c5e8-f560-4984-8594-dc29a7175607 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:03.277506 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f367f67-0208-416e-bcad-511e5d881ba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:03.278115 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f367f67-0208-416e-bcad-511e5d881ba8 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:03.278395 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f367f67-0208-416e-bcad-511e5d881ba8 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:03.278668 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f367f67-0208-416e-bcad-511e5d881ba8 None admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:03.279463 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f367f67-0208-416e-bcad-511e5d881ba8 None admin] RBAC: Adding query filter params (name=member) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:41:03.279773 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f367f67-0208-416e-bcad-511e5d881ba8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:03.281761 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f367f67-0208-416e-bcad-511e5d881ba8 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:03.295438 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 72/149] 10.222.0.27 () {56 vars in 1101 bytes} [Thu Aug 18 21:41:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:03.297589 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46134cef-3c7a-47df-9d1d-852cc59aa3fa None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:03.404407 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:03.418197 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46134cef-3c7a-47df-9d1d-852cc59aa3fa None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:03.462486 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb558c2e-5b2f-4551-b257-4ac38a8208bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:03.463125 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb558c2e-5b2f-4551-b257-4ac38a8208bb None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:03.463407 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb558c2e-5b2f-4551-b257-4ac38a8208bb None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:03.463680 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb558c2e-5b2f-4551-b257-4ac38a8208bb None admin] PATH_INFO: `/v3/users/5935b35ad1844f5c827a7303ed74c83d` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:03.464860 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb558c2e-5b2f-4551-b257-4ac38a8208bb None admin] RBAC: Authorizing `identity:get_user(user_id=5935b35ad1844f5c827a7303ed74c83d)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:03.466418 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb558c2e-5b2f-4551-b257-4ac38a8208bb None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:03.468016 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 78/150] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Aug 18 21:41:03 2022] GET /identity/v3/users/5935b35ad1844f5c827a7303ed74c83d => generated 275 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:03.474630 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f367f67-0208-416e-bcad-511e5d881ba8 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:03.502779 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb558c2e-5b2f-4551-b257-4ac38a8208bb None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:03.609630 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:03.630206 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f367f67-0208-416e-bcad-511e5d881ba8 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:03.686866 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb558c2e-5b2f-4551-b257-4ac38a8208bb None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:03.686866 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c280cbe-b839-4272-92ac-10ce948abd42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:03.686866 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c280cbe-b839-4272-92ac-10ce948abd42 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:03.686866 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c280cbe-b839-4272-92ac-10ce948abd42 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:03.688048 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c280cbe-b839-4272-92ac-10ce948abd42 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:03.702184 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c280cbe-b839-4272-92ac-10ce948abd42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:41:03.703340 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2d2df9-e0dd-4bd0-9fec-aca62a7ad2ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:03.704340 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2d2df9-e0dd-4bd0-9fec-aca62a7ad2ae None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:03.704745 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2d2df9-e0dd-4bd0-9fec-aca62a7ad2ae None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:03.705032 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2d2df9-e0dd-4bd0-9fec-aca62a7ad2ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:03.708203 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application [None req-4c280cbe-b839-4272-92ac-10ce948abd42 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 21:41:03.708203 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:41:03.708203 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:41:03.708203 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:41:03.708203 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:41:03.708203 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:41:03.708203 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:41:03.708203 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:41:03.708203 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:41:03.708203 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:41:03.708203 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:41:03.708203 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:41:03.708203 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:41:03.708203 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:41:03.708203 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:41:03.708203 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:41:03.709156 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:41:03.709156 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:41:03.709156 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:41:03.709156 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:41:03.709156 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:41:03.709156 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:41:03.709156 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:41:03.709156 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:41:03.709156 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:41:03.709156 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:41:03.709156 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:41:03.709156 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application with Lock( Aug 18 21:41:03.709156 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:41:03.709156 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:41:03.709156 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:41:03.709156 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:41:03.709944 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:41:03.709944 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:41:03.709944 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:41:03.709944 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:41:03.709944 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:41:03.709944 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:41:03.709944 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:41:03.709944 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:41:03.709944 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:41:03.709944 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:41:03.709944 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 21:41:03.709944 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:41:03.709944 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 79/151] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Aug 18 21:41:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:41:03.710602 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c280cbe-b839-4272-92ac-10ce948abd42 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:03.743541 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:03.834079 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c280cbe-b839-4272-92ac-10ce948abd42 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:03.861539 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2d2df9-e0dd-4bd0-9fec-aca62a7ad2ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:03.863108 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2d2df9-e0dd-4bd0-9fec-aca62a7ad2ae None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:03.873232 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd86bcba-4882-4908-9767-5676dadb5ed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:03.873887 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd86bcba-4882-4908-9767-5676dadb5ed6 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:03.874176 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd86bcba-4882-4908-9767-5676dadb5ed6 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:03.874455 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd86bcba-4882-4908-9767-5676dadb5ed6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:03.886923 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd86bcba-4882-4908-9767-5676dadb5ed6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:41:03.894187 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application [None req-dd86bcba-4882-4908-9767-5676dadb5ed6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 21:41:03.894187 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:41:03.894187 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:41:03.894187 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:41:03.894187 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:41:03.894187 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:41:03.894187 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:41:03.894187 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:41:03.894187 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:41:03.894187 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:41:03.894187 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:41:03.894187 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:41:03.894187 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:41:03.894187 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:41:03.894187 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:41:03.894187 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:41:03.895076 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:41:03.895076 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:41:03.895076 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:41:03.895076 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:41:03.895076 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:41:03.895076 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:41:03.895076 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:41:03.895076 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:41:03.895076 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:41:03.895076 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:41:03.895076 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:41:03.895076 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application with Lock( Aug 18 21:41:03.895076 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:41:03.895076 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:41:03.895076 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:41:03.895076 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:41:03.895992 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:41:03.895992 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:41:03.895992 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:41:03.895992 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:41:03.895992 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:41:03.895992 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:41:03.895992 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:41:03.895992 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:41:03.895992 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:41:03.895992 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:41:03.895992 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 21:41:03.895992 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:41:03.895992 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 80/152] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Aug 18 21:41:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:41:03.896773 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd86bcba-4882-4908-9767-5676dadb5ed6 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:03.985687 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:04.002513 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 73/153] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Aug 18 21:41:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 528 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 21:41:04.008755 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2d2df9-e0dd-4bd0-9fec-aca62a7ad2ae None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:04.008873 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:04.011231 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd86bcba-4882-4908-9767-5676dadb5ed6 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:04.067365 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8ae56d-dbb9-44fc-aebc-7241c5ffa832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:04.068036 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8ae56d-dbb9-44fc-aebc-7241c5ffa832 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:04.068317 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8ae56d-dbb9-44fc-aebc-7241c5ffa832 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:04.068607 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8ae56d-dbb9-44fc-aebc-7241c5ffa832 None admin] PATH_INFO: `/v3/roles` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:04.069304 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8ae56d-dbb9-44fc-aebc-7241c5ffa832 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:41:04.069574 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8ae56d-dbb9-44fc-aebc-7241c5ffa832 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:04.070969 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8ae56d-dbb9-44fc-aebc-7241c5ffa832 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:04.094879 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 81/154] 10.222.0.27 () {56 vars in 1101 bytes} [Thu Aug 18 21:41:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:04.096159 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d980f3a7-6a25-4d1a-9900-a7a8c8426f5b None None] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:04.096454 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d980f3a7-6a25-4d1a-9900-a7a8c8426f5b None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:04.099876 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d980f3a7-6a25-4d1a-9900-a7a8c8426f5b None None] PATH_INFO: `/` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:04.101370 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 82/155] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:41:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:41:04.101929 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d980f3a7-6a25-4d1a-9900-a7a8c8426f5b None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:04.218206 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2d2df9-e0dd-4bd0-9fec-aca62a7ad2ae None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:04.299020 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d980f3a7-6a25-4d1a-9900-a7a8c8426f5b None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:04.313432 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd6966e-d590-4758-9866-1b48cc4b733f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:04.314449 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd6966e-d590-4758-9866-1b48cc4b733f None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:04.314936 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd6966e-d590-4758-9866-1b48cc4b733f None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:04.315432 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd6966e-d590-4758-9866-1b48cc4b733f None admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:04.316308 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd6966e-d590-4758-9866-1b48cc4b733f None admin] RBAC: Adding query filter params (name=admin) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:41:04.316859 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd6966e-d590-4758-9866-1b48cc4b733f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:04.318564 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd6966e-d590-4758-9866-1b48cc4b733f None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:04.342100 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 74/156] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Aug 18 21:41:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:04.344062 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5134a1-62ae-4e6d-ac35-950e2ecb5c62 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:04.344554 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5134a1-62ae-4e6d-ac35-950e2ecb5c62 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:04.345067 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5134a1-62ae-4e6d-ac35-950e2ecb5c62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:04.361360 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cd3102-07b9-4bc0-acdc-0599b09358c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:04.362018 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cd3102-07b9-4bc0-acdc-0599b09358c6 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:04.362305 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cd3102-07b9-4bc0-acdc-0599b09358c6 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:04.362581 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cd3102-07b9-4bc0-acdc-0599b09358c6 None admin] PATH_INFO: `/v3/projects/e475732a8fb6447b8d2ccca84af2071a` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:04.363762 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cd3102-07b9-4bc0-acdc-0599b09358c6 None admin] RBAC: Authorizing `identity:get_project(project_id=e475732a8fb6447b8d2ccca84af2071a)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:04.365501 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cd3102-07b9-4bc0-acdc-0599b09358c6 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:04.368116 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 83/157] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Aug 18 21:41:04 2022] GET /identity/v3/projects/e475732a8fb6447b8d2ccca84af2071a => generated 298 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:04.368925 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cd3102-07b9-4bc0-acdc-0599b09358c6 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:04.379420 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-2c5134a1-62ae-4e6d-ac35-950e2ecb5c62 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:41:04.380987 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-2c5134a1-62ae-4e6d-ac35-950e2ecb5c62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:41:04.388461 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:04.504947 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:04.528301 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cd3102-07b9-4bc0-acdc-0599b09358c6 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:04.546410 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 75/158] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:41:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 21:41:04.547480 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5134a1-62ae-4e6d-ac35-950e2ecb5c62 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:04.574400 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d96d9d7-a974-4984-9ebd-322ce4307945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:04.575046 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d96d9d7-a974-4984-9ebd-322ce4307945 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:04.575327 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d96d9d7-a974-4984-9ebd-322ce4307945 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:04.575604 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d96d9d7-a974-4984-9ebd-322ce4307945 None admin] PATH_INFO: `/v3/users/d0f5f98e8dd94128a35862081afb409a` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:04.580138 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d96d9d7-a974-4984-9ebd-322ce4307945 None admin] RBAC: Authorizing `identity:get_user(user_id=d0f5f98e8dd94128a35862081afb409a)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:04.581825 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d96d9d7-a974-4984-9ebd-322ce4307945 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:04.583810 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 84/159] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Aug 18 21:41:04 2022] GET /identity/v3/users/d0f5f98e8dd94128a35862081afb409a => generated 289 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:04.584788 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d96d9d7-a974-4984-9ebd-322ce4307945 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:04.756227 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:04.773635 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5134a1-62ae-4e6d-ac35-950e2ecb5c62 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:04.785274 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d96d9d7-a974-4984-9ebd-322ce4307945 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:04.833994 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba20f8f-6c95-46db-8258-607b3cd7df1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:04.835611 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba20f8f-6c95-46db-8258-607b3cd7df1b None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:04.836263 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba20f8f-6c95-46db-8258-607b3cd7df1b None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:04.837482 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba20f8f-6c95-46db-8258-607b3cd7df1b None admin] PATH_INFO: `/v3/users/b468708457d44a0a864439dd99359654` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:04.839408 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba20f8f-6c95-46db-8258-607b3cd7df1b None admin] RBAC: Authorizing `identity:get_user(user_id=b468708457d44a0a864439dd99359654)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:04.841822 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba20f8f-6c95-46db-8258-607b3cd7df1b None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:04.844868 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 76/160] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Aug 18 21:41:04 2022] GET /identity/v3/users/b468708457d44a0a864439dd99359654 => generated 247 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:04.849135 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6840b636-00d1-421d-8d00-2b0de42acc96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:04.850584 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6840b636-00d1-421d-8d00-2b0de42acc96 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:04.851015 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba20f8f-6c95-46db-8258-607b3cd7df1b None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:04.851868 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6840b636-00d1-421d-8d00-2b0de42acc96 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:04.852739 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6840b636-00d1-421d-8d00-2b0de42acc96 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:04.855378 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6840b636-00d1-421d-8d00-2b0de42acc96 None admin] RBAC: Adding query filter params (role.id=de8f2438056f4af9879423f8a59e0e0b, scope.project.id=e475732a8fb6447b8d2ccca84af2071a, user.id=5935b35ad1844f5c827a7303ed74c83d) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:41:04.855892 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6840b636-00d1-421d-8d00-2b0de42acc96 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:04.857869 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6840b636-00d1-421d-8d00-2b0de42acc96 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:04.871495 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 85/161] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Aug 18 21:41:04 2022] GET /identity/v3/role_assignments?user.id=5935b35ad1844f5c827a7303ed74c83d&scope.project.id=e475732a8fb6447b8d2ccca84af2071a&role.id=de8f2438056f4af9879423f8a59e0e0b => generated 608 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:04.872799 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6840b636-00d1-421d-8d00-2b0de42acc96 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:04.929428 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:05.003046 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba20f8f-6c95-46db-8258-607b3cd7df1b None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:05.072103 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6840b636-00d1-421d-8d00-2b0de42acc96 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:05.075653 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365baab3-a86c-4108-8101-d4cb695bec33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:05.075653 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365baab3-a86c-4108-8101-d4cb695bec33 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:05.075946 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365baab3-a86c-4108-8101-d4cb695bec33 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:05.076185 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365baab3-a86c-4108-8101-d4cb695bec33 None admin] PATH_INFO: `/v3/projects/e475732a8fb6447b8d2ccca84af2071a` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:05.081512 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365baab3-a86c-4108-8101-d4cb695bec33 None admin] RBAC: Authorizing `identity:get_project(project_id=e475732a8fb6447b8d2ccca84af2071a)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:05.083032 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365baab3-a86c-4108-8101-d4cb695bec33 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:05.088692 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 77/162] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Aug 18 21:41:04 2022] GET /identity/v3/projects/e475732a8fb6447b8d2ccca84af2071a => generated 298 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:05.095987 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365baab3-a86c-4108-8101-d4cb695bec33 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:05.138042 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06f858b-4ee1-4a8e-a81f-97244a9fde1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:05.139063 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06f858b-4ee1-4a8e-a81f-97244a9fde1c None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:05.139874 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06f858b-4ee1-4a8e-a81f-97244a9fde1c None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:05.140924 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06f858b-4ee1-4a8e-a81f-97244a9fde1c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:05.161590 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:05.243254 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06f858b-4ee1-4a8e-a81f-97244a9fde1c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:05.245166 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06f858b-4ee1-4a8e-a81f-97244a9fde1c None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:05.322797 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365baab3-a86c-4108-8101-d4cb695bec33 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:05.366913 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:05.395720 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 86/163] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Aug 18 21:41:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 523 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 21:41:05.396977 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06f858b-4ee1-4a8e-a81f-97244a9fde1c None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:05.408212 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2245812f-4318-4eef-950f-37480d8f4e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:05.408931 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2245812f-4318-4eef-950f-37480d8f4e85 None admin] REQUEST_METHOD: `PUT` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:05.409212 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2245812f-4318-4eef-950f-37480d8f4e85 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:05.409486 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2245812f-4318-4eef-950f-37480d8f4e85 None admin] PATH_INFO: `/v3/projects/e475732a8fb6447b8d2ccca84af2071a/users/d0f5f98e8dd94128a35862081afb409a/roles/a1ecfacad5ac443db590b35c86cd49e2` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:05.411521 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2245812f-4318-4eef-950f-37480d8f4e85 None admin] RBAC: Authorizing `identity:create_grant(project_id=e475732a8fb6447b8d2ccca84af2071a, user_id=d0f5f98e8dd94128a35862081afb409a, role_id=a1ecfacad5ac443db590b35c86cd49e2)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:05.413068 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2245812f-4318-4eef-950f-37480d8f4e85 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:05.455191 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:05.481461 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 78/164] 10.222.0.27 () {58 vars in 1439 bytes} [Thu Aug 18 21:41:05 2022] PUT /identity/v3/projects/e475732a8fb6447b8d2ccca84af2071a/users/d0f5f98e8dd94128a35862081afb409a/roles/a1ecfacad5ac443db590b35c86cd49e2 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 21:41:05.484569 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239e013d-eab6-4f6c-b0a1-19384964abad None None] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:05.484569 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239e013d-eab6-4f6c-b0a1-19384964abad None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:05.484569 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239e013d-eab6-4f6c-b0a1-19384964abad None None] PATH_INFO: `/` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:05.485626 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 79/165] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:41:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:41:05.486305 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239e013d-eab6-4f6c-b0a1-19384964abad None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:05.534015 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06f858b-4ee1-4a8e-a81f-97244a9fde1c None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:05.592773 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92e134f-2a7c-47cc-81de-79c2a435e7ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:05.593451 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92e134f-2a7c-47cc-81de-79c2a435e7ba None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:05.593733 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92e134f-2a7c-47cc-81de-79c2a435e7ba None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:05.594006 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92e134f-2a7c-47cc-81de-79c2a435e7ba None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:05.612894 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92e134f-2a7c-47cc-81de-79c2a435e7ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:41:05.618124 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application [None req-c92e134f-2a7c-47cc-81de-79c2a435e7ba None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 21:41:05.618124 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:41:05.618124 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:41:05.618124 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:41:05.618124 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:41:05.618124 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:41:05.618124 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:41:05.618124 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:41:05.618124 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:41:05.618124 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:41:05.618124 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:41:05.618124 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:41:05.618124 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:41:05.618124 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:41:05.618124 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:41:05.618124 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:41:05.618995 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:41:05.618995 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:41:05.618995 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:41:05.618995 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:41:05.618995 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:41:05.618995 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:41:05.618995 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:41:05.618995 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:41:05.618995 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:41:05.618995 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:41:05.618995 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:41:05.618995 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application with Lock( Aug 18 21:41:05.618995 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:41:05.618995 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:41:05.618995 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:41:05.618995 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:41:05.620509 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:41:05.620509 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:41:05.620509 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:41:05.620509 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:41:05.620509 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:41:05.620509 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:41:05.620509 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:41:05.620509 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:41:05.620509 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:41:05.620509 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:41:05.620509 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 21:41:05.620509 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:41:05.620509 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 87/166] 10.222.0.27 () {56 vars in 1114 bytes} [Thu Aug 18 21:41:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:41:05.620509 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6a5b32-cf34-42e2-8338-4822ef0ed82d None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:05.621409 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6a5b32-cf34-42e2-8338-4822ef0ed82d None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:05.621409 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6a5b32-cf34-42e2-8338-4822ef0ed82d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:05.652239 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-cf6a5b32-cf34-42e2-8338-4822ef0ed82d None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:41:05.653687 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-cf6a5b32-cf34-42e2-8338-4822ef0ed82d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:41:05.774169 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 88/167] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:41:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 21:41:05.775607 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6a5b32-cf34-42e2-8338-4822ef0ed82d None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:05.798017 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239e013d-eab6-4f6c-b0a1-19384964abad None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:05.816045 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:05.846448 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c791deeb-2af8-4295-9fdc-b2915757e6cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:05.847719 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c791deeb-2af8-4295-9fdc-b2915757e6cb None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:05.848006 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c791deeb-2af8-4295-9fdc-b2915757e6cb None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:05.848287 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c791deeb-2af8-4295-9fdc-b2915757e6cb None admin] PATH_INFO: `/v3/projects/e475732a8fb6447b8d2ccca84af2071a` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:05.849753 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c791deeb-2af8-4295-9fdc-b2915757e6cb None admin] RBAC: Authorizing `identity:get_project(project_id=e475732a8fb6447b8d2ccca84af2071a)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:05.851974 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c791deeb-2af8-4295-9fdc-b2915757e6cb None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:05.856881 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 80/168] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Aug 18 21:41:05 2022] GET /identity/v3/projects/e475732a8fb6447b8d2ccca84af2071a => generated 298 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:05.865818 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c791deeb-2af8-4295-9fdc-b2915757e6cb None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:05.914185 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6a5b32-cf34-42e2-8338-4822ef0ed82d None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:05.929279 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:05.959610 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd60f74-404f-464e-b829-9bd49e9722b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:05.960762 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd60f74-404f-464e-b829-9bd49e9722b8 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:05.961245 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd60f74-404f-464e-b829-9bd49e9722b8 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:05.961714 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd60f74-404f-464e-b829-9bd49e9722b8 None admin] PATH_INFO: `/v3/roles` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:05.962617 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd60f74-404f-464e-b829-9bd49e9722b8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:41:05.963130 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd60f74-404f-464e-b829-9bd49e9722b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:05.965013 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd60f74-404f-464e-b829-9bd49e9722b8 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:05.987194 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 89/169] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Aug 18 21:41:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:05.989137 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977937b8-e86f-4718-b6e5-371250d9a2de None None] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:05.989425 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977937b8-e86f-4718-b6e5-371250d9a2de None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:05.989703 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977937b8-e86f-4718-b6e5-371250d9a2de None None] PATH_INFO: `/` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:05.992863 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 90/170] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:41:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:41:05.998242 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3e98b9-148e-4f81-b149-1dc37bd6aa92 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:05.998382 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3e98b9-148e-4f81-b149-1dc37bd6aa92 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:05.998571 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3e98b9-148e-4f81-b149-1dc37bd6aa92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:06.022957 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c791deeb-2af8-4295-9fdc-b2915757e6cb None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:06.036056 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-cd3e98b9-148e-4f81-b149-1dc37bd6aa92 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:41:06.037292 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-cd3e98b9-148e-4f81-b149-1dc37bd6aa92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:41:06.084357 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed49645-4102-4c89-8aee-19fdae9ea9e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:06.085715 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed49645-4102-4c89-8aee-19fdae9ea9e6 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:06.085998 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed49645-4102-4c89-8aee-19fdae9ea9e6 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:06.086272 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed49645-4102-4c89-8aee-19fdae9ea9e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:06.087001 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed49645-4102-4c89-8aee-19fdae9ea9e6 None admin] RBAC: Adding query filter params (role.id=0833202e2a3d47d1b6b3af57006641b1, scope.project.id=e475732a8fb6447b8d2ccca84af2071a, user.id=b468708457d44a0a864439dd99359654) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:41:06.087310 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed49645-4102-4c89-8aee-19fdae9ea9e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:06.088776 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed49645-4102-4c89-8aee-19fdae9ea9e6 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:06.100132 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 81/171] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Aug 18 21:41:05 2022] GET /identity/v3/role_assignments?user.id=b468708457d44a0a864439dd99359654&scope.project.id=e475732a8fb6447b8d2ccca84af2071a&role.id=0833202e2a3d47d1b6b3af57006641b1 => generated 608 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 21:41:06.101362 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed49645-4102-4c89-8aee-19fdae9ea9e6 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:06.170256 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 91/172] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:41:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 21:41:06.259628 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed49645-4102-4c89-8aee-19fdae9ea9e6 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:06.275004 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:06.302524 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e1e48f-497b-45d7-ba0d-65f8cda012e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:06.303169 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e1e48f-497b-45d7-ba0d-65f8cda012e3 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:06.303452 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e1e48f-497b-45d7-ba0d-65f8cda012e3 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:06.303812 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e1e48f-497b-45d7-ba0d-65f8cda012e3 None admin] PATH_INFO: `/v3/users/5935b35ad1844f5c827a7303ed74c83d` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:06.305029 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e1e48f-497b-45d7-ba0d-65f8cda012e3 None admin] RBAC: Authorizing `identity:get_user(user_id=5935b35ad1844f5c827a7303ed74c83d)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:06.306495 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e1e48f-497b-45d7-ba0d-65f8cda012e3 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:06.308254 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 82/173] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Aug 18 21:41:06 2022] GET /identity/v3/users/5935b35ad1844f5c827a7303ed74c83d => generated 275 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:06.315840 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3e98b9-148e-4f81-b149-1dc37bd6aa92 None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:06.351220 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:06.370812 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e1e48f-497b-45d7-ba0d-65f8cda012e3 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:06.490093 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3e98b9-148e-4f81-b149-1dc37bd6aa92 None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:06.528921 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e0b878-46c8-4056-a748-cc2c64245816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:06.529543 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e0b878-46c8-4056-a748-cc2c64245816 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:06.529823 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e0b878-46c8-4056-a748-cc2c64245816 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:06.530093 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e0b878-46c8-4056-a748-cc2c64245816 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:06.556066 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e1e48f-497b-45d7-ba0d-65f8cda012e3 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:06.612241 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b9a795-7542-41a2-9db3-9c29b4e6de81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:06.613198 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b9a795-7542-41a2-9db3-9c29b4e6de81 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:06.613504 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b9a795-7542-41a2-9db3-9c29b4e6de81 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:06.614697 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b9a795-7542-41a2-9db3-9c29b4e6de81 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:06.637585 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b9a795-7542-41a2-9db3-9c29b4e6de81 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:41:06.645285 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application [None req-e8b9a795-7542-41a2-9db3-9c29b4e6de81 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 21:41:06.645285 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:41:06.645285 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:41:06.645285 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:41:06.645285 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:41:06.645285 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:41:06.645285 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:41:06.645285 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:41:06.645285 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:41:06.645285 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:41:06.645285 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:41:06.645285 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:41:06.645285 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:41:06.645285 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:41:06.645285 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:41:06.645285 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:41:06.646264 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:41:06.646264 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:41:06.646264 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:41:06.646264 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:41:06.646264 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:41:06.646264 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:41:06.646264 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:41:06.646264 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:41:06.646264 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:41:06.646264 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:41:06.646264 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:41:06.646264 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application with Lock( Aug 18 21:41:06.646264 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:41:06.646264 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:41:06.646264 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:41:06.646264 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:41:06.647046 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:41:06.647046 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:41:06.647046 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:41:06.647046 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:41:06.647046 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:41:06.647046 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:41:06.647046 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:41:06.647046 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:41:06.647046 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:41:06.647046 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:41:06.647046 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 21:41:06.647046 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:41:06.647046 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 83/174] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Aug 18 21:41:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 21:41:06.653303 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b9a795-7542-41a2-9db3-9c29b4e6de81 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:06.677214 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e0b878-46c8-4056-a748-cc2c64245816 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:06.678736 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e0b878-46c8-4056-a748-cc2c64245816 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:06.715445 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:06.747613 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:06.822794 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 92/175] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Aug 18 21:41:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 21:41:06.824025 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e0b878-46c8-4056-a748-cc2c64245816 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:06.841799 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b9a795-7542-41a2-9db3-9c29b4e6de81 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:06.893789 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06089edc-0cbd-4d34-b5ec-42e6f2cb5c0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:06.894408 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06089edc-0cbd-4d34-b5ec-42e6f2cb5c0e None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:06.894692 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06089edc-0cbd-4d34-b5ec-42e6f2cb5c0e None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:06.894970 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06089edc-0cbd-4d34-b5ec-42e6f2cb5c0e None admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:06.895649 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06089edc-0cbd-4d34-b5ec-42e6f2cb5c0e None admin] RBAC: Adding query filter params (name=member) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:41:06.895948 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06089edc-0cbd-4d34-b5ec-42e6f2cb5c0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:06.897395 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06089edc-0cbd-4d34-b5ec-42e6f2cb5c0e None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:06.906468 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 84/176] 10.222.0.27 () {56 vars in 1101 bytes} [Thu Aug 18 21:41:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:06.907135 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06089edc-0cbd-4d34-b5ec-42e6f2cb5c0e None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:06.963947 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e0b878-46c8-4056-a748-cc2c64245816 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:06.991618 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:07.011188 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69202a7b-9600-42aa-9962-b6a6e0b5e3c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:07.011188 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69202a7b-9600-42aa-9962-b6a6e0b5e3c8 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:07.011188 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69202a7b-9600-42aa-9962-b6a6e0b5e3c8 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:07.011188 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69202a7b-9600-42aa-9962-b6a6e0b5e3c8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:07.017953 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69202a7b-9600-42aa-9962-b6a6e0b5e3c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:41:07.021179 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:07.024720 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application [None req-69202a7b-9600-42aa-9962-b6a6e0b5e3c8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 21:41:07.024720 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:41:07.024720 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:41:07.024720 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:41:07.024720 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:41:07.024720 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:41:07.024720 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:41:07.024720 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:41:07.024720 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:41:07.024720 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:41:07.024720 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:41:07.024720 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:41:07.024720 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:41:07.024720 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:41:07.024720 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:41:07.024720 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:41:07.025615 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:41:07.025615 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:41:07.025615 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:41:07.025615 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:41:07.025615 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:41:07.025615 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:41:07.025615 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:41:07.025615 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:41:07.025615 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:41:07.025615 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:41:07.025615 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:41:07.025615 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application with Lock( Aug 18 21:41:07.025615 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:41:07.025615 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:41:07.025615 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:41:07.025615 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:41:07.026397 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:41:07.026397 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:41:07.026397 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:41:07.026397 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:41:07.026397 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:41:07.026397 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:41:07.026397 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:41:07.026397 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:41:07.026397 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:41:07.026397 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:41:07.026397 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 21:41:07.026397 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:41:07.027021 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06089edc-0cbd-4d34-b5ec-42e6f2cb5c0e None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:07.028867 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 93/177] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Aug 18 21:41:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:41:07.031860 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a22c33f-cade-45ed-8ee7-46cdae063fe8 None None] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:07.032475 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a22c33f-cade-45ed-8ee7-46cdae063fe8 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:07.032974 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a22c33f-cade-45ed-8ee7-46cdae063fe8 None None] PATH_INFO: `/` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:07.034557 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 94/178] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:41:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:41:07.035737 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a22c33f-cade-45ed-8ee7-46cdae063fe8 None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:07.078652 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915cb1df-be34-4ace-ae1c-866be1f05987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:07.080539 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915cb1df-be34-4ace-ae1c-866be1f05987 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:07.081065 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915cb1df-be34-4ace-ae1c-866be1f05987 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:07.081565 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915cb1df-be34-4ace-ae1c-866be1f05987 None admin] PATH_INFO: `/v3/projects/e475732a8fb6447b8d2ccca84af2071a` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:07.082977 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915cb1df-be34-4ace-ae1c-866be1f05987 None admin] RBAC: Authorizing `identity:get_project(project_id=e475732a8fb6447b8d2ccca84af2071a)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:07.084691 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915cb1df-be34-4ace-ae1c-866be1f05987 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:07.087635 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 85/179] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Aug 18 21:41:06 2022] GET /identity/v3/projects/e475732a8fb6447b8d2ccca84af2071a => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:07.088715 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915cb1df-be34-4ace-ae1c-866be1f05987 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:07.158032 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a22c33f-cade-45ed-8ee7-46cdae063fe8 None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:07.198109 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995190f8-78aa-480a-92d4-667b6af77249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:07.199056 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995190f8-78aa-480a-92d4-667b6af77249 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:07.199493 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995190f8-78aa-480a-92d4-667b6af77249 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:07.199763 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995190f8-78aa-480a-92d4-667b6af77249 None admin] PATH_INFO: `/v3/users/5935b35ad1844f5c827a7303ed74c83d` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:07.200944 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995190f8-78aa-480a-92d4-667b6af77249 None admin] RBAC: Authorizing `identity:get_user(user_id=5935b35ad1844f5c827a7303ed74c83d)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:07.201309 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915cb1df-be34-4ace-ae1c-866be1f05987 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:07.202391 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995190f8-78aa-480a-92d4-667b6af77249 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:07.204623 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 95/180] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Aug 18 21:41:07 2022] GET /identity/v3/users/5935b35ad1844f5c827a7303ed74c83d => generated 275 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:07.205700 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797faee8-6535-4e13-8e1c-4d33e1559917 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:07.205983 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797faee8-6535-4e13-8e1c-4d33e1559917 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:07.206257 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797faee8-6535-4e13-8e1c-4d33e1559917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:07.224757 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-797faee8-6535-4e13-8e1c-4d33e1559917 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:41:07.225956 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-797faee8-6535-4e13-8e1c-4d33e1559917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:41:07.243115 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fc909b-9642-4e25-84f9-f0f8353808fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:07.243716 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fc909b-9642-4e25-84f9-f0f8353808fc None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:07.244032 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fc909b-9642-4e25-84f9-f0f8353808fc None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:07.244310 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fc909b-9642-4e25-84f9-f0f8353808fc None admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:07.245025 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fc909b-9642-4e25-84f9-f0f8353808fc None admin] RBAC: Adding query filter params (name=admin) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:41:07.245324 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fc909b-9642-4e25-84f9-f0f8353808fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:07.246693 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fc909b-9642-4e25-84f9-f0f8353808fc None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:07.256023 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 86/181] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Aug 18 21:41:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:07.256759 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fc909b-9642-4e25-84f9-f0f8353808fc None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:07.282916 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:07.295267 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:07.306987 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 96/182] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:41:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 21:41:07.308445 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8b3f7d-d9c7-4f29-901b-88afd358aeb3 None None] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:07.308768 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8b3f7d-d9c7-4f29-901b-88afd358aeb3 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:07.309043 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8b3f7d-d9c7-4f29-901b-88afd358aeb3 None None] PATH_INFO: `/` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:07.310500 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 97/183] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:41:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:41:07.311005 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8b3f7d-d9c7-4f29-901b-88afd358aeb3 None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:07.382050 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fc909b-9642-4e25-84f9-f0f8353808fc None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:07.417804 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f91d504-4242-490e-a2eb-cd7d643233fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:07.418438 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f91d504-4242-490e-a2eb-cd7d643233fa None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:07.418716 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f91d504-4242-490e-a2eb-cd7d643233fa None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:07.418990 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f91d504-4242-490e-a2eb-cd7d643233fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:07.419716 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f91d504-4242-490e-a2eb-cd7d643233fa None admin] RBAC: Adding query filter params (role.id=66171a9efb5344c7a903946f238a3808, scope.project.id=e475732a8fb6447b8d2ccca84af2071a, user.id=5935b35ad1844f5c827a7303ed74c83d) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:41:07.420031 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f91d504-4242-490e-a2eb-cd7d643233fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:07.421936 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8b3f7d-d9c7-4f29-901b-88afd358aeb3 None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:07.422113 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f91d504-4242-490e-a2eb-cd7d643233fa None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:07.428157 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 87/184] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Aug 18 21:41:07 2022] GET /identity/v3/role_assignments?user.id=5935b35ad1844f5c827a7303ed74c83d&scope.project.id=e475732a8fb6447b8d2ccca84af2071a&role.id=66171a9efb5344c7a903946f238a3808 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:07.428988 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f91d504-4242-490e-a2eb-cd7d643233fa None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:07.462999 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565c7738-a377-4d89-aaf0-dca8a8ce311c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:07.464095 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565c7738-a377-4d89-aaf0-dca8a8ce311c None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:07.464629 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565c7738-a377-4d89-aaf0-dca8a8ce311c None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:07.465127 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565c7738-a377-4d89-aaf0-dca8a8ce311c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:07.523110 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:07.535209 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:07.542816 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f91d504-4242-490e-a2eb-cd7d643233fa None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:07.546024 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565c7738-a377-4d89-aaf0-dca8a8ce311c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:07.548365 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565c7738-a377-4d89-aaf0-dca8a8ce311c None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:07.581850 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6458657-2a8e-49eb-813f-1907502d1c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:07.582807 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6458657-2a8e-49eb-813f-1907502d1c16 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:07.583093 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6458657-2a8e-49eb-813f-1907502d1c16 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:07.583499 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6458657-2a8e-49eb-813f-1907502d1c16 None admin] PATH_INFO: `/v3/users/d7df53d358274e3f9b401339ac1e8124` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:07.601227 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6458657-2a8e-49eb-813f-1907502d1c16 None admin] RBAC: Authorizing `identity:get_user(user_id=d7df53d358274e3f9b401339ac1e8124)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:07.602754 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6458657-2a8e-49eb-813f-1907502d1c16 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:07.604474 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 88/185] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Aug 18 21:41:07 2022] GET /identity/v3/users/d7df53d358274e3f9b401339ac1e8124 => generated 283 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:07.605694 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb3976d-f23b-4079-b460-9d1ccdd3e5ea None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:07.605976 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb3976d-f23b-4079-b460-9d1ccdd3e5ea None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:07.606247 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb3976d-f23b-4079-b460-9d1ccdd3e5ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:07.626147 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-2fb3976d-f23b-4079-b460-9d1ccdd3e5ea None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:41:07.627443 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-2fb3976d-f23b-4079-b460-9d1ccdd3e5ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:41:07.673719 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 98/186] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Aug 18 21:41:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 21:41:07.674432 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565c7738-a377-4d89-aaf0-dca8a8ce311c None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:07.712325 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 89/187] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:41:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 21:41:07.713087 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb3976d-f23b-4079-b460-9d1ccdd3e5ea None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:07.783865 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:07.804386 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565c7738-a377-4d89-aaf0-dca8a8ce311c None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:07.807753 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:07.826681 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb3976d-f23b-4079-b460-9d1ccdd3e5ea None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:07.865650 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879b02fa-f16a-44a0-a501-10a501465b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:07.866383 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879b02fa-f16a-44a0-a501-10a501465b28 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:07.866673 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879b02fa-f16a-44a0-a501-10a501465b28 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:07.866957 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879b02fa-f16a-44a0-a501-10a501465b28 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:07.870982 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f12b538-c794-41c0-b1a0-508551e08e3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:07.872195 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f12b538-c794-41c0-b1a0-508551e08e3a None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:07.872726 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f12b538-c794-41c0-b1a0-508551e08e3a None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:07.873194 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f12b538-c794-41c0-b1a0-508551e08e3a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:07.880282 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879b02fa-f16a-44a0-a501-10a501465b28 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:41:07.885655 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application [None req-879b02fa-f16a-44a0-a501-10a501465b28 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 21:41:07.885655 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:41:07.885655 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:41:07.885655 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:41:07.885655 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:41:07.885655 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:41:07.885655 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:41:07.885655 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:41:07.885655 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:41:07.885655 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:41:07.885655 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:41:07.885655 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:41:07.885655 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:41:07.885655 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:41:07.885655 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:41:07.885655 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:41:07.886605 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:41:07.886605 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:41:07.886605 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:41:07.886605 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:41:07.886605 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:41:07.886605 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:41:07.886605 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:41:07.886605 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:41:07.886605 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:41:07.886605 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:41:07.886605 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:41:07.886605 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application with Lock( Aug 18 21:41:07.886605 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:41:07.886605 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:41:07.886605 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:41:07.886605 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:41:07.887398 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:41:07.887398 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:41:07.887398 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:41:07.887398 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:41:07.887398 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:41:07.887398 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:41:07.887398 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:41:07.887398 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:41:07.887398 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:41:07.887398 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:41:07.887398 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 21:41:07.887398 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:41:07.887398 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 99/188] 10.222.0.27 () {56 vars in 1114 bytes} [Thu Aug 18 21:41:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:41:07.888058 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879b02fa-f16a-44a0-a501-10a501465b28 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:07.963890 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f12b538-c794-41c0-b1a0-508551e08e3a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:07.965394 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f12b538-c794-41c0-b1a0-508551e08e3a None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:08.009892 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879b02fa-f16a-44a0-a501-10a501465b28 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:08.051362 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6356bbe-84a4-4baf-ac9d-f9269d965151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:08.052473 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:08.052697 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6356bbe-84a4-4baf-ac9d-f9269d965151 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:08.053110 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6356bbe-84a4-4baf-ac9d-f9269d965151 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:08.053537 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6356bbe-84a4-4baf-ac9d-f9269d965151 None admin] PATH_INFO: `/v3/projects/6655909799ae40b28b20bbe95d7bc6be` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:08.055463 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6356bbe-84a4-4baf-ac9d-f9269d965151 None admin] RBAC: Authorizing `identity:get_project(project_id=6655909799ae40b28b20bbe95d7bc6be)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:08.057557 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6356bbe-84a4-4baf-ac9d-f9269d965151 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:08.059350 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 100/189] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Aug 18 21:41:07 2022] GET /identity/v3/projects/6655909799ae40b28b20bbe95d7bc6be => generated 312 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:08.060690 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6356bbe-84a4-4baf-ac9d-f9269d965151 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:08.073773 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 90/190] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Aug 18 21:41:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 21:41:08.074636 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f12b538-c794-41c0-b1a0-508551e08e3a None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:08.083290 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:08.176906 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6356bbe-84a4-4baf-ac9d-f9269d965151 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:08.185384 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f12b538-c794-41c0-b1a0-508551e08e3a None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:08.210850 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f90563d-9423-4b8f-8f3b-03ea3eba3642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:08.211454 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f90563d-9423-4b8f-8f3b-03ea3eba3642 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:08.211732 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f90563d-9423-4b8f-8f3b-03ea3eba3642 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:08.212005 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f90563d-9423-4b8f-8f3b-03ea3eba3642 None admin] PATH_INFO: `/v3/roles` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:08.212693 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f90563d-9423-4b8f-8f3b-03ea3eba3642 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:41:08.213001 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f90563d-9423-4b8f-8f3b-03ea3eba3642 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:08.214360 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f90563d-9423-4b8f-8f3b-03ea3eba3642 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:08.219891 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3cf6db-457a-4bcc-99ce-2065df07edcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:08.220517 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3cf6db-457a-4bcc-99ce-2065df07edcd None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:08.220829 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3cf6db-457a-4bcc-99ce-2065df07edcd None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:08.221107 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3cf6db-457a-4bcc-99ce-2065df07edcd None admin] PATH_INFO: `/v3/domains/default` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:08.222030 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 101/191] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Aug 18 21:41:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:08.222809 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f90563d-9423-4b8f-8f3b-03ea3eba3642 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:08.224858 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3cf6db-457a-4bcc-99ce-2065df07edcd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:08.226534 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3cf6db-457a-4bcc-99ce-2065df07edcd None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:08.228629 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 91/192] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 18 21:41:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:08.228989 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3cf6db-457a-4bcc-99ce-2065df07edcd None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:08.280264 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:08.298328 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:08.327463 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f90563d-9423-4b8f-8f3b-03ea3eba3642 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:08.333932 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3cf6db-457a-4bcc-99ce-2065df07edcd None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:08.361355 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cbfc69-db29-48a9-9d8a-fa323c90e032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:08.361955 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cbfc69-db29-48a9-9d8a-fa323c90e032 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:08.362242 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cbfc69-db29-48a9-9d8a-fa323c90e032 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:08.362514 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cbfc69-db29-48a9-9d8a-fa323c90e032 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:08.363237 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cbfc69-db29-48a9-9d8a-fa323c90e032 None admin] RBAC: Adding query filter params (role.id=de8f2438056f4af9879423f8a59e0e0b, scope.project.id=6655909799ae40b28b20bbe95d7bc6be, user.id=5935b35ad1844f5c827a7303ed74c83d) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:41:08.363546 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cbfc69-db29-48a9-9d8a-fa323c90e032 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:08.365002 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cbfc69-db29-48a9-9d8a-fa323c90e032 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:08.367639 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e2d051-8514-439a-bb9b-16a02e634ccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:08.368266 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e2d051-8514-439a-bb9b-16a02e634ccd None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:08.368549 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e2d051-8514-439a-bb9b-16a02e634ccd None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:08.368857 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e2d051-8514-439a-bb9b-16a02e634ccd None admin] PATH_INFO: `/v3/projects/5cfc98a315f14e00a8cddaa2c57a9da6` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:08.370005 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e2d051-8514-439a-bb9b-16a02e634ccd None admin] RBAC: Authorizing `identity:get_project(project_id=5cfc98a315f14e00a8cddaa2c57a9da6)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:08.370668 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 102/193] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Aug 18 21:41:08 2022] GET /identity/v3/role_assignments?user.id=5935b35ad1844f5c827a7303ed74c83d&scope.project.id=6655909799ae40b28b20bbe95d7bc6be&role.id=de8f2438056f4af9879423f8a59e0e0b => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:08.371457 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e2d051-8514-439a-bb9b-16a02e634ccd None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:08.373350 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 92/194] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Aug 18 21:41:08 2022] GET /identity/v3/projects/5cfc98a315f14e00a8cddaa2c57a9da6 => generated 302 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:08.373989 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e2d051-8514-439a-bb9b-16a02e634ccd None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:08.377480 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ae874c-7d72-4908-bcfe-397b8ee210aa None None] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:08.377764 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ae874c-7d72-4908-bcfe-397b8ee210aa None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:08.378043 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ae874c-7d72-4908-bcfe-397b8ee210aa None None] PATH_INFO: `/` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:08.383474 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 103/195] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:41:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:41:08.383474 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ae874c-7d72-4908-bcfe-397b8ee210aa None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:08.490291 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e2d051-8514-439a-bb9b-16a02e634ccd None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:08.505571 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ae874c-7d72-4908-bcfe-397b8ee210aa None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:08.508565 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:08.534584 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb23b176-ded7-4e41-86af-d8961a7cfbb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:08.535217 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb23b176-ded7-4e41-86af-d8961a7cfbb2 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:08.535493 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb23b176-ded7-4e41-86af-d8961a7cfbb2 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:08.536125 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb23b176-ded7-4e41-86af-d8961a7cfbb2 None admin] PATH_INFO: `/v3/users/d7df53d358274e3f9b401339ac1e8124` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:08.537351 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb23b176-ded7-4e41-86af-d8961a7cfbb2 None admin] RBAC: Authorizing `identity:get_user(user_id=d7df53d358274e3f9b401339ac1e8124)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:08.538816 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb23b176-ded7-4e41-86af-d8961a7cfbb2 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:08.541064 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 93/196] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Aug 18 21:41:08 2022] GET /identity/v3/users/d7df53d358274e3f9b401339ac1e8124 => generated 283 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:08.541184 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb23b176-ded7-4e41-86af-d8961a7cfbb2 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:08.549290 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b56c7e3-c368-43b5-9033-4dfe0b993211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:08.550192 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b56c7e3-c368-43b5-9033-4dfe0b993211 None admin] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:08.550192 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b56c7e3-c368-43b5-9033-4dfe0b993211 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:08.550438 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b56c7e3-c368-43b5-9033-4dfe0b993211 None admin] PATH_INFO: `/v3/users` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:08.551084 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b56c7e3-c368-43b5-9033-4dfe0b993211 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:08.552513 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b56c7e3-c368-43b5-9033-4dfe0b993211 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:08.561725 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:08.644298 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb23b176-ded7-4e41-86af-d8961a7cfbb2 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:08.676770 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6cfa42-85a2-412d-96be-df128048d162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:08.677360 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6cfa42-85a2-412d-96be-df128048d162 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:08.677636 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6cfa42-85a2-412d-96be-df128048d162 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:08.677903 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6cfa42-85a2-412d-96be-df128048d162 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:08.678617 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6cfa42-85a2-412d-96be-df128048d162 None admin] RBAC: Adding query filter params (role.id=0833202e2a3d47d1b6b3af57006641b1, scope.project.id=5cfc98a315f14e00a8cddaa2c57a9da6, user.id=d7df53d358274e3f9b401339ac1e8124) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:41:08.678916 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6cfa42-85a2-412d-96be-df128048d162 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:08.680347 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6cfa42-85a2-412d-96be-df128048d162 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:08.685492 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 94/197] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Aug 18 21:41:08 2022] GET /identity/v3/role_assignments?user.id=d7df53d358274e3f9b401339ac1e8124&scope.project.id=5cfc98a315f14e00a8cddaa2c57a9da6&role.id=0833202e2a3d47d1b6b3af57006641b1 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:08.686579 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7c4bc6-8a95-4138-886c-91e717816b92 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:08.686858 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7c4bc6-8a95-4138-886c-91e717816b92 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:08.687753 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7c4bc6-8a95-4138-886c-91e717816b92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:08.695060 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 104/198] 10.222.0.27 () {60 vars in 1132 bytes} [Thu Aug 18 21:41:08 2022] POST /identity/v3/users => generated 297 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:41:08.696614 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b56c7e3-c368-43b5-9033-4dfe0b993211 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:08.710878 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-8b7c4bc6-8a95-4138-886c-91e717816b92 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:41:08.712266 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-8b7c4bc6-8a95-4138-886c-91e717816b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:41:08.773019 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:08.807547 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 95/199] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:41:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 21:41:08.854929 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b56c7e3-c368-43b5-9033-4dfe0b993211 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:08.900979 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5085561a-e1fb-4af7-8a27-b2c69444ae14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:08.901533 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5085561a-e1fb-4af7-8a27-b2c69444ae14 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:08.901805 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5085561a-e1fb-4af7-8a27-b2c69444ae14 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:08.902074 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5085561a-e1fb-4af7-8a27-b2c69444ae14 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:08.966111 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:08.975890 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5085561a-e1fb-4af7-8a27-b2c69444ae14 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:08.977388 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5085561a-e1fb-4af7-8a27-b2c69444ae14 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:09.095413 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 105/200] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Aug 18 21:41:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 21:41:09.101837 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7c4bc6-8a95-4138-886c-91e717816b92 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:09.102289 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5085561a-e1fb-4af7-8a27-b2c69444ae14 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:09.297093 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:09.308137 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5085561a-e1fb-4af7-8a27-b2c69444ae14 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:09.338968 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7c4bc6-8a95-4138-886c-91e717816b92 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:09.355219 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab5ac73-4515-4088-b90d-ca1f9154ac98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:09.355975 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab5ac73-4515-4088-b90d-ca1f9154ac98 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:09.356319 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab5ac73-4515-4088-b90d-ca1f9154ac98 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:09.360580 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab5ac73-4515-4088-b90d-ca1f9154ac98 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:09.379797 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab5ac73-4515-4088-b90d-ca1f9154ac98 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:41:09.385180 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application [None req-0ab5ac73-4515-4088-b90d-ca1f9154ac98 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 21:41:09.385180 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:41:09.385180 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:41:09.385180 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:41:09.385180 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:41:09.385180 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:41:09.385180 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:41:09.385180 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:41:09.385180 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:41:09.385180 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:41:09.385180 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:41:09.385180 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:41:09.385180 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:41:09.385180 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:41:09.385180 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:41:09.385180 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:41:09.386029 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:41:09.386029 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:41:09.386029 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:41:09.386029 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:41:09.386029 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:41:09.386029 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:41:09.386029 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:41:09.386029 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:41:09.386029 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:41:09.386029 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:41:09.386029 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:41:09.386029 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application with Lock( Aug 18 21:41:09.386029 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:41:09.386029 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:41:09.386029 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:41:09.386029 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:41:09.386804 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:41:09.386804 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:41:09.386804 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:41:09.386804 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:41:09.386804 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:41:09.386804 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:41:09.386804 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:41:09.386804 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:41:09.386804 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:41:09.386804 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:41:09.386804 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 21:41:09.386804 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:41:09.386804 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 106/201] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Aug 18 21:41:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 21:41:09.400416 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab5ac73-4515-4088-b90d-ca1f9154ac98 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:09.485862 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5716417-6e46-48ee-ba1d-4e759832c4a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:09.486510 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5716417-6e46-48ee-ba1d-4e759832c4a1 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:09.486783 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5716417-6e46-48ee-ba1d-4e759832c4a1 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:09.487048 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5716417-6e46-48ee-ba1d-4e759832c4a1 None admin] PATH_INFO: `/v3/projects/5cfc98a315f14e00a8cddaa2c57a9da6` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:09.488178 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5716417-6e46-48ee-ba1d-4e759832c4a1 None admin] RBAC: Authorizing `identity:get_project(project_id=5cfc98a315f14e00a8cddaa2c57a9da6)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:09.489669 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5716417-6e46-48ee-ba1d-4e759832c4a1 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:09.491537 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 96/202] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Aug 18 21:41:09 2022] GET /identity/v3/projects/5cfc98a315f14e00a8cddaa2c57a9da6 => generated 302 bytes in 390 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:09.501666 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5716417-6e46-48ee-ba1d-4e759832c4a1 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:09.626394 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab5ac73-4515-4088-b90d-ca1f9154ac98 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:09.679277 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:09.685294 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2dda5f-37fa-4ba3-ad1a-f2c825af905b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:09.686033 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2dda5f-37fa-4ba3-ad1a-f2c825af905b None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:09.686405 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2dda5f-37fa-4ba3-ad1a-f2c825af905b None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:09.686770 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2dda5f-37fa-4ba3-ad1a-f2c825af905b None admin] PATH_INFO: `/v3/roles` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:09.688389 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2dda5f-37fa-4ba3-ad1a-f2c825af905b None admin] RBAC: Adding query filter params (name=reader) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:41:09.692693 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2dda5f-37fa-4ba3-ad1a-f2c825af905b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:09.698462 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2dda5f-37fa-4ba3-ad1a-f2c825af905b None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:09.711057 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 107/203] 10.222.0.27 () {56 vars in 1101 bytes} [Thu Aug 18 21:41:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:09.720275 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2dda5f-37fa-4ba3-ad1a-f2c825af905b None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:09.747970 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5716417-6e46-48ee-ba1d-4e759832c4a1 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:09.752539 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:09.795125 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf4d4b6-4a85-4307-8e8e-1a878e1e9381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:09.800827 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf4d4b6-4a85-4307-8e8e-1a878e1e9381 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:09.801144 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf4d4b6-4a85-4307-8e8e-1a878e1e9381 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:09.801427 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf4d4b6-4a85-4307-8e8e-1a878e1e9381 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:09.802194 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf4d4b6-4a85-4307-8e8e-1a878e1e9381 None admin] RBAC: Adding query filter params (role.id=66171a9efb5344c7a903946f238a3808, scope.project.id=5cfc98a315f14e00a8cddaa2c57a9da6, user.id=d7df53d358274e3f9b401339ac1e8124) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:41:09.802507 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf4d4b6-4a85-4307-8e8e-1a878e1e9381 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:09.803978 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf4d4b6-4a85-4307-8e8e-1a878e1e9381 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:09.818837 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 97/204] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Aug 18 21:41:09 2022] GET /identity/v3/role_assignments?user.id=d7df53d358274e3f9b401339ac1e8124&scope.project.id=5cfc98a315f14e00a8cddaa2c57a9da6&role.id=66171a9efb5344c7a903946f238a3808 => generated 259 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:09.870650 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2dda5f-37fa-4ba3-ad1a-f2c825af905b None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:09.912380 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04632638-6677-4d3b-9bcf-04872ebc73d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:09.913333 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04632638-6677-4d3b-9bcf-04872ebc73d0 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:09.913770 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04632638-6677-4d3b-9bcf-04872ebc73d0 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:09.914184 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04632638-6677-4d3b-9bcf-04872ebc73d0 None admin] PATH_INFO: `/v3/users/d0f5f98e8dd94128a35862081afb409a` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:09.915454 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04632638-6677-4d3b-9bcf-04872ebc73d0 None admin] RBAC: Authorizing `identity:get_user(user_id=d0f5f98e8dd94128a35862081afb409a)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:09.917063 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04632638-6677-4d3b-9bcf-04872ebc73d0 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:09.919110 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 108/205] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Aug 18 21:41:09 2022] GET /identity/v3/users/d0f5f98e8dd94128a35862081afb409a => generated 289 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:09.925213 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf4d4b6-4a85-4307-8e8e-1a878e1e9381 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:10.036038 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf4d4b6-4a85-4307-8e8e-1a878e1e9381 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:10.048644 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:10.073088 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c81a0d-a550-4d48-b317-f60069e0d6aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:10.073960 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c81a0d-a550-4d48-b317-f60069e0d6aa None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:10.074381 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c81a0d-a550-4d48-b317-f60069e0d6aa None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:10.074803 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c81a0d-a550-4d48-b317-f60069e0d6aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:10.148907 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c81a0d-a550-4d48-b317-f60069e0d6aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:10.151042 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c81a0d-a550-4d48-b317-f60069e0d6aa None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:10.297765 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 98/206] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Aug 18 21:41:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 21:41:10.303404 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04632638-6677-4d3b-9bcf-04872ebc73d0 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:10.414913 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:10.436476 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04632638-6677-4d3b-9bcf-04872ebc73d0 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:10.480147 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4485f237-f57d-459e-a5f7-1c83107c409b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:10.480810 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4485f237-f57d-459e-a5f7-1c83107c409b None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:10.481091 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4485f237-f57d-459e-a5f7-1c83107c409b None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:10.481415 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4485f237-f57d-459e-a5f7-1c83107c409b None admin] PATH_INFO: `/v3/projects/e475732a8fb6447b8d2ccca84af2071a` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:10.482643 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4485f237-f57d-459e-a5f7-1c83107c409b None admin] RBAC: Authorizing `identity:get_project(project_id=e475732a8fb6447b8d2ccca84af2071a)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:10.484765 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4485f237-f57d-459e-a5f7-1c83107c409b None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:10.486547 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 109/207] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Aug 18 21:41:10 2022] GET /identity/v3/projects/e475732a8fb6447b8d2ccca84af2071a => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:10.492363 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c81a0d-a550-4d48-b317-f60069e0d6aa None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:10.508143 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:10.615949 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c81a0d-a550-4d48-b317-f60069e0d6aa None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:10.655652 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2b8ff4-cca9-4c19-a0e3-941925d17df7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:10.656880 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2b8ff4-cca9-4c19-a0e3-941925d17df7 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:10.657162 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2b8ff4-cca9-4c19-a0e3-941925d17df7 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:10.657478 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2b8ff4-cca9-4c19-a0e3-941925d17df7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:10.658209 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2b8ff4-cca9-4c19-a0e3-941925d17df7 None admin] RBAC: Adding query filter params (role.id=a1ecfacad5ac443db590b35c86cd49e2, scope.project.id=e475732a8fb6447b8d2ccca84af2071a, user.id=d0f5f98e8dd94128a35862081afb409a) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:41:10.658515 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2b8ff4-cca9-4c19-a0e3-941925d17df7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:10.660019 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2b8ff4-cca9-4c19-a0e3-941925d17df7 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:10.666167 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 99/208] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Aug 18 21:41:10 2022] GET /identity/v3/role_assignments?user.id=d0f5f98e8dd94128a35862081afb409a&scope.project.id=e475732a8fb6447b8d2ccca84af2071a&role.id=a1ecfacad5ac443db590b35c86cd49e2 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:10.869280 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fdd787-14e2-413e-88ae-e2b8d8ca9c20 None None] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:10.869615 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fdd787-14e2-413e-88ae-e2b8d8ca9c20 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:10.869808 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fdd787-14e2-413e-88ae-e2b8d8ca9c20 None None] PATH_INFO: `/` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:10.871316 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 110/209] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:41:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:41:10.877641 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fc3199-7898-457b-aec6-dee27cc8b7a7 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:10.877932 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fc3199-7898-457b-aec6-dee27cc8b7a7 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:10.878213 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fc3199-7898-457b-aec6-dee27cc8b7a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:10.900404 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-a0fc3199-7898-457b-aec6-dee27cc8b7a7 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:41:10.901629 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-a0fc3199-7898-457b-aec6-dee27cc8b7a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:41:10.979015 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 100/210] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:41:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 21:41:11.271201 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fdd787-14e2-413e-88ae-e2b8d8ca9c20 None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:11.383739 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fdd787-14e2-413e-88ae-e2b8d8ca9c20 None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:11.419232 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec68bdd1-bc74-4731-9154-54fef3ab0f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:11.419869 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec68bdd1-bc74-4731-9154-54fef3ab0f4e None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:11.420145 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec68bdd1-bc74-4731-9154-54fef3ab0f4e None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:11.420416 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec68bdd1-bc74-4731-9154-54fef3ab0f4e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:11.432067 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec68bdd1-bc74-4731-9154-54fef3ab0f4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:41:11.437473 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application [None req-ec68bdd1-bc74-4731-9154-54fef3ab0f4e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 21:41:11.437473 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:41:11.437473 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:41:11.437473 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:41:11.437473 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:41:11.437473 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:41:11.437473 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:41:11.437473 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:41:11.437473 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:41:11.437473 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:41:11.437473 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:41:11.437473 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:41:11.437473 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:41:11.437473 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:41:11.437473 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:41:11.437473 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:41:11.439780 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:41:11.439780 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:41:11.439780 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:41:11.439780 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:41:11.439780 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:41:11.439780 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:41:11.439780 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:41:11.439780 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:41:11.439780 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:41:11.439780 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:41:11.439780 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:41:11.439780 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application with Lock( Aug 18 21:41:11.439780 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:41:11.439780 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:41:11.439780 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:41:11.439780 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:41:11.441692 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:41:11.441692 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:41:11.441692 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:41:11.441692 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:41:11.441692 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:41:11.441692 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:41:11.441692 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:41:11.441692 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:41:11.441692 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:41:11.441692 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:41:11.441692 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 21:41:11.441692 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:41:11.441692 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 111/211] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Aug 18 21:41:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:41:11.445833 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fc3199-7898-457b-aec6-dee27cc8b7a7 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:11.454171 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:11.506375 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409322d4-b827-4b2a-a356-7d31c642d84b None None] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:11.507026 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409322d4-b827-4b2a-a356-7d31c642d84b None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:11.507510 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409322d4-b827-4b2a-a356-7d31c642d84b None None] PATH_INFO: `/` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:11.509109 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 112/212] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:41:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:41:11.514160 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6b2bfd-bfe4-4840-87ba-c71132601365 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:11.514962 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6b2bfd-bfe4-4840-87ba-c71132601365 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:11.515612 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6b2bfd-bfe4-4840-87ba-c71132601365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:11.535984 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-bc6b2bfd-bfe4-4840-87ba-c71132601365 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:41:11.537559 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-bc6b2bfd-bfe4-4840-87ba-c71132601365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:41:11.541093 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:11.556285 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fc3199-7898-457b-aec6-dee27cc8b7a7 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:11.598461 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a3adb2-d443-46d1-96bd-230c7ba3a71f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:11.599079 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a3adb2-d443-46d1-96bd-230c7ba3a71f None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:11.599361 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a3adb2-d443-46d1-96bd-230c7ba3a71f None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:11.599635 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a3adb2-d443-46d1-96bd-230c7ba3a71f None admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:11.600305 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a3adb2-d443-46d1-96bd-230c7ba3a71f None admin] RBAC: Adding query filter params (name=admin) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:41:11.600622 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a3adb2-d443-46d1-96bd-230c7ba3a71f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:11.602020 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a3adb2-d443-46d1-96bd-230c7ba3a71f None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:11.610922 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 101/213] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Aug 18 21:41:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:11.611960 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33f5d38-dd0d-4c65-a1f0-7c4618e7e6af None None] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:11.612247 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33f5d38-dd0d-4c65-a1f0-7c4618e7e6af None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:11.612520 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33f5d38-dd0d-4c65-a1f0-7c4618e7e6af None None] PATH_INFO: `/` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:11.616627 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 102/214] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:41:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:41:11.616758 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 113/215] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:41:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 21:41:11.619131 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991a1e96-c940-481f-979c-f874972d8ab1 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:11.619419 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991a1e96-c940-481f-979c-f874972d8ab1 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:11.619691 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991a1e96-c940-481f-979c-f874972d8ab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:11.625330 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33f5d38-dd0d-4c65-a1f0-7c4618e7e6af None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:11.642332 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-991a1e96-c940-481f-979c-f874972d8ab1 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:41:11.643542 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-991a1e96-c940-481f-979c-f874972d8ab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:41:11.716570 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:11.726657 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 114/216] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:41:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 21:41:11.760304 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33f5d38-dd0d-4c65-a1f0-7c4618e7e6af None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:11.799399 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf10c163-5919-443e-85f9-5a62db8c84b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:11.799956 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf10c163-5919-443e-85f9-5a62db8c84b9 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:11.800236 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf10c163-5919-443e-85f9-5a62db8c84b9 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:11.800513 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf10c163-5919-443e-85f9-5a62db8c84b9 None admin] PATH_INFO: `/v3/users/d7df53d358274e3f9b401339ac1e8124` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:11.801676 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf10c163-5919-443e-85f9-5a62db8c84b9 None admin] RBAC: Authorizing `identity:get_user(user_id=d7df53d358274e3f9b401339ac1e8124)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:11.803125 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf10c163-5919-443e-85f9-5a62db8c84b9 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:11.808848 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 103/217] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Aug 18 21:41:11 2022] GET /identity/v3/users/d7df53d358274e3f9b401339ac1e8124 => generated 283 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:11.810873 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991a1e96-c940-481f-979c-f874972d8ab1 None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:11.884628 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:11.896234 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf10c163-5919-443e-85f9-5a62db8c84b9 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:11.927480 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991a1e96-c940-481f-979c-f874972d8ab1 None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:11.966784 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9685d392-5f94-4477-aa5a-2ca25f7cfa49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:11.967456 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9685d392-5f94-4477-aa5a-2ca25f7cfa49 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:11.967738 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9685d392-5f94-4477-aa5a-2ca25f7cfa49 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:11.968013 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9685d392-5f94-4477-aa5a-2ca25f7cfa49 None admin] PATH_INFO: `/v3/projects/5cfc98a315f14e00a8cddaa2c57a9da6` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:11.970834 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9685d392-5f94-4477-aa5a-2ca25f7cfa49 None admin] RBAC: Authorizing `identity:get_project(project_id=5cfc98a315f14e00a8cddaa2c57a9da6)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:11.972826 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9685d392-5f94-4477-aa5a-2ca25f7cfa49 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:11.980008 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 115/218] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Aug 18 21:41:11 2022] GET /identity/v3/projects/5cfc98a315f14e00a8cddaa2c57a9da6 => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:11.981549 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9685d392-5f94-4477-aa5a-2ca25f7cfa49 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:12.034501 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf10c163-5919-443e-85f9-5a62db8c84b9 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:12.068989 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3fe525-5281-42b7-92c1-3e1cb8885254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:12.069545 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3fe525-5281-42b7-92c1-3e1cb8885254 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:12.069820 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3fe525-5281-42b7-92c1-3e1cb8885254 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:12.070093 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3fe525-5281-42b7-92c1-3e1cb8885254 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:12.071959 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:12.081644 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3fe525-5281-42b7-92c1-3e1cb8885254 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:41:12.086942 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application [None req-0b3fe525-5281-42b7-92c1-3e1cb8885254 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 21:41:12.086942 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:41:12.086942 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:41:12.086942 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:41:12.086942 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:41:12.086942 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:41:12.086942 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:41:12.086942 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:41:12.086942 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:41:12.086942 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:41:12.086942 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:41:12.086942 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:41:12.086942 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:41:12.086942 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:41:12.086942 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:41:12.086942 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:41:12.087804 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:41:12.087804 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:41:12.087804 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:41:12.087804 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:41:12.087804 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:41:12.087804 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:41:12.087804 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:41:12.087804 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:41:12.087804 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:41:12.087804 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:41:12.087804 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:41:12.087804 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application with Lock( Aug 18 21:41:12.087804 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:41:12.087804 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:41:12.087804 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:41:12.087804 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:41:12.088620 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:41:12.088620 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:41:12.088620 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:41:12.088620 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:41:12.088620 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:41:12.088620 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:41:12.088620 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:41:12.088620 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:41:12.088620 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:41:12.088620 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:41:12.088620 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 21:41:12.088620 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:41:12.088620 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 104/219] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Aug 18 21:41:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 21:41:12.089378 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d51c75-d394-46de-b40e-906c8ee9799c None None] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:12.089877 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d51c75-d394-46de-b40e-906c8ee9799c None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:12.089877 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d51c75-d394-46de-b40e-906c8ee9799c None None] PATH_INFO: `/` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:12.092758 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 105/220] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:41:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:41:12.092758 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d51c75-d394-46de-b40e-906c8ee9799c None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:12.102740 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9685d392-5f94-4477-aa5a-2ca25f7cfa49 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:12.137135 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23272f92-bc12-4227-ba79-78f386ae818b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:12.137793 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23272f92-bc12-4227-ba79-78f386ae818b None admin] REQUEST_METHOD: `PUT` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:12.138074 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23272f92-bc12-4227-ba79-78f386ae818b None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:12.138345 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23272f92-bc12-4227-ba79-78f386ae818b None admin] PATH_INFO: `/v3/projects/5cfc98a315f14e00a8cddaa2c57a9da6/users/d7df53d358274e3f9b401339ac1e8124/roles/0833202e2a3d47d1b6b3af57006641b1` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:12.141162 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23272f92-bc12-4227-ba79-78f386ae818b None admin] RBAC: Authorizing `identity:create_grant(project_id=5cfc98a315f14e00a8cddaa2c57a9da6, user_id=d7df53d358274e3f9b401339ac1e8124, role_id=0833202e2a3d47d1b6b3af57006641b1)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:12.142588 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23272f92-bc12-4227-ba79-78f386ae818b None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:12.193507 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d51c75-d394-46de-b40e-906c8ee9799c None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:12.226192 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25ec1a7-89f1-41e5-bb9a-45f10164d677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:12.226803 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25ec1a7-89f1-41e5-bb9a-45f10164d677 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:12.227084 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25ec1a7-89f1-41e5-bb9a-45f10164d677 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:12.227356 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25ec1a7-89f1-41e5-bb9a-45f10164d677 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:12.228439 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25ec1a7-89f1-41e5-bb9a-45f10164d677 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:12.229893 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25ec1a7-89f1-41e5-bb9a-45f10164d677 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:12.231444 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 106/221] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 18 21:41:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:12.232191 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25ec1a7-89f1-41e5-bb9a-45f10164d677 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:12.249534 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:12.254727 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 116/222] 10.222.0.27 () {58 vars in 1439 bytes} [Thu Aug 18 21:41:11 2022] PUT /identity/v3/projects/5cfc98a315f14e00a8cddaa2c57a9da6/users/d7df53d358274e3f9b401339ac1e8124/roles/0833202e2a3d47d1b6b3af57006641b1 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 21:41:12.255743 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772a19ac-814e-487f-a5a7-f26487bd53b1 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:12.256028 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772a19ac-814e-487f-a5a7-f26487bd53b1 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:12.256295 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772a19ac-814e-487f-a5a7-f26487bd53b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:12.275484 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-772a19ac-814e-487f-a5a7-f26487bd53b1 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:41:12.276765 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-772a19ac-814e-487f-a5a7-f26487bd53b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:41:12.311931 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:12.356708 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 117/223] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:41:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 21:41:12.357895 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772a19ac-814e-487f-a5a7-f26487bd53b1 None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:12.368487 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25ec1a7-89f1-41e5-bb9a-45f10164d677 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:12.420783 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc2a234-a812-4cf1-8364-589f1526237e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:12.421401 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc2a234-a812-4cf1-8364-589f1526237e None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:12.422392 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc2a234-a812-4cf1-8364-589f1526237e None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:12.422673 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc2a234-a812-4cf1-8364-589f1526237e None admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:12.423628 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc2a234-a812-4cf1-8364-589f1526237e None admin] RBAC: Adding query filter params (name=member) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:41:12.423934 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc2a234-a812-4cf1-8364-589f1526237e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:12.425619 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc2a234-a812-4cf1-8364-589f1526237e None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:12.435652 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 107/224] 10.222.0.27 () {56 vars in 1101 bytes} [Thu Aug 18 21:41:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:12.443107 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc2a234-a812-4cf1-8364-589f1526237e None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:12.483528 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772a19ac-814e-487f-a5a7-f26487bd53b1 None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:12.519505 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:12.533083 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c0d878-994a-480e-aa52-d3787d7f9fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:12.533746 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c0d878-994a-480e-aa52-d3787d7f9fb4 None admin] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:12.534021 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c0d878-994a-480e-aa52-d3787d7f9fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:12.534286 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c0d878-994a-480e-aa52-d3787d7f9fb4 None admin] PATH_INFO: `/v3/users` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:12.535598 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c0d878-994a-480e-aa52-d3787d7f9fb4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:12.537132 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c0d878-994a-480e-aa52-d3787d7f9fb4 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:12.577144 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc2a234-a812-4cf1-8364-589f1526237e None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:12.602134 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:12.614081 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da65ecb8-e977-437d-814f-50e5ae5f8ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:12.617709 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da65ecb8-e977-437d-814f-50e5ae5f8ead None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:12.617709 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da65ecb8-e977-437d-814f-50e5ae5f8ead None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:12.617709 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da65ecb8-e977-437d-814f-50e5ae5f8ead None admin] PATH_INFO: `/v3/users/440d1678328b4e03bc92aaf77299e57a` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:12.629935 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da65ecb8-e977-437d-814f-50e5ae5f8ead None admin] RBAC: Authorizing `identity:get_user(user_id=440d1678328b4e03bc92aaf77299e57a)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:12.631494 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da65ecb8-e977-437d-814f-50e5ae5f8ead None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:12.637858 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 108/225] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Aug 18 21:41:12 2022] GET /identity/v3/users/440d1678328b4e03bc92aaf77299e57a => generated 297 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:12.639931 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da65ecb8-e977-437d-814f-50e5ae5f8ead None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:12.649761 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 118/226] 10.222.0.27 () {60 vars in 1132 bytes} [Thu Aug 18 21:41:12 2022] POST /identity/v3/users => generated 297 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:41:12.650483 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c0d878-994a-480e-aa52-d3787d7f9fb4 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:12.788294 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c0d878-994a-480e-aa52-d3787d7f9fb4 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:12.799581 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da65ecb8-e977-437d-814f-50e5ae5f8ead None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:12.829701 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6845ef34-0a69-477b-88bd-73c2d500f23b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:12.831176 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6845ef34-0a69-477b-88bd-73c2d500f23b None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:12.831635 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6845ef34-0a69-477b-88bd-73c2d500f23b None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:12.831914 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6845ef34-0a69-477b-88bd-73c2d500f23b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:12.839739 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595764ac-9f44-4e6b-b20f-c41b0543199f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:12.840353 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595764ac-9f44-4e6b-b20f-c41b0543199f None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:12.841717 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595764ac-9f44-4e6b-b20f-c41b0543199f None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:12.841717 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595764ac-9f44-4e6b-b20f-c41b0543199f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:12.846919 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6845ef34-0a69-477b-88bd-73c2d500f23b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:41:12.851574 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application [None req-6845ef34-0a69-477b-88bd-73c2d500f23b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 21:41:12.851574 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:41:12.851574 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:41:12.851574 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:41:12.851574 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:41:12.851574 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:41:12.851574 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:41:12.851574 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:41:12.851574 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:41:12.851574 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:41:12.851574 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:41:12.851574 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:41:12.851574 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:41:12.851574 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:41:12.851574 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:41:12.851574 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:41:12.852420 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:41:12.852420 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:41:12.852420 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:41:12.852420 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:41:12.852420 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:41:12.852420 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:41:12.852420 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:41:12.852420 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:41:12.852420 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:41:12.852420 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:41:12.852420 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:41:12.852420 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application with Lock( Aug 18 21:41:12.852420 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:41:12.852420 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:41:12.852420 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:41:12.852420 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:41:12.853239 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:41:12.853239 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:41:12.853239 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:41:12.853239 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:41:12.853239 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:41:12.853239 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:41:12.853239 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:41:12.853239 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:41:12.853239 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:41:12.853239 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:41:12.853239 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 21:41:12.853239 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:41:12.853833 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 119/227] 10.222.0.27 () {56 vars in 1114 bytes} [Thu Aug 18 21:41:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:41:12.860355 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6845ef34-0a69-477b-88bd-73c2d500f23b None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:12.923046 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:12.923877 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:12.948961 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595764ac-9f44-4e6b-b20f-c41b0543199f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:12.950531 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595764ac-9f44-4e6b-b20f-c41b0543199f None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:12.996338 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6845ef34-0a69-477b-88bd-73c2d500f23b None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:13.044579 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823509ca-cc7d-443d-a03d-dff56d06b736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:13.045385 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823509ca-cc7d-443d-a03d-dff56d06b736 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:13.046510 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823509ca-cc7d-443d-a03d-dff56d06b736 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:13.047466 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823509ca-cc7d-443d-a03d-dff56d06b736 None admin] PATH_INFO: `/v3/roles` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:13.048155 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823509ca-cc7d-443d-a03d-dff56d06b736 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:41:13.048457 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823509ca-cc7d-443d-a03d-dff56d06b736 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:13.049875 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823509ca-cc7d-443d-a03d-dff56d06b736 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:13.061067 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 120/228] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Aug 18 21:41:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 21:41:13.066643 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823509ca-cc7d-443d-a03d-dff56d06b736 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:13.089490 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 109/229] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Aug 18 21:41:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 21:41:13.097625 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595764ac-9f44-4e6b-b20f-c41b0543199f None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:13.183338 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823509ca-cc7d-443d-a03d-dff56d06b736 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:13.191351 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:13.245371 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5819605-5c70-498f-85f2-6b5dc94e9a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:13.246032 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5819605-5c70-498f-85f2-6b5dc94e9a63 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:13.246308 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5819605-5c70-498f-85f2-6b5dc94e9a63 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:13.246580 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5819605-5c70-498f-85f2-6b5dc94e9a63 None admin] PATH_INFO: `/v3/users/d7df53d358274e3f9b401339ac1e8124` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:13.247772 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5819605-5c70-498f-85f2-6b5dc94e9a63 None admin] RBAC: Authorizing `identity:get_user(user_id=d7df53d358274e3f9b401339ac1e8124)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:13.249237 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5819605-5c70-498f-85f2-6b5dc94e9a63 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:13.250674 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:13.251528 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 121/230] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Aug 18 21:41:13 2022] GET /identity/v3/users/d7df53d358274e3f9b401339ac1e8124 => generated 283 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 21:41:13.256954 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5819605-5c70-498f-85f2-6b5dc94e9a63 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:13.272376 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595764ac-9f44-4e6b-b20f-c41b0543199f None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:13.311678 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5768d233-2d9f-4df0-b774-43c8a9525daa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:13.312735 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5768d233-2d9f-4df0-b774-43c8a9525daa None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:13.313024 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5768d233-2d9f-4df0-b774-43c8a9525daa None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:13.313395 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5768d233-2d9f-4df0-b774-43c8a9525daa None admin] PATH_INFO: `/v3/projects/5cfc98a315f14e00a8cddaa2c57a9da6` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:13.314756 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5768d233-2d9f-4df0-b774-43c8a9525daa None admin] RBAC: Authorizing `identity:get_project(project_id=5cfc98a315f14e00a8cddaa2c57a9da6)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:13.316233 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5768d233-2d9f-4df0-b774-43c8a9525daa None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:13.318109 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 110/231] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Aug 18 21:41:13 2022] GET /identity/v3/projects/5cfc98a315f14e00a8cddaa2c57a9da6 => generated 302 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 21:41:13.324718 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5768d233-2d9f-4df0-b774-43c8a9525daa None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:13.445376 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5768d233-2d9f-4df0-b774-43c8a9525daa None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:13.471009 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5819605-5c70-498f-85f2-6b5dc94e9a63 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:13.482956 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8333098-2aa2-46a5-80bd-6ffbecb20663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:13.483826 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8333098-2aa2-46a5-80bd-6ffbecb20663 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:13.485098 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8333098-2aa2-46a5-80bd-6ffbecb20663 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:13.485596 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8333098-2aa2-46a5-80bd-6ffbecb20663 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:13.486510 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8333098-2aa2-46a5-80bd-6ffbecb20663 None admin] RBAC: Adding query filter params (role.id=de8f2438056f4af9879423f8a59e0e0b, scope.project.id=5cfc98a315f14e00a8cddaa2c57a9da6, user.id=440d1678328b4e03bc92aaf77299e57a) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:41:13.487110 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8333098-2aa2-46a5-80bd-6ffbecb20663 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:13.488773 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8333098-2aa2-46a5-80bd-6ffbecb20663 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:13.495292 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 111/232] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Aug 18 21:41:13 2022] GET /identity/v3/role_assignments?user.id=440d1678328b4e03bc92aaf77299e57a&scope.project.id=5cfc98a315f14e00a8cddaa2c57a9da6&role.id=de8f2438056f4af9879423f8a59e0e0b => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:13.522053 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8349389b-41e9-4823-a141-acb30976d448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:13.522716 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8349389b-41e9-4823-a141-acb30976d448 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:13.522998 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8349389b-41e9-4823-a141-acb30976d448 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:13.523272 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8349389b-41e9-4823-a141-acb30976d448 None admin] PATH_INFO: `/v3/projects/5cfc98a315f14e00a8cddaa2c57a9da6` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:13.524515 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8349389b-41e9-4823-a141-acb30976d448 None admin] RBAC: Authorizing `identity:get_project(project_id=5cfc98a315f14e00a8cddaa2c57a9da6)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:13.526039 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8349389b-41e9-4823-a141-acb30976d448 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:13.527802 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 122/233] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Aug 18 21:41:13 2022] GET /identity/v3/projects/5cfc98a315f14e00a8cddaa2c57a9da6 => generated 302 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:13.534225 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8333098-2aa2-46a5-80bd-6ffbecb20663 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:13.561060 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:13.683062 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8333098-2aa2-46a5-80bd-6ffbecb20663 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:13.723314 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7b3247-67e6-4436-9df5-c0815039e68a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:13.723903 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7b3247-67e6-4436-9df5-c0815039e68a None admin] REQUEST_METHOD: `PUT` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:13.724187 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7b3247-67e6-4436-9df5-c0815039e68a None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:13.724465 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7b3247-67e6-4436-9df5-c0815039e68a None admin] PATH_INFO: `/v3/projects/5cfc98a315f14e00a8cddaa2c57a9da6/users/d7df53d358274e3f9b401339ac1e8124/roles/66171a9efb5344c7a903946f238a3808` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:13.726701 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7b3247-67e6-4436-9df5-c0815039e68a None admin] RBAC: Authorizing `identity:create_grant(project_id=5cfc98a315f14e00a8cddaa2c57a9da6, user_id=d7df53d358274e3f9b401339ac1e8124, role_id=66171a9efb5344c7a903946f238a3808)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:13.728150 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7b3247-67e6-4436-9df5-c0815039e68a None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:13.804517 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 112/234] 10.222.0.27 () {58 vars in 1439 bytes} [Thu Aug 18 21:41:13 2022] PUT /identity/v3/projects/5cfc98a315f14e00a8cddaa2c57a9da6/users/d7df53d358274e3f9b401339ac1e8124/roles/66171a9efb5344c7a903946f238a3808 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:41:14.370218 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131b3dcf-ec27-4ae9-9cc6-40afc1e5335b None None] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:14.370724 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131b3dcf-ec27-4ae9-9cc6-40afc1e5335b None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:14.370827 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131b3dcf-ec27-4ae9-9cc6-40afc1e5335b None None] PATH_INFO: `/` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:14.372103 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 123/235] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:41:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:41:14.377934 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbfa599-2c3d-423e-8467-c6468e37b35e None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:14.378227 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbfa599-2c3d-423e-8467-c6468e37b35e None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:14.378505 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbfa599-2c3d-423e-8467-c6468e37b35e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:14.405544 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-ddbfa599-2c3d-423e-8467-c6468e37b35e None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:41:14.407575 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-ddbfa599-2c3d-423e-8467-c6468e37b35e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:41:14.501928 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 113/236] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:41:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 21:41:14.845920 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131b3dcf-ec27-4ae9-9cc6-40afc1e5335b None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:14.908012 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:14.981506 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131b3dcf-ec27-4ae9-9cc6-40afc1e5335b None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:15.017478 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6db35b-9705-4dde-b1e7-5a30fc4cb253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:15.018099 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6db35b-9705-4dde-b1e7-5a30fc4cb253 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:15.018386 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6db35b-9705-4dde-b1e7-5a30fc4cb253 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:15.018659 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6db35b-9705-4dde-b1e7-5a30fc4cb253 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:15.029193 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6db35b-9705-4dde-b1e7-5a30fc4cb253 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:41:15.035350 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application [None req-0b6db35b-9705-4dde-b1e7-5a30fc4cb253 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 21:41:15.035350 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:41:15.035350 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:41:15.035350 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:41:15.035350 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:41:15.035350 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:41:15.035350 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:41:15.035350 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:41:15.035350 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:41:15.035350 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:41:15.035350 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:41:15.035350 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:41:15.035350 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:41:15.035350 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:41:15.035350 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:41:15.035350 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:41:15.036264 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:41:15.036264 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:41:15.036264 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:41:15.036264 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:41:15.036264 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:41:15.036264 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:41:15.036264 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:41:15.036264 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:41:15.036264 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:41:15.036264 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:41:15.036264 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:41:15.036264 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application with Lock( Aug 18 21:41:15.036264 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:41:15.036264 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:41:15.036264 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:41:15.036264 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:41:15.037078 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:41:15.037078 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:41:15.037078 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:41:15.037078 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:41:15.037078 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:41:15.037078 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:41:15.037078 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:41:15.037078 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:41:15.037078 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:41:15.037078 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:41:15.037078 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 21:41:15.037078 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:41:15.037078 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 124/237] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Aug 18 21:41:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:41:15.042378 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbfa599-2c3d-423e-8467-c6468e37b35e None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:15.045486 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:15.154259 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbfa599-2c3d-423e-8467-c6468e37b35e None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:15.163359 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e7ae18-489c-41bf-a669-e54ef3c5276b None None] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:15.163927 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e7ae18-489c-41bf-a669-e54ef3c5276b None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:15.164395 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e7ae18-489c-41bf-a669-e54ef3c5276b None None] PATH_INFO: `/` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:15.166210 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 125/238] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:41:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 21:41:15.171311 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6fbb4a-90a7-4e1c-837b-1b015b635c8e None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:15.172313 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6fbb4a-90a7-4e1c-837b-1b015b635c8e None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:15.172759 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6fbb4a-90a7-4e1c-837b-1b015b635c8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:15.193026 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-3c6fbb4a-90a7-4e1c-837b-1b015b635c8e None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:41:15.194585 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-3c6fbb4a-90a7-4e1c-837b-1b015b635c8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:41:15.196082 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f001ac-86f2-497e-bdf5-e639dd568a46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:15.197155 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f001ac-86f2-497e-bdf5-e639dd568a46 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:15.197587 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f001ac-86f2-497e-bdf5-e639dd568a46 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:15.198885 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f001ac-86f2-497e-bdf5-e639dd568a46 None admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:15.199715 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f001ac-86f2-497e-bdf5-e639dd568a46 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:41:15.200187 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f001ac-86f2-497e-bdf5-e639dd568a46 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:15.201747 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f001ac-86f2-497e-bdf5-e639dd568a46 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:15.215252 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 114/239] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Aug 18 21:41:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:15.224728 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f001ac-86f2-497e-bdf5-e639dd568a46 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:15.317336 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:15.344633 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 126/240] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:41:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 21:41:15.367543 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f001ac-86f2-497e-bdf5-e639dd568a46 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:15.425973 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baf14ad-7502-4fe8-9c4b-93c8aeb5621c None None] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:15.426453 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baf14ad-7502-4fe8-9c4b-93c8aeb5621c None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:15.426453 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baf14ad-7502-4fe8-9c4b-93c8aeb5621c None None] PATH_INFO: `/` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:15.427904 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 127/241] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:41:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:41:15.430268 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fcd3f8-989b-4d6c-97b0-feee088399e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:15.430916 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fcd3f8-989b-4d6c-97b0-feee088399e1 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:15.431191 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fcd3f8-989b-4d6c-97b0-feee088399e1 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:15.431562 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fcd3f8-989b-4d6c-97b0-feee088399e1 None admin] PATH_INFO: `/v3/users/d7df53d358274e3f9b401339ac1e8124` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:15.432745 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2501164f-cc59-4670-8efa-d23f73de0594 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:15.433096 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2501164f-cc59-4670-8efa-d23f73de0594 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:15.433438 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2501164f-cc59-4670-8efa-d23f73de0594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:15.437879 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fcd3f8-989b-4d6c-97b0-feee088399e1 None admin] RBAC: Authorizing `identity:get_user(user_id=d7df53d358274e3f9b401339ac1e8124)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:15.439328 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fcd3f8-989b-4d6c-97b0-feee088399e1 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:15.440949 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 115/242] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Aug 18 21:41:15 2022] GET /identity/v3/users/d7df53d358274e3f9b401339ac1e8124 => generated 283 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:15.447183 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fcd3f8-989b-4d6c-97b0-feee088399e1 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:15.457549 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-2501164f-cc59-4670-8efa-d23f73de0594 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:41:15.461289 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-2501164f-cc59-4670-8efa-d23f73de0594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:41:15.507326 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:15.587048 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 128/243] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:41:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 21:41:15.629040 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fcd3f8-989b-4d6c-97b0-feee088399e1 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:15.677755 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2501164f-cc59-4670-8efa-d23f73de0594 None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:15.682141 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b43829-e310-474d-970d-f5dd5000bfe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:15.682765 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b43829-e310-474d-970d-f5dd5000bfe9 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:15.683049 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b43829-e310-474d-970d-f5dd5000bfe9 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:15.683427 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b43829-e310-474d-970d-f5dd5000bfe9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:15.686308 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:15.766149 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b43829-e310-474d-970d-f5dd5000bfe9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:15.768033 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b43829-e310-474d-970d-f5dd5000bfe9 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:15.891632 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 116/244] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Aug 18 21:41:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 18 21:41:15.901586 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b43829-e310-474d-970d-f5dd5000bfe9 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:15.956385 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:15.958605 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2501164f-cc59-4670-8efa-d23f73de0594 None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:15.994258 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfa81ca-f11f-4b47-91f3-113377676097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:15.994885 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfa81ca-f11f-4b47-91f3-113377676097 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:15.995166 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfa81ca-f11f-4b47-91f3-113377676097 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:15.995439 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfa81ca-f11f-4b47-91f3-113377676097 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:16.006403 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfa81ca-f11f-4b47-91f3-113377676097 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:41:16.011145 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application [None req-fdfa81ca-f11f-4b47-91f3-113377676097 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 21:41:16.011145 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:41:16.011145 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:41:16.011145 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:41:16.011145 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:41:16.011145 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:41:16.011145 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:41:16.011145 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:41:16.011145 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:41:16.011145 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:41:16.011145 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:41:16.011145 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:41:16.011145 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:41:16.011145 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:41:16.011145 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:41:16.011145 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:41:16.012025 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:41:16.012025 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:41:16.012025 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:41:16.012025 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:41:16.012025 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:41:16.012025 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:41:16.012025 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:41:16.012025 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:41:16.012025 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:41:16.012025 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:41:16.012025 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:41:16.012025 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application with Lock( Aug 18 21:41:16.012025 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:41:16.012025 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:41:16.012025 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:41:16.012025 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:41:16.012843 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:41:16.012843 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:41:16.012843 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:41:16.012843 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:41:16.012843 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:41:16.012843 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:41:16.012843 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:41:16.012843 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:41:16.012843 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:41:16.012843 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:41:16.012843 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 21:41:16.012843 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:41:16.012843 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 129/245] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Aug 18 21:41:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:41:16.013927 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfa81ca-f11f-4b47-91f3-113377676097 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:16.038633 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b43829-e310-474d-970d-f5dd5000bfe9 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:16.051390 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:16.074517 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbe64ab-e0a6-4be9-9ab5-9fd014104cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:16.075155 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbe64ab-e0a6-4be9-9ab5-9fd014104cf5 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:16.075440 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbe64ab-e0a6-4be9-9ab5-9fd014104cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:16.075711 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbe64ab-e0a6-4be9-9ab5-9fd014104cf5 None admin] PATH_INFO: `/v3/projects/5cfc98a315f14e00a8cddaa2c57a9da6` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:16.076923 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbe64ab-e0a6-4be9-9ab5-9fd014104cf5 None admin] RBAC: Authorizing `identity:get_project(project_id=5cfc98a315f14e00a8cddaa2c57a9da6)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:16.078669 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbe64ab-e0a6-4be9-9ab5-9fd014104cf5 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:16.085121 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 117/246] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Aug 18 21:41:15 2022] GET /identity/v3/projects/5cfc98a315f14e00a8cddaa2c57a9da6 => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:16.085121 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a792652-ef4b-4178-af69-183804b1dd14 None None] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:16.085121 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a792652-ef4b-4178-af69-183804b1dd14 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:16.085121 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a792652-ef4b-4178-af69-183804b1dd14 None None] PATH_INFO: `/` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:16.088566 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 118/247] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:41:16 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:41:16.089385 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a792652-ef4b-4178-af69-183804b1dd14 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:16.137486 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfa81ca-f11f-4b47-91f3-113377676097 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:16.179006 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9a6a79-f4c3-4796-8442-ab4048eac6c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:16.179874 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9a6a79-f4c3-4796-8442-ab4048eac6c2 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:16.180328 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9a6a79-f4c3-4796-8442-ab4048eac6c2 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:16.180778 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9a6a79-f4c3-4796-8442-ab4048eac6c2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:16.182095 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9a6a79-f4c3-4796-8442-ab4048eac6c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:16.183739 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9a6a79-f4c3-4796-8442-ab4048eac6c2 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:16.185596 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 130/248] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 18 21:41:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:16.191072 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9a6a79-f4c3-4796-8442-ab4048eac6c2 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:16.199015 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a792652-ef4b-4178-af69-183804b1dd14 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:16.200538 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:16.237194 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9996099c-4ed8-4de5-9328-8f3fb6c7756f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:16.237714 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9996099c-4ed8-4de5-9328-8f3fb6c7756f None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:16.237992 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9996099c-4ed8-4de5-9328-8f3fb6c7756f None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:16.238262 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9996099c-4ed8-4de5-9328-8f3fb6c7756f None admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:16.238930 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9996099c-4ed8-4de5-9328-8f3fb6c7756f None admin] RBAC: Adding query filter params (name=reader) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:41:16.239232 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9996099c-4ed8-4de5-9328-8f3fb6c7756f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:16.240625 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9996099c-4ed8-4de5-9328-8f3fb6c7756f None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:16.249047 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 119/249] 10.222.0.27 () {56 vars in 1101 bytes} [Thu Aug 18 21:41:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:16.250800 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70b647b-aa27-4545-b8aa-6026b9884dd1 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:16.251075 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70b647b-aa27-4545-b8aa-6026b9884dd1 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:16.251347 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70b647b-aa27-4545-b8aa-6026b9884dd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:16.274106 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-d70b647b-aa27-4545-b8aa-6026b9884dd1 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:41:16.276460 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-d70b647b-aa27-4545-b8aa-6026b9884dd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:41:16.296997 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:16.306922 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9a6a79-f4c3-4796-8442-ab4048eac6c2 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:16.342958 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04813b1-f836-4008-8d15-8bb4244a7905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:16.344214 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04813b1-f836-4008-8d15-8bb4244a7905 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:16.344563 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04813b1-f836-4008-8d15-8bb4244a7905 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:16.344871 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04813b1-f836-4008-8d15-8bb4244a7905 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:16.345604 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04813b1-f836-4008-8d15-8bb4244a7905 None admin] RBAC: Adding query filter params (role.id=0833202e2a3d47d1b6b3af57006641b1, scope.project.id=5cfc98a315f14e00a8cddaa2c57a9da6, user.id=d7df53d358274e3f9b401339ac1e8124) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:41:16.345912 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04813b1-f836-4008-8d15-8bb4244a7905 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:16.347360 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04813b1-f836-4008-8d15-8bb4244a7905 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:16.353340 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 131/250] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Aug 18 21:41:16 2022] GET /identity/v3/role_assignments?user.id=d7df53d358274e3f9b401339ac1e8124&scope.project.id=5cfc98a315f14e00a8cddaa2c57a9da6&role.id=0833202e2a3d47d1b6b3af57006641b1 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:16.355793 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 120/251] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:41:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 21:41:16.361739 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04813b1-f836-4008-8d15-8bb4244a7905 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:16.365113 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70b647b-aa27-4545-b8aa-6026b9884dd1 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:16.518677 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04813b1-f836-4008-8d15-8bb4244a7905 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:16.528326 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:16.538243 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70b647b-aa27-4545-b8aa-6026b9884dd1 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:16.572732 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbba959-d78f-4088-aa5f-de074fc38017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:16.573739 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbba959-d78f-4088-aa5f-de074fc38017 None admin] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:16.574219 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbba959-d78f-4088-aa5f-de074fc38017 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:16.574686 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbba959-d78f-4088-aa5f-de074fc38017 None admin] PATH_INFO: `/v3/users` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:16.575529 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbba959-d78f-4088-aa5f-de074fc38017 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:16.577209 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbba959-d78f-4088-aa5f-de074fc38017 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:16.588824 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8daa479-6e0a-4296-ae1d-a6dad850f6a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:16.589462 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8daa479-6e0a-4296-ae1d-a6dad850f6a7 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:16.589741 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8daa479-6e0a-4296-ae1d-a6dad850f6a7 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:16.590015 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8daa479-6e0a-4296-ae1d-a6dad850f6a7 None admin] PATH_INFO: `/v3/users/248e9f37b096409dba1f78636add31a4` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:16.605746 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8daa479-6e0a-4296-ae1d-a6dad850f6a7 None admin] RBAC: Authorizing `identity:get_user(user_id=248e9f37b096409dba1f78636add31a4)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:16.607476 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8daa479-6e0a-4296-ae1d-a6dad850f6a7 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:16.609910 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 121/252] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Aug 18 21:41:16 2022] GET /identity/v3/users/248e9f37b096409dba1f78636add31a4 => generated 297 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:16.610899 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23afee69-566e-4611-ac84-190019df95eb None None] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:16.611182 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23afee69-566e-4611-ac84-190019df95eb None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:16.611453 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23afee69-566e-4611-ac84-190019df95eb None None] PATH_INFO: `/` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:16.615278 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 122/253] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:41:16 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:41:16.619496 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23afee69-566e-4611-ac84-190019df95eb None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:16.694721 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 132/254] 10.222.0.27 () {60 vars in 1132 bytes} [Thu Aug 18 21:41:16 2022] POST /identity/v3/users => generated 293 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:41:16.696040 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24722af9-8ad0-4824-9db6-bed1a052f86b None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:16.696332 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24722af9-8ad0-4824-9db6-bed1a052f86b None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:16.696625 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24722af9-8ad0-4824-9db6-bed1a052f86b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:16.721501 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-24722af9-8ad0-4824-9db6-bed1a052f86b None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:41:16.722756 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-24722af9-8ad0-4824-9db6-bed1a052f86b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:41:16.726102 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:16.727397 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23afee69-566e-4611-ac84-190019df95eb None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:16.772904 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa161d7-1ba0-4657-938e-30e347cbb2a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:16.773426 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa161d7-1ba0-4657-938e-30e347cbb2a8 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:16.773957 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa161d7-1ba0-4657-938e-30e347cbb2a8 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:16.773957 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa161d7-1ba0-4657-938e-30e347cbb2a8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:16.799184 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:16.800217 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 133/255] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:41:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 21:41:16.801268 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24722af9-8ad0-4824-9db6-bed1a052f86b None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:16.873677 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa161d7-1ba0-4657-938e-30e347cbb2a8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:16.877533 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa161d7-1ba0-4657-938e-30e347cbb2a8 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:16.948245 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24722af9-8ad0-4824-9db6-bed1a052f86b None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:16.994966 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e890fac-24f5-42b4-b002-a837cec57d89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:16.996284 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e890fac-24f5-42b4-b002-a837cec57d89 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:16.997031 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e890fac-24f5-42b4-b002-a837cec57d89 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:16.997464 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e890fac-24f5-42b4-b002-a837cec57d89 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:17.007516 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:17.011392 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e890fac-24f5-42b4-b002-a837cec57d89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:41:17.012005 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 123/256] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Aug 18 21:41:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 21:41:17.018540 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa161d7-1ba0-4657-938e-30e347cbb2a8 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:17.020573 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application [None req-3e890fac-24f5-42b4-b002-a837cec57d89 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 21:41:17.020573 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:41:17.020573 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:41:17.020573 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:41:17.020573 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:41:17.020573 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:41:17.020573 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:41:17.020573 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:41:17.020573 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:41:17.020573 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:41:17.020573 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:41:17.020573 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:41:17.020573 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:41:17.020573 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:41:17.020573 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:41:17.020573 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:41:17.022588 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:41:17.022588 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:41:17.022588 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:41:17.022588 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:41:17.022588 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:41:17.022588 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:41:17.022588 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:41:17.022588 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:41:17.022588 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:41:17.022588 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:41:17.022588 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:41:17.022588 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application with Lock( Aug 18 21:41:17.022588 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:41:17.022588 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:41:17.022588 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:41:17.022588 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:41:17.023514 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:41:17.023514 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:41:17.023514 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:41:17.023514 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:41:17.023514 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:41:17.023514 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:41:17.023514 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:41:17.023514 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:41:17.023514 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:41:17.023514 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:41:17.023514 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 21:41:17.023514 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:41:17.023514 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 134/257] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Aug 18 21:41:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:41:17.029698 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e890fac-24f5-42b4-b002-a837cec57d89 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:17.083369 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:17.145056 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa161d7-1ba0-4657-938e-30e347cbb2a8 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:17.173949 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e890fac-24f5-42b4-b002-a837cec57d89 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:17.189828 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50324375-7e12-4cec-bd88-450e6e62e045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:17.190625 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50324375-7e12-4cec-bd88-450e6e62e045 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:17.190912 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50324375-7e12-4cec-bd88-450e6e62e045 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:17.191324 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50324375-7e12-4cec-bd88-450e6e62e045 None admin] PATH_INFO: `/v3/projects/5cfc98a315f14e00a8cddaa2c57a9da6` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:17.192661 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50324375-7e12-4cec-bd88-450e6e62e045 None admin] RBAC: Authorizing `identity:get_project(project_id=5cfc98a315f14e00a8cddaa2c57a9da6)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:17.194122 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50324375-7e12-4cec-bd88-450e6e62e045 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:17.196092 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 124/258] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Aug 18 21:41:17 2022] GET /identity/v3/projects/5cfc98a315f14e00a8cddaa2c57a9da6 => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:17.197004 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50324375-7e12-4cec-bd88-450e6e62e045 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:17.215562 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ddebd8-6e8e-4e18-9c34-5af0ce1e3754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:17.216179 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ddebd8-6e8e-4e18-9c34-5af0ce1e3754 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:17.216459 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ddebd8-6e8e-4e18-9c34-5af0ce1e3754 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:17.216763 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ddebd8-6e8e-4e18-9c34-5af0ce1e3754 None admin] PATH_INFO: `/v3/roles` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:17.217545 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ddebd8-6e8e-4e18-9c34-5af0ce1e3754 None admin] RBAC: Adding query filter params (name=member) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:41:17.217954 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ddebd8-6e8e-4e18-9c34-5af0ce1e3754 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:17.220318 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ddebd8-6e8e-4e18-9c34-5af0ce1e3754 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:17.229542 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 135/259] 10.222.0.27 () {56 vars in 1101 bytes} [Thu Aug 18 21:41:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:17.230369 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ddebd8-6e8e-4e18-9c34-5af0ce1e3754 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:17.311839 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:17.317276 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50324375-7e12-4cec-bd88-450e6e62e045 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:17.340806 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:17.357098 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd19ed9-9bfb-430b-92d6-f260ef0619af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:17.357626 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ddebd8-6e8e-4e18-9c34-5af0ce1e3754 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:17.357746 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd19ed9-9bfb-430b-92d6-f260ef0619af None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:17.358000 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd19ed9-9bfb-430b-92d6-f260ef0619af None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:17.358272 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd19ed9-9bfb-430b-92d6-f260ef0619af None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:17.369965 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd19ed9-9bfb-430b-92d6-f260ef0619af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:41:17.375995 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application [None req-7fd19ed9-9bfb-430b-92d6-f260ef0619af None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 21:41:17.375995 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:41:17.375995 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:41:17.375995 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:41:17.375995 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:41:17.375995 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:41:17.375995 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:41:17.375995 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:41:17.375995 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:41:17.375995 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:41:17.375995 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:41:17.375995 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:41:17.375995 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:41:17.375995 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:41:17.375995 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:41:17.375995 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:41:17.377157 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:41:17.377157 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:41:17.377157 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:41:17.377157 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:41:17.377157 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:41:17.377157 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:41:17.377157 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:41:17.377157 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:41:17.377157 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:41:17.377157 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:41:17.377157 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:41:17.377157 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application with Lock( Aug 18 21:41:17.377157 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:41:17.377157 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:41:17.377157 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:41:17.377157 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:41:17.383276 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:41:17.383276 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:41:17.383276 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:41:17.383276 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:41:17.383276 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:41:17.383276 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:41:17.383276 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:41:17.383276 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:41:17.383276 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:41:17.383276 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:41:17.383276 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 21:41:17.383276 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:41:17.383276 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 125/260] 10.222.0.27 () {56 vars in 1114 bytes} [Thu Aug 18 21:41:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:41:17.383276 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd19ed9-9bfb-430b-92d6-f260ef0619af None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:17.406388 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d6bc41-55d3-47a6-9a17-22373235b76c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:17.407598 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d6bc41-55d3-47a6-9a17-22373235b76c None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:17.408031 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d6bc41-55d3-47a6-9a17-22373235b76c None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:17.408447 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d6bc41-55d3-47a6-9a17-22373235b76c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:17.409414 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d6bc41-55d3-47a6-9a17-22373235b76c None admin] RBAC: Adding query filter params (role.id=a1ecfacad5ac443db590b35c86cd49e2, scope.project.id=5cfc98a315f14e00a8cddaa2c57a9da6, user.id=248e9f37b096409dba1f78636add31a4) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:41:17.409972 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d6bc41-55d3-47a6-9a17-22373235b76c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:17.411692 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d6bc41-55d3-47a6-9a17-22373235b76c None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:17.417959 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 136/261] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Aug 18 21:41:17 2022] GET /identity/v3/role_assignments?user.id=248e9f37b096409dba1f78636add31a4&scope.project.id=5cfc98a315f14e00a8cddaa2c57a9da6&role.id=a1ecfacad5ac443db590b35c86cd49e2 => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:17.418979 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d6bc41-55d3-47a6-9a17-22373235b76c None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:17.496205 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd19ed9-9bfb-430b-92d6-f260ef0619af None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:17.535853 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4934c489-c088-4d30-9086-23463ad18c1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:17.536627 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4934c489-c088-4d30-9086-23463ad18c1a None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:17.536910 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4934c489-c088-4d30-9086-23463ad18c1a None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:17.537186 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4934c489-c088-4d30-9086-23463ad18c1a None admin] PATH_INFO: `/v3/users/440d1678328b4e03bc92aaf77299e57a` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:17.538120 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d6bc41-55d3-47a6-9a17-22373235b76c None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:17.538553 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4934c489-c088-4d30-9086-23463ad18c1a None admin] RBAC: Authorizing `identity:get_user(user_id=440d1678328b4e03bc92aaf77299e57a)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:17.539868 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4934c489-c088-4d30-9086-23463ad18c1a None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:17.542880 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 126/262] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Aug 18 21:41:17 2022] GET /identity/v3/users/440d1678328b4e03bc92aaf77299e57a => generated 297 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:17.550726 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4934c489-c088-4d30-9086-23463ad18c1a None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:17.587739 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:17.613044 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:17.613455 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99642bda-2e3d-442f-b5a0-1bc4630a905f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:17.614887 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99642bda-2e3d-442f-b5a0-1bc4630a905f None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:17.615371 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99642bda-2e3d-442f-b5a0-1bc4630a905f None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:17.615879 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99642bda-2e3d-442f-b5a0-1bc4630a905f None admin] PATH_INFO: `/v3/roles` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:17.616784 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99642bda-2e3d-442f-b5a0-1bc4630a905f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:41:17.617290 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99642bda-2e3d-442f-b5a0-1bc4630a905f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:17.618943 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99642bda-2e3d-442f-b5a0-1bc4630a905f None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:17.647203 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 137/263] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Aug 18 21:41:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:17.653086 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99642bda-2e3d-442f-b5a0-1bc4630a905f None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:17.676725 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4934c489-c088-4d30-9086-23463ad18c1a None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:17.728831 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d6529e-bfd7-4230-93ba-a5ef617621d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:17.729547 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d6529e-bfd7-4230-93ba-a5ef617621d6 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:17.729833 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d6529e-bfd7-4230-93ba-a5ef617621d6 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:17.730109 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d6529e-bfd7-4230-93ba-a5ef617621d6 None admin] PATH_INFO: `/v3/projects/5cfc98a315f14e00a8cddaa2c57a9da6` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:17.731510 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d6529e-bfd7-4230-93ba-a5ef617621d6 None admin] RBAC: Authorizing `identity:get_project(project_id=5cfc98a315f14e00a8cddaa2c57a9da6)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:17.733108 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d6529e-bfd7-4230-93ba-a5ef617621d6 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:17.739289 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 127/264] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Aug 18 21:41:17 2022] GET /identity/v3/projects/5cfc98a315f14e00a8cddaa2c57a9da6 => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 21:41:17.741329 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d6529e-bfd7-4230-93ba-a5ef617621d6 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:17.795114 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99642bda-2e3d-442f-b5a0-1bc4630a905f None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:17.839625 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5edfe5a-b706-4d0e-9137-b3dab855161e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:17.841388 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5edfe5a-b706-4d0e-9137-b3dab855161e None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:17.842119 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5edfe5a-b706-4d0e-9137-b3dab855161e None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:17.843170 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5edfe5a-b706-4d0e-9137-b3dab855161e None admin] PATH_INFO: `/v3/users/d7df53d358274e3f9b401339ac1e8124` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:17.846367 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5edfe5a-b706-4d0e-9137-b3dab855161e None admin] RBAC: Authorizing `identity:get_user(user_id=d7df53d358274e3f9b401339ac1e8124)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:17.848210 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5edfe5a-b706-4d0e-9137-b3dab855161e None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:17.853167 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 138/265] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Aug 18 21:41:17 2022] GET /identity/v3/users/d7df53d358274e3f9b401339ac1e8124 => generated 283 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:17.861422 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5edfe5a-b706-4d0e-9137-b3dab855161e None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:17.918335 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d6529e-bfd7-4230-93ba-a5ef617621d6 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:17.939670 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:17.961507 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5c91f2-2218-4801-b3ea-6ca7eeedc322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:17.962755 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5c91f2-2218-4801-b3ea-6ca7eeedc322 None admin] REQUEST_METHOD: `PUT` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:17.963270 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5c91f2-2218-4801-b3ea-6ca7eeedc322 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:17.963747 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5c91f2-2218-4801-b3ea-6ca7eeedc322 None admin] PATH_INFO: `/v3/projects/5cfc98a315f14e00a8cddaa2c57a9da6/users/440d1678328b4e03bc92aaf77299e57a/roles/de8f2438056f4af9879423f8a59e0e0b` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:17.966882 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5c91f2-2218-4801-b3ea-6ca7eeedc322 None admin] RBAC: Authorizing `identity:create_grant(project_id=5cfc98a315f14e00a8cddaa2c57a9da6, user_id=440d1678328b4e03bc92aaf77299e57a, role_id=de8f2438056f4af9879423f8a59e0e0b)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:17.969720 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5c91f2-2218-4801-b3ea-6ca7eeedc322 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:18.000785 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:18.050368 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 128/266] 10.222.0.27 () {58 vars in 1439 bytes} [Thu Aug 18 21:41:17 2022] PUT /identity/v3/projects/5cfc98a315f14e00a8cddaa2c57a9da6/users/440d1678328b4e03bc92aaf77299e57a/roles/de8f2438056f4af9879423f8a59e0e0b => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 21:41:18.050707 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5edfe5a-b706-4d0e-9137-b3dab855161e None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:18.093131 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343e4991-34db-4c2c-8af1-2f0fd501d987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:18.094519 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343e4991-34db-4c2c-8af1-2f0fd501d987 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:18.095015 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343e4991-34db-4c2c-8af1-2f0fd501d987 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:18.095349 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343e4991-34db-4c2c-8af1-2f0fd501d987 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:18.175139 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343e4991-34db-4c2c-8af1-2f0fd501d987 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:18.176675 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343e4991-34db-4c2c-8af1-2f0fd501d987 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:18.243539 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:18.303656 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 139/267] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Aug 18 21:41:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 21:41:18.309224 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5c91f2-2218-4801-b3ea-6ca7eeedc322 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:18.436640 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5c91f2-2218-4801-b3ea-6ca7eeedc322 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:18.490674 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c20295-a814-4a46-8055-7ebdba2765e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:18.491310 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c20295-a814-4a46-8055-7ebdba2765e5 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:18.491587 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c20295-a814-4a46-8055-7ebdba2765e5 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:18.491857 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c20295-a814-4a46-8055-7ebdba2765e5 None admin] PATH_INFO: `/v3/projects/5cfc98a315f14e00a8cddaa2c57a9da6` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:18.493026 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c20295-a814-4a46-8055-7ebdba2765e5 None admin] RBAC: Authorizing `identity:get_project(project_id=5cfc98a315f14e00a8cddaa2c57a9da6)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:18.494515 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c20295-a814-4a46-8055-7ebdba2765e5 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:18.496358 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 129/268] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Aug 18 21:41:18 2022] GET /identity/v3/projects/5cfc98a315f14e00a8cddaa2c57a9da6 => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:18.502580 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343e4991-34db-4c2c-8af1-2f0fd501d987 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:18.646158 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343e4991-34db-4c2c-8af1-2f0fd501d987 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:18.691986 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2089ea-9f08-4d35-8eb6-fb2402dd26b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:18.692610 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2089ea-9f08-4d35-8eb6-fb2402dd26b7 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:18.692886 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2089ea-9f08-4d35-8eb6-fb2402dd26b7 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:18.693155 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2089ea-9f08-4d35-8eb6-fb2402dd26b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:18.693878 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2089ea-9f08-4d35-8eb6-fb2402dd26b7 None admin] RBAC: Adding query filter params (role.id=66171a9efb5344c7a903946f238a3808, scope.project.id=5cfc98a315f14e00a8cddaa2c57a9da6, user.id=d7df53d358274e3f9b401339ac1e8124) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:41:18.694178 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2089ea-9f08-4d35-8eb6-fb2402dd26b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:18.695600 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2089ea-9f08-4d35-8eb6-fb2402dd26b7 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:18.701850 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 140/269] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Aug 18 21:41:18 2022] GET /identity/v3/role_assignments?user.id=d7df53d358274e3f9b401339ac1e8124&scope.project.id=5cfc98a315f14e00a8cddaa2c57a9da6&role.id=66171a9efb5344c7a903946f238a3808 => generated 608 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:18.993959 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e565922-534c-440a-a668-a3bba86fe197 None None] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:18.994167 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e565922-534c-440a-a668-a3bba86fe197 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:18.994447 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e565922-534c-440a-a668-a3bba86fe197 None None] PATH_INFO: `/` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:18.996023 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 130/270] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:41:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:41:19.002336 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba98653-1e45-4bfb-a687-76786479884d None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:19.002627 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba98653-1e45-4bfb-a687-76786479884d None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:19.002907 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba98653-1e45-4bfb-a687-76786479884d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:19.025134 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-9ba98653-1e45-4bfb-a687-76786479884d None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:41:19.026625 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-9ba98653-1e45-4bfb-a687-76786479884d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:41:19.042706 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:19.111349 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 141/271] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:41:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 21:41:19.282446 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bac381-51e1-470b-88cf-471bb130d463 None None] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:19.282734 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bac381-51e1-470b-88cf-471bb130d463 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:19.282912 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bac381-51e1-470b-88cf-471bb130d463 None None] PATH_INFO: `/` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:19.284558 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 131/272] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:41:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:41:19.289976 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc9b561-c610-4ab8-a8d4-1b5805d2150a None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:19.290357 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc9b561-c610-4ab8-a8d4-1b5805d2150a None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:19.290760 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc9b561-c610-4ab8-a8d4-1b5805d2150a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:19.316113 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-6dc9b561-c610-4ab8-a8d4-1b5805d2150a None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:41:19.317373 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-6dc9b561-c610-4ab8-a8d4-1b5805d2150a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:41:19.392308 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 142/273] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:41:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 21:41:19.411345 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bac381-51e1-470b-88cf-471bb130d463 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:19.464210 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:19.527034 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bac381-51e1-470b-88cf-471bb130d463 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:19.566904 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c6c5b0-2f39-43d6-a7a0-c654b535e018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:19.567461 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c6c5b0-2f39-43d6-a7a0-c654b535e018 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:19.567746 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c6c5b0-2f39-43d6-a7a0-c654b535e018 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:19.568111 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c6c5b0-2f39-43d6-a7a0-c654b535e018 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:19.579059 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c6c5b0-2f39-43d6-a7a0-c654b535e018 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:41:19.584569 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application [None req-89c6c5b0-2f39-43d6-a7a0-c654b535e018 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 21:41:19.584569 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:41:19.584569 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:41:19.584569 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:41:19.584569 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:41:19.584569 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:41:19.584569 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:41:19.584569 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:41:19.584569 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:41:19.584569 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:41:19.584569 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:41:19.584569 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:41:19.584569 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:41:19.584569 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:41:19.584569 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:41:19.584569 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:41:19.585453 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:41:19.585453 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:41:19.585453 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:41:19.585453 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:41:19.585453 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:41:19.585453 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:41:19.585453 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:41:19.585453 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:41:19.585453 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:41:19.585453 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:41:19.585453 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:41:19.585453 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application with Lock( Aug 18 21:41:19.585453 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:41:19.585453 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:41:19.585453 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:41:19.585453 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:41:19.586245 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:41:19.586245 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:41:19.586245 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:41:19.586245 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:41:19.586245 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:41:19.586245 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:41:19.586245 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:41:19.586245 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:41:19.586245 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:41:19.586245 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:41:19.586245 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 21:41:19.586245 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:41:19.590655 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 132/274] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Aug 18 21:41:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:41:19.592000 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc9b561-c610-4ab8-a8d4-1b5805d2150a None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:19.666186 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c6c5b0-2f39-43d6-a7a0-c654b535e018 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:19.685927 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:19.712375 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc9b561-c610-4ab8-a8d4-1b5805d2150a None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:19.760110 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd935449-bb12-451e-aefc-ec2a73c92a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:19.760759 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd935449-bb12-451e-aefc-ec2a73c92a1f None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:19.761299 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd935449-bb12-451e-aefc-ec2a73c92a1f None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:19.761581 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd935449-bb12-451e-aefc-ec2a73c92a1f None admin] PATH_INFO: `/v3/roles` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:19.762645 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd935449-bb12-451e-aefc-ec2a73c92a1f None admin] RBAC: Adding query filter params (name=member) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:41:19.762952 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd935449-bb12-451e-aefc-ec2a73c92a1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:19.764339 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd935449-bb12-451e-aefc-ec2a73c92a1f None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:19.779633 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c6c5b0-2f39-43d6-a7a0-c654b535e018 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:19.784640 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 143/275] 10.222.0.27 () {56 vars in 1101 bytes} [Thu Aug 18 21:41:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:19.785954 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:19.787661 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd935449-bb12-451e-aefc-ec2a73c92a1f None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:19.820309 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e137db-ea17-4deb-93d4-c833b450a9a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:19.821021 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e137db-ea17-4deb-93d4-c833b450a9a5 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:19.821297 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e137db-ea17-4deb-93d4-c833b450a9a5 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:19.821621 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e137db-ea17-4deb-93d4-c833b450a9a5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:19.822878 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e137db-ea17-4deb-93d4-c833b450a9a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:19.824571 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e137db-ea17-4deb-93d4-c833b450a9a5 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:19.831340 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 133/276] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 18 21:41:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 21:41:19.832297 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e137db-ea17-4deb-93d4-c833b450a9a5 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:19.907661 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd935449-bb12-451e-aefc-ec2a73c92a1f None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:19.950722 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6473b4-59f0-4afc-886d-566d0e64705a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:19.951363 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6473b4-59f0-4afc-886d-566d0e64705a None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:19.951645 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6473b4-59f0-4afc-886d-566d0e64705a None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:19.951833 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e137db-ea17-4deb-93d4-c833b450a9a5 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:19.951930 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6473b4-59f0-4afc-886d-566d0e64705a None admin] PATH_INFO: `/v3/users/2461f47edb4b40359e57690c84a803e2` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:19.964081 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:19.966432 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6473b4-59f0-4afc-886d-566d0e64705a None admin] RBAC: Authorizing `identity:get_user(user_id=2461f47edb4b40359e57690c84a803e2)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:19.968142 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6473b4-59f0-4afc-886d-566d0e64705a None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:19.970254 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 144/277] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Aug 18 21:41:19 2022] GET /identity/v3/users/2461f47edb4b40359e57690c84a803e2 => generated 293 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:19.976200 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d7daee-1a68-4639-92ac-db68994c5913 None None] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:19.976488 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d7daee-1a68-4639-92ac-db68994c5913 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:19.979246 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d7daee-1a68-4639-92ac-db68994c5913 None None] PATH_INFO: `/` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:19.979246 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 145/278] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:41:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:41:19.981102 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d7daee-1a68-4639-92ac-db68994c5913 None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:19.991579 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d605507c-98c8-44c0-a7b9-0dc55302070b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:19.992187 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d605507c-98c8-44c0-a7b9-0dc55302070b None admin] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:19.992467 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d605507c-98c8-44c0-a7b9-0dc55302070b None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:19.992802 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d605507c-98c8-44c0-a7b9-0dc55302070b None admin] PATH_INFO: `/v3/users` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:19.993451 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d605507c-98c8-44c0-a7b9-0dc55302070b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:19.994934 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d605507c-98c8-44c0-a7b9-0dc55302070b None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:20.100051 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d7daee-1a68-4639-92ac-db68994c5913 None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:20.100428 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 134/279] 10.222.0.27 () {60 vars in 1132 bytes} [Thu Aug 18 21:41:19 2022] POST /identity/v3/users => generated 293 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:41:20.106232 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33efadb9-33e5-4c6e-83c1-6db2d9e8c132 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:20.106812 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33efadb9-33e5-4c6e-83c1-6db2d9e8c132 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:20.107300 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33efadb9-33e5-4c6e-83c1-6db2d9e8c132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:20.134298 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-33efadb9-33e5-4c6e-83c1-6db2d9e8c132 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:41:20.136907 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-33efadb9-33e5-4c6e-83c1-6db2d9e8c132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:41:20.148324 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b6081e-55d0-4aca-8ca2-96b7e09be56c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:20.149208 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b6081e-55d0-4aca-8ca2-96b7e09be56c None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:20.149564 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b6081e-55d0-4aca-8ca2-96b7e09be56c None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:20.149957 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b6081e-55d0-4aca-8ca2-96b7e09be56c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:20.150873 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b6081e-55d0-4aca-8ca2-96b7e09be56c None admin] RBAC: Adding query filter params (role.id=de8f2438056f4af9879423f8a59e0e0b, user.id=2461f47edb4b40359e57690c84a803e2, scope.system=all) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:41:20.151833 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b6081e-55d0-4aca-8ca2-96b7e09be56c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:20.153945 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b6081e-55d0-4aca-8ca2-96b7e09be56c None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:20.166172 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 146/280] 10.222.0.27 () {56 vars in 1308 bytes} [Thu Aug 18 21:41:19 2022] GET /identity/v3/role_assignments?user.id=2461f47edb4b40359e57690c84a803e2&scope.system=all&role.id=de8f2438056f4af9879423f8a59e0e0b => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:20.172317 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:20.228216 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 135/281] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:41:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 21:41:20.430372 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f63b27d-af9a-4995-ad4d-e459062fa164 None None] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:20.430738 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f63b27d-af9a-4995-ad4d-e459062fa164 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:20.430925 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f63b27d-af9a-4995-ad4d-e459062fa164 None None] PATH_INFO: `/` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:20.432554 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 147/282] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:41:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:41:20.438177 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7365ed45-e96e-4623-8697-85cb2d6942b6 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:20.438626 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7365ed45-e96e-4623-8697-85cb2d6942b6 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:20.438822 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7365ed45-e96e-4623-8697-85cb2d6942b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:20.459634 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-7365ed45-e96e-4623-8697-85cb2d6942b6 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:41:20.460900 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-7365ed45-e96e-4623-8697-85cb2d6942b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:41:20.509849 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f63b27d-af9a-4995-ad4d-e459062fa164 None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:20.544135 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 136/283] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:41:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 21:41:20.581243 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:20.622681 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f63b27d-af9a-4995-ad4d-e459062fa164 None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:20.661173 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13ced2c-2026-49e4-9ff7-93854ad71f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:20.661806 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13ced2c-2026-49e4-9ff7-93854ad71f5a None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:20.662081 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13ced2c-2026-49e4-9ff7-93854ad71f5a None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:20.662401 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13ced2c-2026-49e4-9ff7-93854ad71f5a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:20.674064 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13ced2c-2026-49e4-9ff7-93854ad71f5a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:41:20.678934 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application [None req-f13ced2c-2026-49e4-9ff7-93854ad71f5a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 21:41:20.678934 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:41:20.678934 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:41:20.678934 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:41:20.678934 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:41:20.678934 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:41:20.678934 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:41:20.678934 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:41:20.678934 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:41:20.678934 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:41:20.678934 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:41:20.678934 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:41:20.678934 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:41:20.678934 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:41:20.678934 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:41:20.678934 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:41:20.679808 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:41:20.679808 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:41:20.679808 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:41:20.679808 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:41:20.679808 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:41:20.679808 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:41:20.679808 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:41:20.679808 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:41:20.679808 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:41:20.679808 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:41:20.679808 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:41:20.679808 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application with Lock( Aug 18 21:41:20.679808 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:41:20.679808 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:41:20.679808 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:41:20.679808 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:41:20.680661 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:41:20.680661 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:41:20.680661 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:41:20.680661 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:41:20.680661 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:41:20.680661 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:41:20.680661 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:41:20.680661 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:41:20.680661 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:41:20.680661 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:41:20.680661 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 21:41:20.680661 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:41:20.683470 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 148/284] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Aug 18 21:41:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 21:41:20.686293 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7365ed45-e96e-4623-8697-85cb2d6942b6 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:20.787539 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:20.800025 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7365ed45-e96e-4623-8697-85cb2d6942b6 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:20.834475 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393a4bd8-9659-4578-98ba-5b2ca0736f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:20.835080 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393a4bd8-9659-4578-98ba-5b2ca0736f61 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:20.835354 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393a4bd8-9659-4578-98ba-5b2ca0736f61 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:20.835623 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393a4bd8-9659-4578-98ba-5b2ca0736f61 None admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:20.836284 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393a4bd8-9659-4578-98ba-5b2ca0736f61 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:41:20.836583 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393a4bd8-9659-4578-98ba-5b2ca0736f61 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:20.838111 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393a4bd8-9659-4578-98ba-5b2ca0736f61 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:20.851596 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 137/285] 10.222.0.27 () {56 vars in 1101 bytes} [Thu Aug 18 21:41:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:20.852993 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13ced2c-2026-49e4-9ff7-93854ad71f5a None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:20.935603 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393a4bd8-9659-4578-98ba-5b2ca0736f61 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:20.964310 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13ced2c-2026-49e4-9ff7-93854ad71f5a None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:20.990084 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:21.001831 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976ed8c4-5299-4b01-b0bd-6b518ba5c4bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:21.002463 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976ed8c4-5299-4b01-b0bd-6b518ba5c4bb None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:21.002738 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976ed8c4-5299-4b01-b0bd-6b518ba5c4bb None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:21.003061 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976ed8c4-5299-4b01-b0bd-6b518ba5c4bb None admin] PATH_INFO: `/v3/users/248e9f37b096409dba1f78636add31a4` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:21.004259 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976ed8c4-5299-4b01-b0bd-6b518ba5c4bb None admin] RBAC: Authorizing `identity:get_user(user_id=248e9f37b096409dba1f78636add31a4)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:21.005746 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976ed8c4-5299-4b01-b0bd-6b518ba5c4bb None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:21.012284 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 149/286] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Aug 18 21:41:20 2022] GET /identity/v3/users/248e9f37b096409dba1f78636add31a4 => generated 297 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:21.013520 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976ed8c4-5299-4b01-b0bd-6b518ba5c4bb None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:21.068066 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393a4bd8-9659-4578-98ba-5b2ca0736f61 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:21.108155 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644125a3-b1a9-49ea-a896-e1b789dada8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:21.110052 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644125a3-b1a9-49ea-a896-e1b789dada8e None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:21.110332 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644125a3-b1a9-49ea-a896-e1b789dada8e None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:21.110601 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644125a3-b1a9-49ea-a896-e1b789dada8e None admin] PATH_INFO: `/v3/roles/member` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:21.137017 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644125a3-b1a9-49ea-a896-e1b789dada8e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:41:21.141422 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976ed8c4-5299-4b01-b0bd-6b518ba5c4bb None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:21.147342 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application [None req-644125a3-b1a9-49ea-a896-e1b789dada8e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 21:41:21.147342 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:41:21.147342 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:41:21.147342 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:41:21.147342 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:41:21.147342 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:41:21.147342 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:41:21.147342 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:41:21.147342 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:41:21.147342 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:41:21.147342 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:41:21.147342 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:41:21.147342 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:41:21.147342 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:41:21.147342 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:41:21.147342 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:41:21.148233 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:41:21.148233 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:41:21.148233 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:41:21.148233 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:41:21.148233 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:41:21.148233 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:41:21.148233 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:41:21.148233 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:41:21.148233 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:41:21.148233 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:41:21.148233 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:41:21.148233 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application with Lock( Aug 18 21:41:21.148233 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:41:21.148233 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:41:21.148233 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:41:21.148233 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:41:21.149054 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:41:21.149054 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:41:21.149054 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:41:21.149054 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:41:21.149054 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:41:21.149054 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:41:21.149054 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:41:21.149054 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:41:21.149054 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:41:21.149054 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:41:21.149054 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 21:41:21.149054 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:41:21.154826 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 138/287] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Aug 18 21:41:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:41:21.155770 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644125a3-b1a9-49ea-a896-e1b789dada8e None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:21.178962 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:21.205969 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f666d76-5489-4f04-8ad1-ae73e8f8eb3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:21.206569 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f666d76-5489-4f04-8ad1-ae73e8f8eb3d None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:21.206847 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f666d76-5489-4f04-8ad1-ae73e8f8eb3d None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:21.207115 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f666d76-5489-4f04-8ad1-ae73e8f8eb3d None admin] PATH_INFO: `/v3/projects/5cfc98a315f14e00a8cddaa2c57a9da6` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:21.209138 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f666d76-5489-4f04-8ad1-ae73e8f8eb3d None admin] RBAC: Authorizing `identity:get_project(project_id=5cfc98a315f14e00a8cddaa2c57a9da6)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:21.211283 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f666d76-5489-4f04-8ad1-ae73e8f8eb3d None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:21.220525 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 150/288] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Aug 18 21:41:21 2022] GET /identity/v3/projects/5cfc98a315f14e00a8cddaa2c57a9da6 => generated 302 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:21.221747 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f666d76-5489-4f04-8ad1-ae73e8f8eb3d None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:21.318538 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:21.324693 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644125a3-b1a9-49ea-a896-e1b789dada8e None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:21.377463 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc141dd0-79c3-4762-86fe-ff994c0d3809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:21.378084 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc141dd0-79c3-4762-86fe-ff994c0d3809 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:21.378362 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc141dd0-79c3-4762-86fe-ff994c0d3809 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:21.378639 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc141dd0-79c3-4762-86fe-ff994c0d3809 None admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:21.379313 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc141dd0-79c3-4762-86fe-ff994c0d3809 None admin] RBAC: Adding query filter params (name=member) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:41:21.379615 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc141dd0-79c3-4762-86fe-ff994c0d3809 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:21.381039 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc141dd0-79c3-4762-86fe-ff994c0d3809 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:21.389046 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f666d76-5489-4f04-8ad1-ae73e8f8eb3d None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:21.404125 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 139/289] 10.222.0.27 () {56 vars in 1101 bytes} [Thu Aug 18 21:41:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:21.411681 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc141dd0-79c3-4762-86fe-ff994c0d3809 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:21.460302 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f115cb7-4a48-481b-9b42-76c0e531db6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:21.460937 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f115cb7-4a48-481b-9b42-76c0e531db6b None admin] REQUEST_METHOD: `PUT` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:21.461217 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f115cb7-4a48-481b-9b42-76c0e531db6b None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:21.461495 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f115cb7-4a48-481b-9b42-76c0e531db6b None admin] PATH_INFO: `/v3/projects/5cfc98a315f14e00a8cddaa2c57a9da6/users/248e9f37b096409dba1f78636add31a4/roles/a1ecfacad5ac443db590b35c86cd49e2` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:21.463503 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f115cb7-4a48-481b-9b42-76c0e531db6b None admin] RBAC: Authorizing `identity:create_grant(project_id=5cfc98a315f14e00a8cddaa2c57a9da6, user_id=248e9f37b096409dba1f78636add31a4, role_id=a1ecfacad5ac443db590b35c86cd49e2)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:21.464978 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f115cb7-4a48-481b-9b42-76c0e531db6b None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:21.517709 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:21.550540 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc141dd0-79c3-4762-86fe-ff994c0d3809 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:21.563854 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 151/290] 10.222.0.27 () {58 vars in 1439 bytes} [Thu Aug 18 21:41:21 2022] PUT /identity/v3/projects/5cfc98a315f14e00a8cddaa2c57a9da6/users/248e9f37b096409dba1f78636add31a4/roles/a1ecfacad5ac443db590b35c86cd49e2 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 21:41:21.594482 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554d3f7a-c82d-4f16-9e96-81cd8189923d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:21.595122 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554d3f7a-c82d-4f16-9e96-81cd8189923d None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:21.595399 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554d3f7a-c82d-4f16-9e96-81cd8189923d None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:21.595724 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554d3f7a-c82d-4f16-9e96-81cd8189923d None admin] PATH_INFO: `/v3/users/440d1678328b4e03bc92aaf77299e57a` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:21.596943 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554d3f7a-c82d-4f16-9e96-81cd8189923d None admin] RBAC: Authorizing `identity:get_user(user_id=440d1678328b4e03bc92aaf77299e57a)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:21.598662 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554d3f7a-c82d-4f16-9e96-81cd8189923d None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:21.603838 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 140/291] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Aug 18 21:41:21 2022] GET /identity/v3/users/440d1678328b4e03bc92aaf77299e57a => generated 297 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 21:41:21.606829 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f115cb7-4a48-481b-9b42-76c0e531db6b None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:21.744520 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f115cb7-4a48-481b-9b42-76c0e531db6b None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:21.766355 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:21.782603 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05055cc-2c6c-4973-89cf-df3e6bea0df6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:21.783233 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05055cc-2c6c-4973-89cf-df3e6bea0df6 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:21.783602 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05055cc-2c6c-4973-89cf-df3e6bea0df6 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:21.783938 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05055cc-2c6c-4973-89cf-df3e6bea0df6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:21.857664 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05055cc-2c6c-4973-89cf-df3e6bea0df6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:21.859810 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05055cc-2c6c-4973-89cf-df3e6bea0df6 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:21.983741 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 152/292] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Aug 18 21:41:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 21:41:21.990140 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554d3f7a-c82d-4f16-9e96-81cd8189923d None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:22.139773 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554d3f7a-c82d-4f16-9e96-81cd8189923d None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:22.185053 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43dc1f1-09f2-4c98-b81e-ba660cda0de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:22.185682 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43dc1f1-09f2-4c98-b81e-ba660cda0de0 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:22.185959 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43dc1f1-09f2-4c98-b81e-ba660cda0de0 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:22.186230 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43dc1f1-09f2-4c98-b81e-ba660cda0de0 None admin] PATH_INFO: `/v3/projects/5cfc98a315f14e00a8cddaa2c57a9da6` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:22.187466 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43dc1f1-09f2-4c98-b81e-ba660cda0de0 None admin] RBAC: Authorizing `identity:get_project(project_id=5cfc98a315f14e00a8cddaa2c57a9da6)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:22.188937 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43dc1f1-09f2-4c98-b81e-ba660cda0de0 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:22.190956 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 141/293] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Aug 18 21:41:21 2022] GET /identity/v3/projects/5cfc98a315f14e00a8cddaa2c57a9da6 => generated 302 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:22.196831 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05055cc-2c6c-4973-89cf-df3e6bea0df6 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:22.227946 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:22.349384 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05055cc-2c6c-4973-89cf-df3e6bea0df6 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:22.401432 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344df290-e4fb-4e4a-a5e7-ec1fac827b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:22.401978 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344df290-e4fb-4e4a-a5e7-ec1fac827b92 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:22.402259 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344df290-e4fb-4e4a-a5e7-ec1fac827b92 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:22.402531 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344df290-e4fb-4e4a-a5e7-ec1fac827b92 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:22.403269 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344df290-e4fb-4e4a-a5e7-ec1fac827b92 None admin] RBAC: Adding query filter params (role.id=de8f2438056f4af9879423f8a59e0e0b, scope.project.id=5cfc98a315f14e00a8cddaa2c57a9da6, user.id=440d1678328b4e03bc92aaf77299e57a) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:41:22.403579 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344df290-e4fb-4e4a-a5e7-ec1fac827b92 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:22.405063 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344df290-e4fb-4e4a-a5e7-ec1fac827b92 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:22.412898 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 153/294] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Aug 18 21:41:22 2022] GET /identity/v3/role_assignments?user.id=440d1678328b4e03bc92aaf77299e57a&scope.project.id=5cfc98a315f14e00a8cddaa2c57a9da6&role.id=de8f2438056f4af9879423f8a59e0e0b => generated 608 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:22.667063 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73492bc4-8edf-4c51-8e1c-94ea3c107106 None None] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:22.667063 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73492bc4-8edf-4c51-8e1c-94ea3c107106 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:22.667063 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73492bc4-8edf-4c51-8e1c-94ea3c107106 None None] PATH_INFO: `/` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:22.668220 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 142/295] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:41:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:41:22.672180 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab140f3c-115c-47a2-9da5-45d405565b1a None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:22.672940 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab140f3c-115c-47a2-9da5-45d405565b1a None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:22.673415 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab140f3c-115c-47a2-9da5-45d405565b1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:22.697001 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-ab140f3c-115c-47a2-9da5-45d405565b1a None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:41:22.698630 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-ab140f3c-115c-47a2-9da5-45d405565b1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:41:22.709751 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e71d53-a187-43c8-93fa-115ae01590b3 None None] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:22.710359 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e71d53-a187-43c8-93fa-115ae01590b3 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:22.710860 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e71d53-a187-43c8-93fa-115ae01590b3 None None] PATH_INFO: `/` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:22.712687 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 143/296] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:41:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:41:22.720171 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4ac1c0-4cd3-4607-9f84-ae5d9d155c40 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:22.720824 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4ac1c0-4cd3-4607-9f84-ae5d9d155c40 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:22.721309 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4ac1c0-4cd3-4607-9f84-ae5d9d155c40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:22.742718 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-6a4ac1c0-4cd3-4607-9f84-ae5d9d155c40 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:41:22.744252 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-6a4ac1c0-4cd3-4607-9f84-ae5d9d155c40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:41:22.746731 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:22.782249 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 154/297] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:41:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 21:41:22.821950 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 144/298] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:41:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 21:41:22.878528 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8a952c-2672-4de7-8f33-c73b361957fd None None] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:22.879354 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8a952c-2672-4de7-8f33-c73b361957fd None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:22.879795 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8a952c-2672-4de7-8f33-c73b361957fd None None] PATH_INFO: `/` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:22.881315 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 155/299] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:41:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:41:22.887613 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c988463d-1377-44a4-a676-8bcda7083dbb None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:22.888059 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c988463d-1377-44a4-a676-8bcda7083dbb None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:22.888474 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c988463d-1377-44a4-a676-8bcda7083dbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:22.909826 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-c988463d-1377-44a4-a676-8bcda7083dbb None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:41:22.911251 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-c988463d-1377-44a4-a676-8bcda7083dbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:41:22.988996 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 145/300] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:41:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 21:41:23.091899 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8a952c-2672-4de7-8f33-c73b361957fd None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:23.109916 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:23.125359 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c988463d-1377-44a4-a676-8bcda7083dbb None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:23.226187 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8a952c-2672-4de7-8f33-c73b361957fd None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:23.227508 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:23.276507 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c988463d-1377-44a4-a676-8bcda7083dbb None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:23.277735 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbfde92-0e19-4536-9d2b-0c2a0443973a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:23.278895 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbfde92-0e19-4536-9d2b-0c2a0443973a None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:23.279404 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbfde92-0e19-4536-9d2b-0c2a0443973a None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:23.279878 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbfde92-0e19-4536-9d2b-0c2a0443973a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:23.291436 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbfde92-0e19-4536-9d2b-0c2a0443973a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:41:23.296147 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application [None req-9bbfde92-0e19-4536-9d2b-0c2a0443973a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 21:41:23.296147 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:41:23.296147 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:41:23.296147 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:41:23.296147 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:41:23.296147 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:41:23.296147 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:41:23.296147 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:41:23.296147 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:41:23.296147 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:41:23.296147 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:41:23.296147 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:41:23.296147 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:41:23.296147 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:41:23.296147 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:41:23.296147 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:41:23.297128 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:41:23.297128 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:41:23.297128 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:41:23.297128 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:41:23.297128 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:41:23.297128 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:41:23.297128 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:41:23.297128 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:41:23.297128 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:41:23.297128 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:41:23.297128 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:41:23.297128 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application with Lock( Aug 18 21:41:23.297128 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:41:23.297128 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:41:23.297128 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:41:23.297128 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:41:23.297929 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:41:23.297929 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:41:23.297929 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:41:23.297929 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:41:23.297929 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:41:23.297929 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:41:23.297929 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:41:23.297929 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:41:23.297929 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:41:23.297929 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:41:23.297929 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 21:41:23.297929 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:41:23.297929 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 156/301] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Aug 18 21:41:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:41:23.299016 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbfde92-0e19-4536-9d2b-0c2a0443973a None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:23.322928 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb96096a-8db4-48a9-b76f-f330a53fddad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:23.323559 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb96096a-8db4-48a9-b76f-f330a53fddad None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:23.323837 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb96096a-8db4-48a9-b76f-f330a53fddad None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:23.324106 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb96096a-8db4-48a9-b76f-f330a53fddad None admin] PATH_INFO: `/v3/roles/member` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:23.334777 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb96096a-8db4-48a9-b76f-f330a53fddad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:41:23.339538 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application [None req-cb96096a-8db4-48a9-b76f-f330a53fddad None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 21:41:23.339538 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:41:23.339538 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:41:23.339538 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:41:23.339538 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:41:23.339538 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:41:23.339538 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:41:23.339538 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:41:23.339538 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:41:23.339538 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:41:23.339538 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:41:23.339538 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:41:23.339538 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:41:23.339538 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:41:23.339538 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:41:23.339538 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:41:23.340429 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:41:23.340429 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:41:23.340429 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:41:23.340429 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:41:23.340429 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:41:23.340429 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:41:23.340429 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:41:23.340429 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:41:23.340429 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:41:23.340429 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:41:23.340429 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:41:23.340429 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application with Lock( Aug 18 21:41:23.340429 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:41:23.340429 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:41:23.340429 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:41:23.340429 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:41:23.341307 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:41:23.341307 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:41:23.341307 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:41:23.341307 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:41:23.341307 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:41:23.341307 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:41:23.341307 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:41:23.341307 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:41:23.341307 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:41:23.341307 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:41:23.341307 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 21:41:23.341307 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:41:23.344861 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 146/302] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Aug 18 21:41:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:41:23.346003 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb96096a-8db4-48a9-b76f-f330a53fddad None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:23.389294 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:23.415681 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbfde92-0e19-4536-9d2b-0c2a0443973a None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:23.449824 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb96096a-8db4-48a9-b76f-f330a53fddad None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:23.455585 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed930bb3-adbc-4707-84b6-ce0190cfddae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:23.456214 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed930bb3-adbc-4707-84b6-ce0190cfddae None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:23.456488 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed930bb3-adbc-4707-84b6-ce0190cfddae None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:23.456781 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed930bb3-adbc-4707-84b6-ce0190cfddae None admin] PATH_INFO: `/v3/domains/default` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:23.458022 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed930bb3-adbc-4707-84b6-ce0190cfddae None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:23.459321 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed930bb3-adbc-4707-84b6-ce0190cfddae None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:23.464655 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 157/303] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 18 21:41:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:23.464655 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed930bb3-adbc-4707-84b6-ce0190cfddae None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:23.483157 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:23.493198 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdf7587-e32a-4b2e-8485-ff97628468e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:23.493873 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdf7587-e32a-4b2e-8485-ff97628468e0 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:23.494961 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdf7587-e32a-4b2e-8485-ff97628468e0 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:23.494961 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdf7587-e32a-4b2e-8485-ff97628468e0 None admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:23.495110 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdf7587-e32a-4b2e-8485-ff97628468e0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:41:23.495359 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdf7587-e32a-4b2e-8485-ff97628468e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:23.496791 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdf7587-e32a-4b2e-8485-ff97628468e0 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:23.505721 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 147/304] 10.222.0.27 () {56 vars in 1101 bytes} [Thu Aug 18 21:41:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:23.506312 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdf7587-e32a-4b2e-8485-ff97628468e0 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:23.579479 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed930bb3-adbc-4707-84b6-ce0190cfddae None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:23.613744 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdf7587-e32a-4b2e-8485-ff97628468e0 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:23.615719 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21c5d24-8b9b-49d7-9993-6f49eaf7ea26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:23.616410 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21c5d24-8b9b-49d7-9993-6f49eaf7ea26 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:23.616719 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21c5d24-8b9b-49d7-9993-6f49eaf7ea26 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:23.616991 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21c5d24-8b9b-49d7-9993-6f49eaf7ea26 None admin] PATH_INFO: `/v3/roles` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:23.617650 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21c5d24-8b9b-49d7-9993-6f49eaf7ea26 None admin] RBAC: Adding query filter params (name=member) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:41:23.617948 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21c5d24-8b9b-49d7-9993-6f49eaf7ea26 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:23.619299 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21c5d24-8b9b-49d7-9993-6f49eaf7ea26 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:23.628111 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 158/305] 10.222.0.27 () {56 vars in 1101 bytes} [Thu Aug 18 21:41:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:23.628111 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21c5d24-8b9b-49d7-9993-6f49eaf7ea26 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:23.633947 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:23.654743 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6722615-dbe2-408b-90b2-98ea68f67110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:23.655355 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6722615-dbe2-408b-90b2-98ea68f67110 None admin] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:23.655625 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6722615-dbe2-408b-90b2-98ea68f67110 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:23.656690 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6722615-dbe2-408b-90b2-98ea68f67110 None admin] PATH_INFO: `/v3/groups` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:23.657482 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6722615-dbe2-408b-90b2-98ea68f67110 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:23.658967 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6722615-dbe2-408b-90b2-98ea68f67110 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:23.733536 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21c5d24-8b9b-49d7-9993-6f49eaf7ea26 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:23.746222 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 148/306] 10.222.0.27 () {60 vars in 1134 bytes} [Thu Aug 18 21:41:23 2022] POST /identity/v3/groups => generated 229 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:41:23.753875 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6722615-dbe2-408b-90b2-98ea68f67110 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:23.783882 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ba5b93-b7ab-444f-86ef-972f9a439184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:23.784523 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ba5b93-b7ab-444f-86ef-972f9a439184 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:23.784833 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ba5b93-b7ab-444f-86ef-972f9a439184 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:23.785102 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ba5b93-b7ab-444f-86ef-972f9a439184 None admin] PATH_INFO: `/v3/users/04b4bc9b131a46a1b341aa8f0e595d9f` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:23.801669 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ba5b93-b7ab-444f-86ef-972f9a439184 None admin] RBAC: Authorizing `identity:get_user(user_id=04b4bc9b131a46a1b341aa8f0e595d9f)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:23.803150 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ba5b93-b7ab-444f-86ef-972f9a439184 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:23.805153 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 159/307] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Aug 18 21:41:23 2022] GET /identity/v3/users/04b4bc9b131a46a1b341aa8f0e595d9f => generated 293 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:23.810485 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7818f4e0-f413-485f-98e8-61c6fc2e6f4d None None] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:23.810485 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7818f4e0-f413-485f-98e8-61c6fc2e6f4d None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:23.810485 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7818f4e0-f413-485f-98e8-61c6fc2e6f4d None None] PATH_INFO: `/` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:23.810485 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 160/308] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:41:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:41:23.813680 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7818f4e0-f413-485f-98e8-61c6fc2e6f4d None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:23.829179 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:23.886132 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6722615-dbe2-408b-90b2-98ea68f67110 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:23.889385 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:23.928750 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fd6850-a02c-4992-b591-9c71b023295f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:23.929382 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fd6850-a02c-4992-b591-9c71b023295f None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:23.929660 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fd6850-a02c-4992-b591-9c71b023295f None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:23.929924 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fd6850-a02c-4992-b591-9c71b023295f None admin] PATH_INFO: `/v3/users/2461f47edb4b40359e57690c84a803e2` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:23.931069 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fd6850-a02c-4992-b591-9c71b023295f None admin] RBAC: Authorizing `identity:get_user(user_id=2461f47edb4b40359e57690c84a803e2)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:23.932555 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fd6850-a02c-4992-b591-9c71b023295f None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:23.934269 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 149/309] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Aug 18 21:41:23 2022] GET /identity/v3/users/2461f47edb4b40359e57690c84a803e2 => generated 293 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:23.935337 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc4cdc1-29dc-41a5-a7be-a080e1a8ff09 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:23.935614 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc4cdc1-29dc-41a5-a7be-a080e1a8ff09 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:23.936681 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc4cdc1-29dc-41a5-a7be-a080e1a8ff09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:23.939592 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7818f4e0-f413-485f-98e8-61c6fc2e6f4d None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:23.960009 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-1fc4cdc1-29dc-41a5-a7be-a080e1a8ff09 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:41:23.961294 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-1fc4cdc1-29dc-41a5-a7be-a080e1a8ff09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:41:23.975592 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b5097e-5f18-40b6-9f69-ef56af359611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:23.976201 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b5097e-5f18-40b6-9f69-ef56af359611 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:23.976479 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b5097e-5f18-40b6-9f69-ef56af359611 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:23.976780 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b5097e-5f18-40b6-9f69-ef56af359611 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:23.977506 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b5097e-5f18-40b6-9f69-ef56af359611 None admin] RBAC: Adding query filter params (role.id=a1ecfacad5ac443db590b35c86cd49e2, user.id=04b4bc9b131a46a1b341aa8f0e595d9f, scope.system=all) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:41:23.977909 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b5097e-5f18-40b6-9f69-ef56af359611 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:23.979232 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b5097e-5f18-40b6-9f69-ef56af359611 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:23.985428 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 161/310] 10.222.0.27 () {56 vars in 1308 bytes} [Thu Aug 18 21:41:23 2022] GET /identity/v3/role_assignments?user.id=04b4bc9b131a46a1b341aa8f0e595d9f&scope.system=all&role.id=a1ecfacad5ac443db590b35c86cd49e2 => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:23.985918 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b5097e-5f18-40b6-9f69-ef56af359611 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:24.041441 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 150/311] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:41:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 21:41:24.131743 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b5097e-5f18-40b6-9f69-ef56af359611 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:24.160932 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:24.169402 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050b85bf-61da-40de-b609-b6728f4ee14c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:24.170058 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050b85bf-61da-40de-b609-b6728f4ee14c None admin] REQUEST_METHOD: `PUT` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:24.170335 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050b85bf-61da-40de-b609-b6728f4ee14c None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:24.170610 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050b85bf-61da-40de-b609-b6728f4ee14c None admin] PATH_INFO: `/v3/system/users/2461f47edb4b40359e57690c84a803e2/roles/de8f2438056f4af9879423f8a59e0e0b` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:24.172755 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050b85bf-61da-40de-b609-b6728f4ee14c None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=2461f47edb4b40359e57690c84a803e2, role_id=de8f2438056f4af9879423f8a59e0e0b)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:24.174353 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050b85bf-61da-40de-b609-b6728f4ee14c None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:24.289745 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 162/312] 10.222.0.27 () {58 vars in 1334 bytes} [Thu Aug 18 21:41:23 2022] PUT /identity/v3/system/users/2461f47edb4b40359e57690c84a803e2/roles/de8f2438056f4af9879423f8a59e0e0b => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:41:24.342855 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc4cdc1-29dc-41a5-a7be-a080e1a8ff09 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:24.399173 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:24.458544 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc4cdc1-29dc-41a5-a7be-a080e1a8ff09 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:24.494098 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd76aff8-26c2-4909-ae64-8613a2b558e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:24.494722 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd76aff8-26c2-4909-ae64-8613a2b558e5 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:24.494998 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd76aff8-26c2-4909-ae64-8613a2b558e5 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:24.495269 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd76aff8-26c2-4909-ae64-8613a2b558e5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:24.505888 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd76aff8-26c2-4909-ae64-8613a2b558e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:41:24.510626 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application [None req-bd76aff8-26c2-4909-ae64-8613a2b558e5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 21:41:24.510626 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:41:24.510626 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:41:24.510626 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:41:24.510626 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:41:24.510626 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:41:24.510626 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:41:24.510626 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:41:24.510626 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:41:24.510626 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:41:24.510626 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:41:24.510626 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:41:24.510626 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:41:24.510626 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:41:24.510626 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:41:24.510626 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:41:24.511489 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:41:24.511489 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:41:24.511489 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:41:24.511489 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:41:24.511489 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:41:24.511489 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:41:24.511489 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:41:24.511489 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:41:24.511489 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:41:24.511489 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:41:24.511489 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:41:24.511489 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application with Lock( Aug 18 21:41:24.511489 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:41:24.511489 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:41:24.511489 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:41:24.511489 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:41:24.512674 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:41:24.512674 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:41:24.512674 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:41:24.512674 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:41:24.512674 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:41:24.512674 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:41:24.512674 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:41:24.512674 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:41:24.512674 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:41:24.512674 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:41:24.512674 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 21:41:24.512674 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:41:24.512674 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 151/313] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Aug 18 21:41:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:41:24.518641 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050b85bf-61da-40de-b609-b6728f4ee14c None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:24.622342 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050b85bf-61da-40de-b609-b6728f4ee14c None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:24.657741 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6add27c5-6b72-4a1d-bdee-8289820fa61e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:24.658358 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6add27c5-6b72-4a1d-bdee-8289820fa61e None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:24.658634 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6add27c5-6b72-4a1d-bdee-8289820fa61e None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:24.658901 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6add27c5-6b72-4a1d-bdee-8289820fa61e None admin] PATH_INFO: `/v3/roles` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:24.659568 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6add27c5-6b72-4a1d-bdee-8289820fa61e None admin] RBAC: Adding query filter params (name=reader) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:41:24.659865 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6add27c5-6b72-4a1d-bdee-8289820fa61e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:24.661311 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6add27c5-6b72-4a1d-bdee-8289820fa61e None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:24.669858 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 163/314] 10.222.0.27 () {56 vars in 1101 bytes} [Thu Aug 18 21:41:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:24.676204 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd76aff8-26c2-4909-ae64-8613a2b558e5 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:24.779783 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd76aff8-26c2-4909-ae64-8613a2b558e5 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:24.789670 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:24.818502 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd0125b-b1f2-43b2-bdb1-e9f08041b7b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:24.819144 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd0125b-b1f2-43b2-bdb1-e9f08041b7b8 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:24.819464 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd0125b-b1f2-43b2-bdb1-e9f08041b7b8 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:24.819740 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd0125b-b1f2-43b2-bdb1-e9f08041b7b8 None admin] PATH_INFO: `/v3/users/248e9f37b096409dba1f78636add31a4` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:24.820933 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd0125b-b1f2-43b2-bdb1-e9f08041b7b8 None admin] RBAC: Authorizing `identity:get_user(user_id=248e9f37b096409dba1f78636add31a4)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:24.822396 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd0125b-b1f2-43b2-bdb1-e9f08041b7b8 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:24.824455 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 152/315] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Aug 18 21:41:24 2022] GET /identity/v3/users/248e9f37b096409dba1f78636add31a4 => generated 297 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:24.829856 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6add27c5-6b72-4a1d-bdee-8289820fa61e None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:24.884927 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:24.936484 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6add27c5-6b72-4a1d-bdee-8289820fa61e None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:24.971020 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e36c4af-f9b3-4a10-af9b-e5fbeb298f6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:24.971637 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e36c4af-f9b3-4a10-af9b-e5fbeb298f6d None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:24.971913 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e36c4af-f9b3-4a10-af9b-e5fbeb298f6d None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:24.972179 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e36c4af-f9b3-4a10-af9b-e5fbeb298f6d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:25.043127 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e36c4af-f9b3-4a10-af9b-e5fbeb298f6d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:25.044526 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e36c4af-f9b3-4a10-af9b-e5fbeb298f6d None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:25.096505 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:25.147241 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 164/316] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Aug 18 21:41:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 21:41:25.152776 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd0125b-b1f2-43b2-bdb1-e9f08041b7b8 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:25.258656 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd0125b-b1f2-43b2-bdb1-e9f08041b7b8 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:25.297434 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06879d21-1a1b-4c4a-9fd5-5c65d7aa7013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:25.298005 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06879d21-1a1b-4c4a-9fd5-5c65d7aa7013 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:25.298284 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06879d21-1a1b-4c4a-9fd5-5c65d7aa7013 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:25.298559 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06879d21-1a1b-4c4a-9fd5-5c65d7aa7013 None admin] PATH_INFO: `/v3/projects/5cfc98a315f14e00a8cddaa2c57a9da6` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:25.299750 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06879d21-1a1b-4c4a-9fd5-5c65d7aa7013 None admin] RBAC: Authorizing `identity:get_project(project_id=5cfc98a315f14e00a8cddaa2c57a9da6)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:25.301232 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06879d21-1a1b-4c4a-9fd5-5c65d7aa7013 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:25.303178 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 153/317] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Aug 18 21:41:25 2022] GET /identity/v3/projects/5cfc98a315f14e00a8cddaa2c57a9da6 => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:25.309971 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e36c4af-f9b3-4a10-af9b-e5fbeb298f6d None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:25.418756 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e36c4af-f9b3-4a10-af9b-e5fbeb298f6d None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:25.456058 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef62e72-9881-45cb-94ee-b8f06719465a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:25.456693 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef62e72-9881-45cb-94ee-b8f06719465a None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:25.456978 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef62e72-9881-45cb-94ee-b8f06719465a None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:25.457237 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef62e72-9881-45cb-94ee-b8f06719465a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:25.457951 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef62e72-9881-45cb-94ee-b8f06719465a None admin] RBAC: Adding query filter params (role.id=a1ecfacad5ac443db590b35c86cd49e2, scope.project.id=5cfc98a315f14e00a8cddaa2c57a9da6, user.id=248e9f37b096409dba1f78636add31a4) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:41:25.458251 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef62e72-9881-45cb-94ee-b8f06719465a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:25.459681 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef62e72-9881-45cb-94ee-b8f06719465a None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:25.465971 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 165/318] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Aug 18 21:41:25 2022] GET /identity/v3/role_assignments?user.id=248e9f37b096409dba1f78636add31a4&scope.project.id=5cfc98a315f14e00a8cddaa2c57a9da6&role.id=a1ecfacad5ac443db590b35c86cd49e2 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:25.778686 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fdb2e0-3385-49a1-93f8-d1d6f93303a0 None None] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:25.779077 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fdb2e0-3385-49a1-93f8-d1d6f93303a0 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:25.779419 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fdb2e0-3385-49a1-93f8-d1d6f93303a0 None None] PATH_INFO: `/` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:25.780897 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 154/319] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:41:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:41:25.787201 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aba6b9-2ce5-43f5-8fb7-552d20020282 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:25.787490 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aba6b9-2ce5-43f5-8fb7-552d20020282 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:25.787762 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aba6b9-2ce5-43f5-8fb7-552d20020282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:25.806840 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-40aba6b9-2ce5-43f5-8fb7-552d20020282 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:41:25.808032 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-40aba6b9-2ce5-43f5-8fb7-552d20020282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:41:25.819865 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:25.876683 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 166/320] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:41:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 21:41:25.948971 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bef974a-d40b-4f82-8c12-4cd2736431f8 None None] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:25.949318 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bef974a-d40b-4f82-8c12-4cd2736431f8 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:25.949523 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bef974a-d40b-4f82-8c12-4cd2736431f8 None None] PATH_INFO: `/` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:25.950988 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 155/321] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:41:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:41:25.956510 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed91ab4-9090-42b7-a82f-1fa5f9343107 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:25.957036 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed91ab4-9090-42b7-a82f-1fa5f9343107 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:25.957110 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed91ab4-9090-42b7-a82f-1fa5f9343107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:25.975799 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-7ed91ab4-9090-42b7-a82f-1fa5f9343107 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:41:25.977277 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-7ed91ab4-9090-42b7-a82f-1fa5f9343107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:41:26.044302 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 167/322] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:41:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 21:41:26.149520 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bef974a-d40b-4f82-8c12-4cd2736431f8 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:26.200006 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:26.254676 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bef974a-d40b-4f82-8c12-4cd2736431f8 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:26.294423 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba16e41d-82e4-49ff-8cc4-cac52848d8a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:26.294993 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba16e41d-82e4-49ff-8cc4-cac52848d8a9 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:26.295268 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba16e41d-82e4-49ff-8cc4-cac52848d8a9 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:26.295535 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba16e41d-82e4-49ff-8cc4-cac52848d8a9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:26.297242 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba16e41d-82e4-49ff-8cc4-cac52848d8a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:26.298687 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba16e41d-82e4-49ff-8cc4-cac52848d8a9 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:26.300408 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 156/323] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 18 21:41:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:26.305843 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed91ab4-9090-42b7-a82f-1fa5f9343107 None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:26.324194 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba16e41d-82e4-49ff-8cc4-cac52848d8a9 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:26.385532 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:26.409153 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed91ab4-9090-42b7-a82f-1fa5f9343107 None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:26.424209 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba16e41d-82e4-49ff-8cc4-cac52848d8a9 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:26.436883 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:26.443328 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065bc075-ba47-4102-98bb-a5b3118ab277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:26.443928 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065bc075-ba47-4102-98bb-a5b3118ab277 None admin] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:26.444201 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065bc075-ba47-4102-98bb-a5b3118ab277 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:26.444467 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065bc075-ba47-4102-98bb-a5b3118ab277 None admin] PATH_INFO: `/v3/groups` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:26.445159 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065bc075-ba47-4102-98bb-a5b3118ab277 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:26.446574 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065bc075-ba47-4102-98bb-a5b3118ab277 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:26.458571 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb290e6f-e710-46ce-b398-9f5dc47fc565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:26.459192 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb290e6f-e710-46ce-b398-9f5dc47fc565 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:26.459469 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb290e6f-e710-46ce-b398-9f5dc47fc565 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:26.459737 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb290e6f-e710-46ce-b398-9f5dc47fc565 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:26.469523 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb290e6f-e710-46ce-b398-9f5dc47fc565 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:41:26.474594 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application [None req-eb290e6f-e710-46ce-b398-9f5dc47fc565 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 21:41:26.474594 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:41:26.474594 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:41:26.474594 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:41:26.474594 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:41:26.474594 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:41:26.474594 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:41:26.474594 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:41:26.474594 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:41:26.474594 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:41:26.474594 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:41:26.474594 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:41:26.474594 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:41:26.474594 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:41:26.474594 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:41:26.474594 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:41:26.475450 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:41:26.475450 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:41:26.475450 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:41:26.475450 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:41:26.475450 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:41:26.475450 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:41:26.475450 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:41:26.475450 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:41:26.475450 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:41:26.475450 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:41:26.475450 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:41:26.475450 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application with Lock( Aug 18 21:41:26.475450 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:41:26.475450 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:41:26.475450 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:41:26.475450 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:41:26.476284 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:41:26.476284 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:41:26.476284 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:41:26.476284 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:41:26.476284 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:41:26.476284 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:41:26.476284 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:41:26.476284 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:41:26.476284 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:41:26.476284 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:41:26.476284 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 21:41:26.476284 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:41:26.476284 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 157/324] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Aug 18 21:41:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 21:41:26.477277 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9e257d-cca1-4814-94c1-729ea601c050 None None] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:26.477557 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9e257d-cca1-4814-94c1-729ea601c050 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:26.477817 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9e257d-cca1-4814-94c1-729ea601c050 None None] PATH_INFO: `/` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:26.479622 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 158/325] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:41:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:41:26.481670 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9e257d-cca1-4814-94c1-729ea601c050 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:26.574876 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 168/326] 10.222.0.27 () {60 vars in 1134 bytes} [Thu Aug 18 21:41:26 2022] POST /identity/v3/groups => generated 226 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:41:26.574876 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86210075-f543-4866-a146-75743fc6ff1f None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:26.574876 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86210075-f543-4866-a146-75743fc6ff1f None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:26.574876 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86210075-f543-4866-a146-75743fc6ff1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:26.583008 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-86210075-f543-4866-a146-75743fc6ff1f None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:41:26.584298 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-86210075-f543-4866-a146-75743fc6ff1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:41:26.587739 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9e257d-cca1-4814-94c1-729ea601c050 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:26.629517 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d0ee9e-2c1f-44f2-b4f0-9718baf7eaf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:26.630139 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d0ee9e-2c1f-44f2-b4f0-9718baf7eaf7 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:26.630419 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d0ee9e-2c1f-44f2-b4f0-9718baf7eaf7 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:26.630699 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d0ee9e-2c1f-44f2-b4f0-9718baf7eaf7 None admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:26.631424 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d0ee9e-2c1f-44f2-b4f0-9718baf7eaf7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:41:26.631734 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d0ee9e-2c1f-44f2-b4f0-9718baf7eaf7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:26.633248 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d0ee9e-2c1f-44f2-b4f0-9718baf7eaf7 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:26.646709 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 159/327] 10.222.0.27 () {56 vars in 1101 bytes} [Thu Aug 18 21:41:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 21:41:26.652914 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d0ee9e-2c1f-44f2-b4f0-9718baf7eaf7 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:26.661345 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 169/328] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:41:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 21:41:26.691892 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:26.761614 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d0ee9e-2c1f-44f2-b4f0-9718baf7eaf7 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:26.798482 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad813bb2-2a54-4a10-9574-e03c5e12f0bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:26.799211 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad813bb2-2a54-4a10-9574-e03c5e12f0bf None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:26.799418 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad813bb2-2a54-4a10-9574-e03c5e12f0bf None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:26.799693 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad813bb2-2a54-4a10-9574-e03c5e12f0bf None admin] PATH_INFO: `/v3/users/04b4bc9b131a46a1b341aa8f0e595d9f` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:26.800890 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad813bb2-2a54-4a10-9574-e03c5e12f0bf None admin] RBAC: Authorizing `identity:get_user(user_id=04b4bc9b131a46a1b341aa8f0e595d9f)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:26.802346 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad813bb2-2a54-4a10-9574-e03c5e12f0bf None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:26.804106 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 160/329] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Aug 18 21:41:26 2022] GET /identity/v3/users/04b4bc9b131a46a1b341aa8f0e595d9f => generated 293 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:26.809632 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86210075-f543-4866-a146-75743fc6ff1f None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:26.882019 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:26.923636 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86210075-f543-4866-a146-75743fc6ff1f None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:26.941676 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad813bb2-2a54-4a10-9574-e03c5e12f0bf None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:26.965189 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac95499-191a-401f-ba1f-1d5a28e46c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:26.966570 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac95499-191a-401f-ba1f-1d5a28e46c93 None admin] REQUEST_METHOD: `PUT` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:26.967047 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac95499-191a-401f-ba1f-1d5a28e46c93 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:26.967476 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac95499-191a-401f-ba1f-1d5a28e46c93 None admin] PATH_INFO: `/v3/system/users/04b4bc9b131a46a1b341aa8f0e595d9f/roles/a1ecfacad5ac443db590b35c86cd49e2` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:26.969604 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac95499-191a-401f-ba1f-1d5a28e46c93 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=04b4bc9b131a46a1b341aa8f0e595d9f, role_id=a1ecfacad5ac443db590b35c86cd49e2)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:26.971037 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac95499-191a-401f-ba1f-1d5a28e46c93 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:27.043659 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 170/330] 10.222.0.27 () {58 vars in 1334 bytes} [Thu Aug 18 21:41:26 2022] PUT /identity/v3/system/users/04b4bc9b131a46a1b341aa8f0e595d9f/roles/a1ecfacad5ac443db590b35c86cd49e2 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:41:27.058707 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad813bb2-2a54-4a10-9574-e03c5e12f0bf None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:27.061139 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:27.102324 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbcb706-c61b-4a24-b2fd-b2d78e53886a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:27.102970 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbcb706-c61b-4a24-b2fd-b2d78e53886a None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:27.103248 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbcb706-c61b-4a24-b2fd-b2d78e53886a None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:27.103517 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbcb706-c61b-4a24-b2fd-b2d78e53886a None admin] PATH_INFO: `/v3/roles/member` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:27.117385 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbcb706-c61b-4a24-b2fd-b2d78e53886a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:41:27.122916 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application [None req-dbbcb706-c61b-4a24-b2fd-b2d78e53886a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 21:41:27.122916 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:41:27.122916 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:41:27.122916 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:41:27.122916 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:41:27.122916 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:41:27.122916 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:41:27.122916 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:41:27.122916 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:41:27.122916 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:41:27.122916 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:41:27.122916 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:41:27.122916 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:41:27.122916 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:41:27.122916 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:41:27.122916 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:41:27.123861 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:41:27.123861 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:41:27.123861 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:41:27.123861 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:41:27.123861 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:41:27.123861 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:41:27.123861 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:41:27.123861 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:41:27.123861 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:41:27.123861 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:41:27.123861 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:41:27.123861 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application with Lock( Aug 18 21:41:27.123861 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:41:27.123861 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:41:27.123861 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:41:27.123861 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:41:27.126019 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:41:27.126019 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:41:27.126019 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:41:27.126019 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:41:27.126019 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:41:27.126019 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:41:27.126019 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:41:27.126019 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:41:27.126019 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:41:27.126019 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:41:27.126019 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 21:41:27.126019 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:41:27.126019 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 161/331] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Aug 18 21:41:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 21:41:27.130840 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac95499-191a-401f-ba1f-1d5a28e46c93 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:27.251273 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac95499-191a-401f-ba1f-1d5a28e46c93 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:27.284064 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:27.293264 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1121f7f-3003-44fb-b37e-6ba6ba89b543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:27.298942 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1121f7f-3003-44fb-b37e-6ba6ba89b543 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:27.298942 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1121f7f-3003-44fb-b37e-6ba6ba89b543 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:27.298942 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1121f7f-3003-44fb-b37e-6ba6ba89b543 None admin] PATH_INFO: `/v3/roles` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:27.298942 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1121f7f-3003-44fb-b37e-6ba6ba89b543 None admin] RBAC: Adding query filter params (name=member) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:41:27.298942 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1121f7f-3003-44fb-b37e-6ba6ba89b543 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:27.298942 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1121f7f-3003-44fb-b37e-6ba6ba89b543 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:27.310790 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 171/332] 10.222.0.27 () {56 vars in 1101 bytes} [Thu Aug 18 21:41:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:27.317211 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbcb706-c61b-4a24-b2fd-b2d78e53886a None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:27.446505 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbcb706-c61b-4a24-b2fd-b2d78e53886a None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:27.487752 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54472f13-cad7-4aa7-953c-50fed17ae3b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:27.488390 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54472f13-cad7-4aa7-953c-50fed17ae3b7 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:27.488698 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54472f13-cad7-4aa7-953c-50fed17ae3b7 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:27.488974 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54472f13-cad7-4aa7-953c-50fed17ae3b7 None admin] PATH_INFO: `/v3/users/2461f47edb4b40359e57690c84a803e2` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:27.490127 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54472f13-cad7-4aa7-953c-50fed17ae3b7 None admin] RBAC: Authorizing `identity:get_user(user_id=2461f47edb4b40359e57690c84a803e2)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:27.491574 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54472f13-cad7-4aa7-953c-50fed17ae3b7 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:27.493550 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 162/333] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Aug 18 21:41:27 2022] GET /identity/v3/users/2461f47edb4b40359e57690c84a803e2 => generated 293 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:27.501985 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1121f7f-3003-44fb-b37e-6ba6ba89b543 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:27.617544 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1121f7f-3003-44fb-b37e-6ba6ba89b543 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:27.663810 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a13003-4125-4575-a2f6-e7acbd1d906e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:27.664426 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a13003-4125-4575-a2f6-e7acbd1d906e None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:27.664732 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a13003-4125-4575-a2f6-e7acbd1d906e None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:27.665010 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a13003-4125-4575-a2f6-e7acbd1d906e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:27.665738 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a13003-4125-4575-a2f6-e7acbd1d906e None admin] RBAC: Adding query filter params (role.id=de8f2438056f4af9879423f8a59e0e0b, user.id=2461f47edb4b40359e57690c84a803e2, scope.system=all) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:41:27.666048 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a13003-4125-4575-a2f6-e7acbd1d906e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:27.667485 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a13003-4125-4575-a2f6-e7acbd1d906e None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:27.683638 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 172/334] 10.222.0.27 () {56 vars in 1308 bytes} [Thu Aug 18 21:41:27 2022] GET /identity/v3/role_assignments?user.id=2461f47edb4b40359e57690c84a803e2&scope.system=all&role.id=de8f2438056f4af9879423f8a59e0e0b => generated 510 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:28.886635 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5515058a-0d1e-4f50-b416-828ee81a8394 None None] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:28.887147 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5515058a-0d1e-4f50-b416-828ee81a8394 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:28.887412 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5515058a-0d1e-4f50-b416-828ee81a8394 None None] PATH_INFO: `/` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:28.888894 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 163/335] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:41:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:41:28.894762 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a94599-67d2-4633-b5f1-b28e4b5a358b None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:28.895185 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a94599-67d2-4633-b5f1-b28e4b5a358b None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:28.895360 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a94599-67d2-4633-b5f1-b28e4b5a358b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:28.918764 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-45a94599-67d2-4633-b5f1-b28e4b5a358b None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:41:28.919981 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-45a94599-67d2-4633-b5f1-b28e4b5a358b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:41:28.973818 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:28.998103 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 173/336] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:41:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 21:41:29.459606 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4996c26e-4fed-4f0d-be06-d4eb6918e433 None None] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:29.460279 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4996c26e-4fed-4f0d-be06-d4eb6918e433 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:29.460814 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4996c26e-4fed-4f0d-be06-d4eb6918e433 None None] PATH_INFO: `/` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:29.462630 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 164/337] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:41:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:41:29.467401 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdd773d-76a9-412c-88f0-7d826e3a8777 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:29.467902 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdd773d-76a9-412c-88f0-7d826e3a8777 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:29.468391 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdd773d-76a9-412c-88f0-7d826e3a8777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:29.489141 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-2cdd773d-76a9-412c-88f0-7d826e3a8777 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:41:29.490659 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-2cdd773d-76a9-412c-88f0-7d826e3a8777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:41:29.563188 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4996c26e-4fed-4f0d-be06-d4eb6918e433 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:29.572886 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 174/338] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:41:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 21:41:29.616130 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:29.714335 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4996c26e-4fed-4f0d-be06-d4eb6918e433 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:29.754193 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bce878-e3c8-44b5-9ae5-b6d6bf3879a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:29.755225 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bce878-e3c8-44b5-9ae5-b6d6bf3879a2 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:29.755722 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bce878-e3c8-44b5-9ae5-b6d6bf3879a2 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:29.756231 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bce878-e3c8-44b5-9ae5-b6d6bf3879a2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:29.767556 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bce878-e3c8-44b5-9ae5-b6d6bf3879a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:41:29.772619 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application [None req-77bce878-e3c8-44b5-9ae5-b6d6bf3879a2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 21:41:29.772619 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:41:29.772619 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:41:29.772619 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:41:29.772619 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:41:29.772619 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:41:29.772619 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:41:29.772619 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:41:29.772619 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:41:29.772619 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:41:29.772619 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:41:29.772619 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:41:29.772619 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:41:29.772619 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:41:29.772619 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:41:29.772619 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:41:29.773464 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:41:29.773464 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:41:29.773464 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:41:29.773464 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:41:29.773464 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:41:29.773464 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:41:29.773464 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:41:29.773464 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:41:29.773464 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:41:29.773464 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:41:29.773464 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:41:29.773464 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application with Lock( Aug 18 21:41:29.773464 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:41:29.773464 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:41:29.773464 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:41:29.773464 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:41:29.774268 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:41:29.774268 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:41:29.774268 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:41:29.774268 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:41:29.774268 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:41:29.774268 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:41:29.774268 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:41:29.774268 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:41:29.774268 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:41:29.774268 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:41:29.774268 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 21:41:29.774268 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:41:29.776514 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 165/339] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Aug 18 21:41:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 21:41:29.786090 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdd773d-76a9-412c-88f0-7d826e3a8777 None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:29.891036 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9d01b9-7542-45e4-8a8b-9a6c303d3f67 None None] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:29.892271 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9d01b9-7542-45e4-8a8b-9a6c303d3f67 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:29.892783 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9d01b9-7542-45e4-8a8b-9a6c303d3f67 None None] PATH_INFO: `/` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:29.894313 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 166/340] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:41:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 21:41:29.899496 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f63b574-964b-40e0-8650-ef009f69aaaf None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:29.899775 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f63b574-964b-40e0-8650-ef009f69aaaf None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:29.900047 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f63b574-964b-40e0-8650-ef009f69aaaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:29.936932 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdd773d-76a9-412c-88f0-7d826e3a8777 None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:29.940740 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-5f63b574-964b-40e0-8650-ef009f69aaaf None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:41:29.942996 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-5f63b574-964b-40e0-8650-ef009f69aaaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:41:29.964652 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:30.024644 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51a74c3-e142-4581-958a-cbcc735385a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:30.027300 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51a74c3-e142-4581-958a-cbcc735385a9 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:30.027587 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51a74c3-e142-4581-958a-cbcc735385a9 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:30.027862 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51a74c3-e142-4581-958a-cbcc735385a9 None admin] PATH_INFO: `/v3/roles` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:30.028538 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51a74c3-e142-4581-958a-cbcc735385a9 None admin] RBAC: Adding query filter params (name=member) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:41:30.028898 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51a74c3-e142-4581-958a-cbcc735385a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:30.030272 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51a74c3-e142-4581-958a-cbcc735385a9 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:30.053860 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 175/341] 10.222.0.27 () {56 vars in 1101 bytes} [Thu Aug 18 21:41:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:30.055204 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c012f7-b660-482b-bbb8-8413c224df2e None None] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:30.055495 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c012f7-b660-482b-bbb8-8413c224df2e None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:30.055773 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c012f7-b660-482b-bbb8-8413c224df2e None None] PATH_INFO: `/` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:30.057440 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 176/342] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:41:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:41:30.060810 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c012f7-b660-482b-bbb8-8413c224df2e None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:30.108572 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 167/343] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:41:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 21:41:30.112099 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f621b331-db8a-4995-a7c2-20763b26652d None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:30.112379 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f621b331-db8a-4995-a7c2-20763b26652d None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:30.112675 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f621b331-db8a-4995-a7c2-20763b26652d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:30.138529 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-f621b331-db8a-4995-a7c2-20763b26652d None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:41:30.140069 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-f621b331-db8a-4995-a7c2-20763b26652d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:41:30.162437 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:30.221318 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c012f7-b660-482b-bbb8-8413c224df2e None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:30.241702 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 168/344] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:41:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 21:41:30.243557 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f621b331-db8a-4995-a7c2-20763b26652d None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:30.298853 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfc41dd-e0e7-408c-af0a-3fd6f88b2df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:30.299478 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfc41dd-e0e7-408c-af0a-3fd6f88b2df1 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:30.299764 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfc41dd-e0e7-408c-af0a-3fd6f88b2df1 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:30.300842 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfc41dd-e0e7-408c-af0a-3fd6f88b2df1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:30.393138 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:30.442951 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfc41dd-e0e7-408c-af0a-3fd6f88b2df1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:30.444334 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfc41dd-e0e7-408c-af0a-3fd6f88b2df1 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:30.460842 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f621b331-db8a-4995-a7c2-20763b26652d None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:30.553502 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4e4b4f-7048-45bd-b19d-c792608884f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:30.554141 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4e4b4f-7048-45bd-b19d-c792608884f0 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:30.554419 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4e4b4f-7048-45bd-b19d-c792608884f0 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:30.554694 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4e4b4f-7048-45bd-b19d-c792608884f0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:30.575020 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4e4b4f-7048-45bd-b19d-c792608884f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:41:30.580957 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application [None req-0f4e4b4f-7048-45bd-b19d-c792608884f0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 21:41:30.580957 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:41:30.580957 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:41:30.580957 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:41:30.580957 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:41:30.580957 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:41:30.580957 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:41:30.580957 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:41:30.580957 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:41:30.580957 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:41:30.580957 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:41:30.580957 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:41:30.580957 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:41:30.580957 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:41:30.580957 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:41:30.580957 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:41:30.581891 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:41:30.581891 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:41:30.581891 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:41:30.581891 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:41:30.581891 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:41:30.581891 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:41:30.581891 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:41:30.581891 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:41:30.581891 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:41:30.581891 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:41:30.581891 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:41:30.581891 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application with Lock( Aug 18 21:41:30.581891 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:41:30.581891 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:41:30.581891 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:41:30.581891 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:41:30.583381 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:41:30.583381 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:41:30.583381 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:41:30.583381 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:41:30.583381 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:41:30.583381 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:41:30.583381 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:41:30.583381 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:41:30.583381 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:41:30.583381 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:41:30.583381 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 21:41:30.583381 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:41:30.583381 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 169/345] 10.222.0.27 () {56 vars in 1114 bytes} [Thu Aug 18 21:41:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:41:30.583381 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4e4b4f-7048-45bd-b19d-c792608884f0 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:30.609062 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 177/346] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Aug 18 21:41:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 548 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 21:41:30.610814 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfc41dd-e0e7-408c-af0a-3fd6f88b2df1 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:30.618178 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:30.708387 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:30.733067 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4e4b4f-7048-45bd-b19d-c792608884f0 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:30.740295 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfc41dd-e0e7-408c-af0a-3fd6f88b2df1 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:30.782436 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4de9b88-8d70-466b-8a53-bde4fd403136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:30.783044 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4de9b88-8d70-466b-8a53-bde4fd403136 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:30.783322 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4de9b88-8d70-466b-8a53-bde4fd403136 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:30.783748 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4de9b88-8d70-466b-8a53-bde4fd403136 None admin] PATH_INFO: `/v3/roles` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:30.784421 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4de9b88-8d70-466b-8a53-bde4fd403136 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:41:30.784528 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96845d50-c2df-4d89-a185-ae63ea591f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:30.784816 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4de9b88-8d70-466b-8a53-bde4fd403136 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:30.785140 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96845d50-c2df-4d89-a185-ae63ea591f88 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:30.785413 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96845d50-c2df-4d89-a185-ae63ea591f88 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:30.785681 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96845d50-c2df-4d89-a185-ae63ea591f88 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:30.786094 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4de9b88-8d70-466b-8a53-bde4fd403136 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:30.796243 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 178/347] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Aug 18 21:41:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:30.797773 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4de9b88-8d70-466b-8a53-bde4fd403136 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:30.799905 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96845d50-c2df-4d89-a185-ae63ea591f88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:41:30.805093 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application [None req-96845d50-c2df-4d89-a185-ae63ea591f88 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 21:41:30.805093 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:41:30.805093 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:41:30.805093 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:41:30.805093 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:41:30.805093 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:41:30.805093 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:41:30.805093 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:41:30.805093 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:41:30.805093 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:41:30.805093 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:41:30.805093 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:41:30.805093 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:41:30.805093 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:41:30.805093 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:41:30.805093 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:41:30.806289 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:41:30.806289 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:41:30.806289 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:41:30.806289 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:41:30.806289 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:41:30.806289 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:41:30.806289 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:41:30.806289 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:41:30.806289 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:41:30.806289 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:41:30.806289 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:41:30.806289 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application with Lock( Aug 18 21:41:30.806289 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:41:30.806289 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:41:30.806289 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:41:30.806289 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:41:30.807266 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:41:30.807266 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:41:30.807266 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:41:30.807266 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:41:30.807266 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:41:30.807266 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:41:30.807266 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:41:30.807266 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:41:30.807266 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:41:30.807266 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:41:30.807266 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 21:41:30.807266 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:41:30.807266 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 170/348] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Aug 18 21:41:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:41:30.808104 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbde4123-36fa-4b5f-a4bd-761488570aa6 None None] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:30.808104 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbde4123-36fa-4b5f-a4bd-761488570aa6 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:30.808104 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbde4123-36fa-4b5f-a4bd-761488570aa6 None None] PATH_INFO: `/` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:30.809870 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 171/349] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:41:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:41:30.810573 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbde4123-36fa-4b5f-a4bd-761488570aa6 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:30.908146 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:30.927567 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4de9b88-8d70-466b-8a53-bde4fd403136 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:30.955967 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbde4123-36fa-4b5f-a4bd-761488570aa6 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:30.970664 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a11f150-d69b-4ad1-9dae-03424dace4d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:30.971516 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a11f150-d69b-4ad1-9dae-03424dace4d4 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:30.971798 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a11f150-d69b-4ad1-9dae-03424dace4d4 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:30.972076 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a11f150-d69b-4ad1-9dae-03424dace4d4 None admin] PATH_INFO: `/v3/projects/e475732a8fb6447b8d2ccca84af2071a` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:30.974380 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a11f150-d69b-4ad1-9dae-03424dace4d4 None admin] RBAC: Authorizing `identity:get_project(project_id=e475732a8fb6447b8d2ccca84af2071a)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:30.974686 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a11f150-d69b-4ad1-9dae-03424dace4d4 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:30.976314 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 179/350] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Aug 18 21:41:30 2022] GET /identity/v3/projects/e475732a8fb6447b8d2ccca84af2071a => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:30.981585 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a11f150-d69b-4ad1-9dae-03424dace4d4 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:30.985910 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:31.009317 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021f6b2c-f9e9-49a2-bf63-50a1eef17f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:31.009958 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021f6b2c-f9e9-49a2-bf63-50a1eef17f41 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:31.010237 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021f6b2c-f9e9-49a2-bf63-50a1eef17f41 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:31.010510 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021f6b2c-f9e9-49a2-bf63-50a1eef17f41 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:31.030235 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021f6b2c-f9e9-49a2-bf63-50a1eef17f41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:41:31.036001 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application [None req-021f6b2c-f9e9-49a2-bf63-50a1eef17f41 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 21:41:31.036001 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:41:31.036001 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:41:31.036001 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:41:31.036001 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:41:31.036001 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:41:31.036001 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:41:31.036001 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:41:31.036001 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:41:31.036001 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:41:31.036001 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:41:31.036001 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:41:31.036001 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:41:31.036001 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:41:31.036001 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:41:31.036001 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:41:31.036943 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:41:31.036943 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:41:31.036943 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:41:31.036943 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:41:31.036943 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:41:31.036943 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:41:31.036943 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:41:31.036943 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:41:31.036943 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:41:31.036943 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:41:31.036943 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:41:31.036943 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application with Lock( Aug 18 21:41:31.036943 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:41:31.036943 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:41:31.036943 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:41:31.036943 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:41:31.037750 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:41:31.037750 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:41:31.037750 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:41:31.037750 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:41:31.037750 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:41:31.037750 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:41:31.037750 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:41:31.037750 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:41:31.037750 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:41:31.037750 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:41:31.037750 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 21:41:31.037750 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:41:31.037750 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 172/351] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Aug 18 21:41:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:41:31.038406 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021f6b2c-f9e9-49a2-bf63-50a1eef17f41 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:31.117483 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a11f150-d69b-4ad1-9dae-03424dace4d4 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:31.162581 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c4c707-bef4-4c2e-a658-e5ce3ddf4529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:31.163192 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c4c707-bef4-4c2e-a658-e5ce3ddf4529 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:31.163471 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c4c707-bef4-4c2e-a658-e5ce3ddf4529 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:31.163748 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c4c707-bef4-4c2e-a658-e5ce3ddf4529 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:31.174698 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021f6b2c-f9e9-49a2-bf63-50a1eef17f41 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:31.217875 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:31.229466 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca0f7bd-3346-4366-ad32-9a640f11b412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:31.229647 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca0f7bd-3346-4366-ad32-9a640f11b412 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:31.229872 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca0f7bd-3346-4366-ad32-9a640f11b412 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:31.230076 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca0f7bd-3346-4366-ad32-9a640f11b412 None admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:31.230857 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca0f7bd-3346-4366-ad32-9a640f11b412 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:41:31.231161 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca0f7bd-3346-4366-ad32-9a640f11b412 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:31.232547 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca0f7bd-3346-4366-ad32-9a640f11b412 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:31.243611 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 173/352] 10.222.0.27 () {56 vars in 1101 bytes} [Thu Aug 18 21:41:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:31.244647 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceeb180-f61f-415d-b8ee-f52088902fa4 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:31.244938 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceeb180-f61f-415d-b8ee-f52088902fa4 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:31.245212 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceeb180-f61f-415d-b8ee-f52088902fa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:31.253838 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c4c707-bef4-4c2e-a658-e5ce3ddf4529 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:31.255456 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c4c707-bef4-4c2e-a658-e5ce3ddf4529 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:31.263946 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:31.274274 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-2ceeb180-f61f-415d-b8ee-f52088902fa4 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:41:31.275776 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-2ceeb180-f61f-415d-b8ee-f52088902fa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:41:31.372655 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 174/353] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:41:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 21:41:31.372655 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceeb180-f61f-415d-b8ee-f52088902fa4 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:31.395420 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 180/354] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Aug 18 21:41:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 21:41:31.397363 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c4c707-bef4-4c2e-a658-e5ce3ddf4529 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:31.495848 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceeb180-f61f-415d-b8ee-f52088902fa4 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:31.525117 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c4c707-bef4-4c2e-a658-e5ce3ddf4529 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:31.526035 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:31.527585 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:31.548876 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62206ded-eed5-4083-b3b3-a9d9895df501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:31.549602 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62206ded-eed5-4083-b3b3-a9d9895df501 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:31.549949 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62206ded-eed5-4083-b3b3-a9d9895df501 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:31.550291 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62206ded-eed5-4083-b3b3-a9d9895df501 None admin] PATH_INFO: `/v3/groups/900265762daa4681948a01c6028fb33c` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:31.558118 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62206ded-eed5-4083-b3b3-a9d9895df501 None admin] RBAC: Authorizing `identity:get_group(group_id=900265762daa4681948a01c6028fb33c)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:31.559557 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62206ded-eed5-4083-b3b3-a9d9895df501 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:31.561193 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 175/355] 10.222.0.27 () {56 vars in 1180 bytes} [Thu Aug 18 21:41:31 2022] GET /identity/v3/groups/900265762daa4681948a01c6028fb33c => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:31.561946 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62206ded-eed5-4083-b3b3-a9d9895df501 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:31.570670 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95f49bc-6f03-4a65-ab5e-45e2013a1fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:31.571614 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95f49bc-6f03-4a65-ab5e-45e2013a1fda None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:31.571614 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95f49bc-6f03-4a65-ab5e-45e2013a1fda None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:31.571796 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95f49bc-6f03-4a65-ab5e-45e2013a1fda None admin] PATH_INFO: `/v3/roles` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:31.573438 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95f49bc-6f03-4a65-ab5e-45e2013a1fda None admin] RBAC: Adding query filter params (name=member) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:41:31.573438 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95f49bc-6f03-4a65-ab5e-45e2013a1fda None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:31.574479 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95f49bc-6f03-4a65-ab5e-45e2013a1fda None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:31.585662 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 181/356] 10.222.0.27 () {56 vars in 1101 bytes} [Thu Aug 18 21:41:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:31.591081 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95f49bc-6f03-4a65-ab5e-45e2013a1fda None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:31.683569 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62206ded-eed5-4083-b3b3-a9d9895df501 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:31.706706 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95f49bc-6f03-4a65-ab5e-45e2013a1fda None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:31.723688 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84bf3b7-f970-4f03-80ba-1738df018a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:31.724328 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84bf3b7-f970-4f03-80ba-1738df018a0d None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:31.724624 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84bf3b7-f970-4f03-80ba-1738df018a0d None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:31.724916 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84bf3b7-f970-4f03-80ba-1738df018a0d None admin] PATH_INFO: `/v3/users/04b4bc9b131a46a1b341aa8f0e595d9f` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:31.726055 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84bf3b7-f970-4f03-80ba-1738df018a0d None admin] RBAC: Authorizing `identity:get_user(user_id=04b4bc9b131a46a1b341aa8f0e595d9f)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:31.727508 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84bf3b7-f970-4f03-80ba-1738df018a0d None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:31.729460 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 176/357] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Aug 18 21:41:31 2022] GET /identity/v3/users/04b4bc9b131a46a1b341aa8f0e595d9f => generated 293 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:31.730608 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5f8033-fe50-416c-afa2-1f1333be8779 None None] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:31.730892 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5f8033-fe50-416c-afa2-1f1333be8779 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:31.731169 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5f8033-fe50-416c-afa2-1f1333be8779 None None] PATH_INFO: `/` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:31.732507 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 177/358] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:41:31 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:41:31.733086 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5f8033-fe50-416c-afa2-1f1333be8779 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:31.753405 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6722b30b-98dd-4a2c-b304-89a2d25c7796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:31.754009 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6722b30b-98dd-4a2c-b304-89a2d25c7796 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:31.754286 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6722b30b-98dd-4a2c-b304-89a2d25c7796 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:31.754558 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6722b30b-98dd-4a2c-b304-89a2d25c7796 None admin] PATH_INFO: `/v3/projects/e475732a8fb6447b8d2ccca84af2071a` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:31.755789 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6722b30b-98dd-4a2c-b304-89a2d25c7796 None admin] RBAC: Authorizing `identity:get_project(project_id=e475732a8fb6447b8d2ccca84af2071a)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:31.757277 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6722b30b-98dd-4a2c-b304-89a2d25c7796 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:31.759067 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 182/359] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Aug 18 21:41:31 2022] GET /identity/v3/projects/e475732a8fb6447b8d2ccca84af2071a => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:31.759672 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6722b30b-98dd-4a2c-b304-89a2d25c7796 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:31.799136 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:31.802109 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:31.859842 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5f8033-fe50-416c-afa2-1f1333be8779 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:31.879176 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6722b30b-98dd-4a2c-b304-89a2d25c7796 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:31.898840 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecd7c72-6d8e-43ac-b145-498edb8474fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:31.899445 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecd7c72-6d8e-43ac-b145-498edb8474fe None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:31.899722 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecd7c72-6d8e-43ac-b145-498edb8474fe None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:31.899996 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecd7c72-6d8e-43ac-b145-498edb8474fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:31.900751 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecd7c72-6d8e-43ac-b145-498edb8474fe None admin] RBAC: Adding query filter params (group.id=900265762daa4681948a01c6028fb33c, role.id=de8f2438056f4af9879423f8a59e0e0b, scope.project.id=e475732a8fb6447b8d2ccca84af2071a) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:41:31.901057 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecd7c72-6d8e-43ac-b145-498edb8474fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:31.902504 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecd7c72-6d8e-43ac-b145-498edb8474fe None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:31.909415 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 178/360] 10.222.0.27 () {56 vars in 1376 bytes} [Thu Aug 18 21:41:31 2022] GET /identity/v3/role_assignments?group.id=900265762daa4681948a01c6028fb33c&scope.project.id=e475732a8fb6447b8d2ccca84af2071a&role.id=de8f2438056f4af9879423f8a59e0e0b => generated 260 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:31.910837 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecd7c72-6d8e-43ac-b145-498edb8474fe None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:31.926212 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fcc5e2-e0c8-4edd-b10d-4a47936e292f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:31.926837 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fcc5e2-e0c8-4edd-b10d-4a47936e292f None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:31.927115 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fcc5e2-e0c8-4edd-b10d-4a47936e292f None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:31.927385 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fcc5e2-e0c8-4edd-b10d-4a47936e292f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:32.031978 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fcc5e2-e0c8-4edd-b10d-4a47936e292f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:32.033557 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fcc5e2-e0c8-4edd-b10d-4a47936e292f None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:32.050478 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecd7c72-6d8e-43ac-b145-498edb8474fe None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:32.072169 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:32.081332 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:32.091420 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9b1aa3-95fc-4adf-9dfe-9648ab9aa183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:32.092214 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9b1aa3-95fc-4adf-9dfe-9648ab9aa183 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:32.092652 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9b1aa3-95fc-4adf-9dfe-9648ab9aa183 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:32.093024 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9b1aa3-95fc-4adf-9dfe-9648ab9aa183 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:32.108817 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9b1aa3-95fc-4adf-9dfe-9648ab9aa183 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:41:32.114973 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application [None req-1c9b1aa3-95fc-4adf-9dfe-9648ab9aa183 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 21:41:32.114973 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:41:32.114973 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:41:32.114973 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:41:32.114973 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:41:32.114973 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:41:32.114973 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:41:32.114973 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:41:32.114973 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:41:32.114973 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:41:32.114973 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:41:32.114973 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:41:32.114973 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:41:32.114973 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:41:32.114973 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:41:32.114973 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:41:32.117940 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:41:32.117940 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:41:32.117940 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:41:32.117940 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:41:32.117940 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:41:32.117940 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:41:32.117940 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:41:32.117940 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:41:32.117940 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:41:32.117940 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:41:32.117940 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:41:32.117940 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application with Lock( Aug 18 21:41:32.117940 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:41:32.117940 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:41:32.117940 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:41:32.117940 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:41:32.118747 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:41:32.118747 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:41:32.118747 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:41:32.118747 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:41:32.118747 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:41:32.118747 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:41:32.118747 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:41:32.118747 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:41:32.118747 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:41:32.118747 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:41:32.118747 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 21:41:32.118747 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:41:32.118747 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 179/361] 10.222.0.27 () {56 vars in 1114 bytes} [Thu Aug 18 21:41:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:41:32.118747 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9b1aa3-95fc-4adf-9dfe-9648ab9aa183 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:32.173543 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 183/362] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Aug 18 21:41:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 21:41:32.177548 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1e2e1c-6040-410c-94c7-5ba8930caa52 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:32.177548 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1e2e1c-6040-410c-94c7-5ba8930caa52 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:32.177548 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1e2e1c-6040-410c-94c7-5ba8930caa52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:32.196454 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-cb1e2e1c-6040-410c-94c7-5ba8930caa52 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:41:32.197886 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-cb1e2e1c-6040-410c-94c7-5ba8930caa52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:41:32.244577 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9b1aa3-95fc-4adf-9dfe-9648ab9aa183 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:32.288695 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 184/363] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:41:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 21:41:32.288695 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1e2e1c-6040-410c-94c7-5ba8930caa52 None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:32.300760 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d4e259-b24b-4a0d-a3dc-476c51cdbe0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:32.301854 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d4e259-b24b-4a0d-a3dc-476c51cdbe0c None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:32.302300 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d4e259-b24b-4a0d-a3dc-476c51cdbe0c None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:32.302883 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d4e259-b24b-4a0d-a3dc-476c51cdbe0c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:32.304156 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d4e259-b24b-4a0d-a3dc-476c51cdbe0c None admin] RBAC: Adding query filter params (role.id=a1ecfacad5ac443db590b35c86cd49e2, user.id=04b4bc9b131a46a1b341aa8f0e595d9f, scope.system=all) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:41:32.304935 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d4e259-b24b-4a0d-a3dc-476c51cdbe0c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:32.306995 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d4e259-b24b-4a0d-a3dc-476c51cdbe0c None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:32.322936 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 180/364] 10.222.0.27 () {56 vars in 1308 bytes} [Thu Aug 18 21:41:32 2022] GET /identity/v3/role_assignments?user.id=04b4bc9b131a46a1b341aa8f0e595d9f&scope.system=all&role.id=a1ecfacad5ac443db590b35c86cd49e2 => generated 510 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:32.323953 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d4e259-b24b-4a0d-a3dc-476c51cdbe0c None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:32.360965 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:32.364289 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:32.399426 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1e2e1c-6040-410c-94c7-5ba8930caa52 None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:32.438616 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347d303c-f517-425b-b209-d0624bef3ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:32.439846 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347d303c-f517-425b-b209-d0624bef3ffe None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:32.440130 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347d303c-f517-425b-b209-d0624bef3ffe None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:32.440622 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347d303c-f517-425b-b209-d0624bef3ffe None admin] PATH_INFO: `/v3/groups/900265762daa4681948a01c6028fb33c` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:32.442001 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347d303c-f517-425b-b209-d0624bef3ffe None admin] RBAC: Authorizing `identity:get_group(group_id=900265762daa4681948a01c6028fb33c)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:32.442946 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d4e259-b24b-4a0d-a3dc-476c51cdbe0c None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:32.443453 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347d303c-f517-425b-b209-d0624bef3ffe None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:32.445529 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 185/365] 10.222.0.27 () {56 vars in 1180 bytes} [Thu Aug 18 21:41:32 2022] GET /identity/v3/groups/900265762daa4681948a01c6028fb33c => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:32.446326 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347d303c-f517-425b-b209-d0624bef3ffe None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:32.489998 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b67320-ce7e-4311-9642-73ae707c88ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:32.490862 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b67320-ce7e-4311-9642-73ae707c88ca None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:32.491204 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b67320-ce7e-4311-9642-73ae707c88ca None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:32.491484 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b67320-ce7e-4311-9642-73ae707c88ca None admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:32.492667 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b67320-ce7e-4311-9642-73ae707c88ca None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:41:32.492976 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b67320-ce7e-4311-9642-73ae707c88ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:32.494999 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b67320-ce7e-4311-9642-73ae707c88ca None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:32.508380 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 181/366] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Aug 18 21:41:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:32.509086 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b67320-ce7e-4311-9642-73ae707c88ca None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:32.615443 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347d303c-f517-425b-b209-d0624bef3ffe None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:32.654417 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:32.662260 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:32.663640 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f00fc5f-87eb-41d9-9745-78cb4f4e599e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:32.664280 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f00fc5f-87eb-41d9-9745-78cb4f4e599e None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:32.664557 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f00fc5f-87eb-41d9-9745-78cb4f4e599e None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:32.664850 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f00fc5f-87eb-41d9-9745-78cb4f4e599e None admin] PATH_INFO: `/v3/projects/5cfc98a315f14e00a8cddaa2c57a9da6` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:32.666468 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f00fc5f-87eb-41d9-9745-78cb4f4e599e None admin] RBAC: Authorizing `identity:get_project(project_id=5cfc98a315f14e00a8cddaa2c57a9da6)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:32.667854 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f00fc5f-87eb-41d9-9745-78cb4f4e599e None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:32.668103 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b67320-ce7e-4311-9642-73ae707c88ca None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:32.669809 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 186/367] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Aug 18 21:41:32 2022] GET /identity/v3/projects/5cfc98a315f14e00a8cddaa2c57a9da6 => generated 302 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:32.670559 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f00fc5f-87eb-41d9-9745-78cb4f4e599e None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:32.719178 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4e3085-6d80-4098-a7a4-8689ac19a46e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:32.720578 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4e3085-6d80-4098-a7a4-8689ac19a46e None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:32.722687 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4e3085-6d80-4098-a7a4-8689ac19a46e None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:32.723472 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4e3085-6d80-4098-a7a4-8689ac19a46e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:32.724150 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4e3085-6d80-4098-a7a4-8689ac19a46e None admin] RBAC: Adding query filter params (group.id=900265762daa4681948a01c6028fb33c, role.id=66171a9efb5344c7a903946f238a3808, scope.project.id=e475732a8fb6447b8d2ccca84af2071a) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:41:32.724463 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4e3085-6d80-4098-a7a4-8689ac19a46e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:32.726402 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4e3085-6d80-4098-a7a4-8689ac19a46e None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:32.732646 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 182/368] 10.222.0.27 () {56 vars in 1376 bytes} [Thu Aug 18 21:41:32 2022] GET /identity/v3/role_assignments?group.id=900265762daa4681948a01c6028fb33c&scope.project.id=e475732a8fb6447b8d2ccca84af2071a&role.id=66171a9efb5344c7a903946f238a3808 => generated 260 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:32.735244 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4e3085-6d80-4098-a7a4-8689ac19a46e None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:32.817778 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f00fc5f-87eb-41d9-9745-78cb4f4e599e None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:32.866432 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4e3085-6d80-4098-a7a4-8689ac19a46e None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:32.867514 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdb7b8c-e3fc-4ae1-a667-c617bf294193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:32.868145 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdb7b8c-e3fc-4ae1-a667-c617bf294193 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:32.868427 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdb7b8c-e3fc-4ae1-a667-c617bf294193 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:32.868791 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdb7b8c-e3fc-4ae1-a667-c617bf294193 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:32.926997 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687bfc09-ce61-4a7d-b56c-41297c2eb49d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:32.927634 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687bfc09-ce61-4a7d-b56c-41297c2eb49d None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:32.927913 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687bfc09-ce61-4a7d-b56c-41297c2eb49d None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:32.928446 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687bfc09-ce61-4a7d-b56c-41297c2eb49d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:32.943652 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687bfc09-ce61-4a7d-b56c-41297c2eb49d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:41:32.951614 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:32.951747 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application [None req-687bfc09-ce61-4a7d-b56c-41297c2eb49d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 21:41:32.951747 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:41:32.951747 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:41:32.951747 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:41:32.951747 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:41:32.951747 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:41:32.951747 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:41:32.951747 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:41:32.951747 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:41:32.951747 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:41:32.951747 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:41:32.951747 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:41:32.951747 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:41:32.951747 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:41:32.951747 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:41:32.951747 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:41:32.952582 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:41:32.952582 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:41:32.952582 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:41:32.952582 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:41:32.952582 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:41:32.952582 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:41:32.952582 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:41:32.952582 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:41:32.952582 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:41:32.952582 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:41:32.952582 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:41:32.952582 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application with Lock( Aug 18 21:41:32.952582 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:41:32.952582 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:41:32.952582 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:41:32.952582 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:41:32.954122 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:41:32.954122 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:41:32.954122 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:41:32.954122 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:41:32.954122 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:41:32.954122 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:41:32.954122 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:41:32.954122 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:41:32.954122 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:41:32.954122 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:41:32.954122 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 21:41:32.954122 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:41:32.955814 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 183/369] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Aug 18 21:41:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:41:32.955814 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687bfc09-ce61-4a7d-b56c-41297c2eb49d None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:32.958228 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdb7b8c-e3fc-4ae1-a667-c617bf294193 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:32.958719 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdb7b8c-e3fc-4ae1-a667-c617bf294193 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:32.992640 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:33.097103 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 187/370] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Aug 18 21:41:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 21:41:33.098142 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdb7b8c-e3fc-4ae1-a667-c617bf294193 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:33.098912 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687bfc09-ce61-4a7d-b56c-41297c2eb49d None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:33.147525 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d47af5-47a7-49f3-bf15-feabde726f57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:33.148089 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d47af5-47a7-49f3-bf15-feabde726f57 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:33.148364 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d47af5-47a7-49f3-bf15-feabde726f57 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:33.148658 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d47af5-47a7-49f3-bf15-feabde726f57 None admin] PATH_INFO: `/v3/groups/900265762daa4681948a01c6028fb33c` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:33.150266 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d47af5-47a7-49f3-bf15-feabde726f57 None admin] RBAC: Authorizing `identity:get_group(group_id=900265762daa4681948a01c6028fb33c)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:33.151239 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d47af5-47a7-49f3-bf15-feabde726f57 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:33.153872 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 184/371] 10.222.0.27 () {56 vars in 1180 bytes} [Thu Aug 18 21:41:32 2022] GET /identity/v3/groups/900265762daa4681948a01c6028fb33c => generated 226 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:33.154638 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d47af5-47a7-49f3-bf15-feabde726f57 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:33.255035 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:33.260563 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdb7b8c-e3fc-4ae1-a667-c617bf294193 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:33.291138 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:33.304329 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e37073c-1e70-4db4-abde-4e1a52dae896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:33.304992 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e37073c-1e70-4db4-abde-4e1a52dae896 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:33.305269 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e37073c-1e70-4db4-abde-4e1a52dae896 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:33.305566 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d47af5-47a7-49f3-bf15-feabde726f57 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:33.305699 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e37073c-1e70-4db4-abde-4e1a52dae896 None admin] PATH_INFO: `/v3/roles` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:33.306259 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e37073c-1e70-4db4-abde-4e1a52dae896 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:41:33.306560 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e37073c-1e70-4db4-abde-4e1a52dae896 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:33.307917 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e37073c-1e70-4db4-abde-4e1a52dae896 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:33.319192 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 188/372] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Aug 18 21:41:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:33.319848 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e37073c-1e70-4db4-abde-4e1a52dae896 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:33.345869 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5b7305-82ed-49a3-bb90-f6adc45aa5b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:33.346518 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5b7305-82ed-49a3-bb90-f6adc45aa5b6 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:33.346955 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5b7305-82ed-49a3-bb90-f6adc45aa5b6 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:33.347068 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5b7305-82ed-49a3-bb90-f6adc45aa5b6 None admin] PATH_INFO: `/v3/projects/5cfc98a315f14e00a8cddaa2c57a9da6` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:33.348206 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5b7305-82ed-49a3-bb90-f6adc45aa5b6 None admin] RBAC: Authorizing `identity:get_project(project_id=5cfc98a315f14e00a8cddaa2c57a9da6)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:33.349673 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5b7305-82ed-49a3-bb90-f6adc45aa5b6 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:33.351294 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 185/373] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Aug 18 21:41:33 2022] GET /identity/v3/projects/5cfc98a315f14e00a8cddaa2c57a9da6 => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:33.352048 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5b7305-82ed-49a3-bb90-f6adc45aa5b6 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:33.450118 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e37073c-1e70-4db4-abde-4e1a52dae896 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:33.476470 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5b7305-82ed-49a3-bb90-f6adc45aa5b6 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:33.487097 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea14136a-7abd-4dc6-9f37-fcac2ba5f8ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:33.487708 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea14136a-7abd-4dc6-9f37-fcac2ba5f8ff None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:33.487987 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea14136a-7abd-4dc6-9f37-fcac2ba5f8ff None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:33.488258 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea14136a-7abd-4dc6-9f37-fcac2ba5f8ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:33.489004 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea14136a-7abd-4dc6-9f37-fcac2ba5f8ff None admin] RBAC: Adding query filter params (group.id=900265762daa4681948a01c6028fb33c, role.id=de8f2438056f4af9879423f8a59e0e0b, scope.project.id=5cfc98a315f14e00a8cddaa2c57a9da6) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:41:33.489309 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea14136a-7abd-4dc6-9f37-fcac2ba5f8ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:33.490823 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea14136a-7abd-4dc6-9f37-fcac2ba5f8ff None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:33.504620 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 189/374] 10.222.0.27 () {56 vars in 1376 bytes} [Thu Aug 18 21:41:33 2022] GET /identity/v3/role_assignments?group.id=900265762daa4681948a01c6028fb33c&scope.project.id=5cfc98a315f14e00a8cddaa2c57a9da6&role.id=de8f2438056f4af9879423f8a59e0e0b => generated 260 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:33.504620 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea14136a-7abd-4dc6-9f37-fcac2ba5f8ff None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:33.550729 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522b2972-62e8-4275-adf8-e8c493fe72fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:33.551353 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522b2972-62e8-4275-adf8-e8c493fe72fc None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:33.551628 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522b2972-62e8-4275-adf8-e8c493fe72fc None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:33.551898 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522b2972-62e8-4275-adf8-e8c493fe72fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:33.560992 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:33.611245 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:33.702484 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522b2972-62e8-4275-adf8-e8c493fe72fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:33.705007 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522b2972-62e8-4275-adf8-e8c493fe72fc None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:33.719952 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea14136a-7abd-4dc6-9f37-fcac2ba5f8ff None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:33.778227 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7040468f-af30-4e34-ae29-4bf186ab5ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:33.779257 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7040468f-af30-4e34-ae29-4bf186ab5ef2 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:33.779746 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7040468f-af30-4e34-ae29-4bf186ab5ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:33.780242 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7040468f-af30-4e34-ae29-4bf186ab5ef2 None admin] PATH_INFO: `/v3/groups/900265762daa4681948a01c6028fb33c` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:33.782384 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7040468f-af30-4e34-ae29-4bf186ab5ef2 None admin] RBAC: Authorizing `identity:get_group(group_id=900265762daa4681948a01c6028fb33c)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:33.784101 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7040468f-af30-4e34-ae29-4bf186ab5ef2 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:33.785933 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 190/375] 10.222.0.27 () {56 vars in 1180 bytes} [Thu Aug 18 21:41:33 2022] GET /identity/v3/groups/900265762daa4681948a01c6028fb33c => generated 226 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:33.791770 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7040468f-af30-4e34-ae29-4bf186ab5ef2 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:33.866108 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 186/376] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Aug 18 21:41:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 514 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 21:41:33.871686 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522b2972-62e8-4275-adf8-e8c493fe72fc None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:33.904420 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:33.915624 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7040468f-af30-4e34-ae29-4bf186ab5ef2 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:33.957060 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:33.957564 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a03fb5-54fc-4d49-ada7-8590d58bb14d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:33.958303 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a03fb5-54fc-4d49-ada7-8590d58bb14d None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:33.958510 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a03fb5-54fc-4d49-ada7-8590d58bb14d None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:33.958790 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a03fb5-54fc-4d49-ada7-8590d58bb14d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:33.959529 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a03fb5-54fc-4d49-ada7-8590d58bb14d None admin] RBAC: Adding query filter params (group.id=900265762daa4681948a01c6028fb33c, role.id=66171a9efb5344c7a903946f238a3808, scope.project.id=5cfc98a315f14e00a8cddaa2c57a9da6) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:41:33.959838 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a03fb5-54fc-4d49-ada7-8590d58bb14d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:33.961308 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a03fb5-54fc-4d49-ada7-8590d58bb14d None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:33.969455 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 191/377] 10.222.0.27 () {56 vars in 1376 bytes} [Thu Aug 18 21:41:33 2022] GET /identity/v3/role_assignments?group.id=900265762daa4681948a01c6028fb33c&scope.project.id=5cfc98a315f14e00a8cddaa2c57a9da6&role.id=66171a9efb5344c7a903946f238a3808 => generated 260 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 21:41:34.024185 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522b2972-62e8-4275-adf8-e8c493fe72fc None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:34.072216 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b67dd3d-397a-4b2b-b393-ce1f26a8f9ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:34.072939 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b67dd3d-397a-4b2b-b393-ce1f26a8f9ff None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:34.073474 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b67dd3d-397a-4b2b-b393-ce1f26a8f9ff None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:34.073806 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b67dd3d-397a-4b2b-b393-ce1f26a8f9ff None admin] PATH_INFO: `/v3/projects/c586edb6eda041a285eb97d5b15554f4` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:34.075014 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b67dd3d-397a-4b2b-b393-ce1f26a8f9ff None admin] RBAC: Authorizing `identity:get_project(project_id=c586edb6eda041a285eb97d5b15554f4)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:34.076489 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b67dd3d-397a-4b2b-b393-ce1f26a8f9ff None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:34.079390 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 187/378] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Aug 18 21:41:33 2022] GET /identity/v3/projects/c586edb6eda041a285eb97d5b15554f4 => generated 344 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 21:41:34.085255 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a03fb5-54fc-4d49-ada7-8590d58bb14d None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:34.233097 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a03fb5-54fc-4d49-ada7-8590d58bb14d None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:34.279886 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1411f309-21e1-44f4-b9e1-21f6cea27b51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:34.280527 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1411f309-21e1-44f4-b9e1-21f6cea27b51 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:34.280833 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1411f309-21e1-44f4-b9e1-21f6cea27b51 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:34.281183 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1411f309-21e1-44f4-b9e1-21f6cea27b51 None admin] PATH_INFO: `/v3/groups/317888c0f57d4ee0bb65ecf107e32250` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:34.288036 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1411f309-21e1-44f4-b9e1-21f6cea27b51 None admin] RBAC: Authorizing `identity:get_group(group_id=317888c0f57d4ee0bb65ecf107e32250)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:34.291618 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1411f309-21e1-44f4-b9e1-21f6cea27b51 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:34.291618 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 192/379] 10.222.0.27 () {56 vars in 1180 bytes} [Thu Aug 18 21:41:34 2022] GET /identity/v3/groups/317888c0f57d4ee0bb65ecf107e32250 => generated 229 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:34.297954 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b67dd3d-397a-4b2b-b393-ce1f26a8f9ff None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:34.374075 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ba3b59-aede-44f7-8fb9-3c2664bc2cdb None None] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:34.374594 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ba3b59-aede-44f7-8fb9-3c2664bc2cdb None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:34.375734 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ba3b59-aede-44f7-8fb9-3c2664bc2cdb None None] PATH_INFO: `/` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:34.377492 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 193/380] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:41:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:41:34.383401 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bf3447-c8cb-4be2-aa7b-27be128a9c6f None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:34.383887 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bf3447-c8cb-4be2-aa7b-27be128a9c6f None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:34.384312 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bf3447-c8cb-4be2-aa7b-27be128a9c6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:34.407020 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-22bf3447-c8cb-4be2-aa7b-27be128a9c6f None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:41:34.408740 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-22bf3447-c8cb-4be2-aa7b-27be128a9c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:41:34.428093 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:34.493018 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 194/381] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:41:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 21:41:34.502762 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b67dd3d-397a-4b2b-b393-ce1f26a8f9ff None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:34.554254 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:34.568859 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0fc4f1-9d58-4501-8380-5e81b331ae09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:34.572675 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0fc4f1-9d58-4501-8380-5e81b331ae09 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:34.572675 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0fc4f1-9d58-4501-8380-5e81b331ae09 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:34.572675 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0fc4f1-9d58-4501-8380-5e81b331ae09 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:34.572675 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0fc4f1-9d58-4501-8380-5e81b331ae09 None admin] RBAC: Adding query filter params (group.id=317888c0f57d4ee0bb65ecf107e32250, role.id=0833202e2a3d47d1b6b3af57006641b1, scope.project.id=c586edb6eda041a285eb97d5b15554f4) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:41:34.572675 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0fc4f1-9d58-4501-8380-5e81b331ae09 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:34.572675 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0fc4f1-9d58-4501-8380-5e81b331ae09 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:34.581311 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 188/382] 10.222.0.27 () {56 vars in 1376 bytes} [Thu Aug 18 21:41:34 2022] GET /identity/v3/role_assignments?group.id=317888c0f57d4ee0bb65ecf107e32250&scope.project.id=c586edb6eda041a285eb97d5b15554f4&role.id=0833202e2a3d47d1b6b3af57006641b1 => generated 260 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:34.808105 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bf3447-c8cb-4be2-aa7b-27be128a9c6f None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:34.933052 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bf3447-c8cb-4be2-aa7b-27be128a9c6f None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:34.983404 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478a2c38-f9e4-4bd9-9a59-6178d6670fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:34.984568 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478a2c38-f9e4-4bd9-9a59-6178d6670fe3 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:34.985017 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478a2c38-f9e4-4bd9-9a59-6178d6670fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:34.985519 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478a2c38-f9e4-4bd9-9a59-6178d6670fe3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:35.001604 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478a2c38-f9e4-4bd9-9a59-6178d6670fe3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:41:35.006358 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application [None req-478a2c38-f9e4-4bd9-9a59-6178d6670fe3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 21:41:35.006358 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:41:35.006358 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:41:35.006358 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:41:35.006358 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:41:35.006358 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:41:35.006358 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:41:35.006358 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:41:35.006358 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:41:35.006358 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:41:35.006358 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:41:35.006358 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:41:35.006358 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:41:35.006358 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:41:35.006358 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:41:35.006358 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:41:35.007226 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:41:35.007226 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:41:35.007226 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:41:35.007226 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:41:35.007226 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:41:35.007226 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:41:35.007226 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:41:35.007226 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:41:35.007226 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:41:35.007226 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:41:35.007226 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:41:35.007226 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application with Lock( Aug 18 21:41:35.007226 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:41:35.007226 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:41:35.007226 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:41:35.007226 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:41:35.008586 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:41:35.008586 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:41:35.008586 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:41:35.008586 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:41:35.008586 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:41:35.008586 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:41:35.008586 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:41:35.008586 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:41:35.008586 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:41:35.008586 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:41:35.008586 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 21:41:35.008586 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:41:35.008586 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 195/383] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Aug 18 21:41:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:41:35.013238 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0fc4f1-9d58-4501-8380-5e81b331ae09 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:35.106693 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ae32c2-4f05-425c-81ff-7f8a455f153e None None] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:35.106993 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ae32c2-4f05-425c-81ff-7f8a455f153e None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:35.107760 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ae32c2-4f05-425c-81ff-7f8a455f153e None None] PATH_INFO: `/` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:35.110299 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 196/384] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:41:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 21:41:35.115746 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1574aac7-b267-40b6-bb46-f983705a6bfe None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:35.116032 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1574aac7-b267-40b6-bb46-f983705a6bfe None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:35.116309 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1574aac7-b267-40b6-bb46-f983705a6bfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:35.137332 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-1574aac7-b267-40b6-bb46-f983705a6bfe None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:41:35.139327 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-1574aac7-b267-40b6-bb46-f983705a6bfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:41:35.144239 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:35.171194 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0fc4f1-9d58-4501-8380-5e81b331ae09 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:35.240027 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270f44d5-7497-4e2a-ac12-ea08dfdefe91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:35.240713 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270f44d5-7497-4e2a-ac12-ea08dfdefe91 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:35.240994 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270f44d5-7497-4e2a-ac12-ea08dfdefe91 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:35.241268 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270f44d5-7497-4e2a-ac12-ea08dfdefe91 None admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:35.241945 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270f44d5-7497-4e2a-ac12-ea08dfdefe91 None admin] RBAC: Adding query filter params (name=member) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:41:35.242246 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270f44d5-7497-4e2a-ac12-ea08dfdefe91 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:35.244167 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270f44d5-7497-4e2a-ac12-ea08dfdefe91 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:35.266417 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 189/385] 10.222.0.27 () {56 vars in 1101 bytes} [Thu Aug 18 21:41:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:35.268120 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270f44d5-7497-4e2a-ac12-ea08dfdefe91 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:35.270603 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 197/386] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:41:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 21:41:35.334088 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:35.383651 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270f44d5-7497-4e2a-ac12-ea08dfdefe91 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:35.418928 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8884830-64f7-4e22-acf4-4b7098e29094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:35.419569 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8884830-64f7-4e22-acf4-4b7098e29094 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:35.419850 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8884830-64f7-4e22-acf4-4b7098e29094 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:35.420126 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8884830-64f7-4e22-acf4-4b7098e29094 None admin] PATH_INFO: `/v3/groups/900265762daa4681948a01c6028fb33c` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:35.421369 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8884830-64f7-4e22-acf4-4b7098e29094 None admin] RBAC: Authorizing `identity:get_group(group_id=900265762daa4681948a01c6028fb33c)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:35.422892 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8884830-64f7-4e22-acf4-4b7098e29094 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:35.424785 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 190/387] 10.222.0.27 () {56 vars in 1180 bytes} [Thu Aug 18 21:41:35 2022] GET /identity/v3/groups/900265762daa4681948a01c6028fb33c => generated 226 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:35.430419 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1574aac7-b267-40b6-bb46-f983705a6bfe None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:35.558516 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1574aac7-b267-40b6-bb46-f983705a6bfe None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:35.609922 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e27c9d-35db-4cc0-a8af-04a8a9a0d045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:35.610558 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e27c9d-35db-4cc0-a8af-04a8a9a0d045 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:35.610839 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e27c9d-35db-4cc0-a8af-04a8a9a0d045 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:35.611113 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e27c9d-35db-4cc0-a8af-04a8a9a0d045 None admin] PATH_INFO: `/v3/projects/e475732a8fb6447b8d2ccca84af2071a` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:35.617276 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e27c9d-35db-4cc0-a8af-04a8a9a0d045 None admin] RBAC: Authorizing `identity:get_project(project_id=e475732a8fb6447b8d2ccca84af2071a)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:35.618784 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e27c9d-35db-4cc0-a8af-04a8a9a0d045 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:35.620738 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 198/388] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Aug 18 21:41:35 2022] GET /identity/v3/projects/e475732a8fb6447b8d2ccca84af2071a => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:35.627046 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8884830-64f7-4e22-acf4-4b7098e29094 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:35.728838 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e27c9d-35db-4cc0-a8af-04a8a9a0d045 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:35.753114 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:35.807371 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8884830-64f7-4e22-acf4-4b7098e29094 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:35.850068 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:35.872291 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e27c9d-35db-4cc0-a8af-04a8a9a0d045 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:35.879169 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6e090e-d7e6-439b-afa1-63f73b5f1a88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:35.879874 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6e090e-d7e6-439b-afa1-63f73b5f1a88 None admin] REQUEST_METHOD: `PUT` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:35.880167 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6e090e-d7e6-439b-afa1-63f73b5f1a88 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:35.880442 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6e090e-d7e6-439b-afa1-63f73b5f1a88 None admin] PATH_INFO: `/v3/projects/e475732a8fb6447b8d2ccca84af2071a/groups/900265762daa4681948a01c6028fb33c/roles/de8f2438056f4af9879423f8a59e0e0b` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:35.885855 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6e090e-d7e6-439b-afa1-63f73b5f1a88 None admin] RBAC: Authorizing `identity:create_grant(project_id=e475732a8fb6447b8d2ccca84af2071a, group_id=900265762daa4681948a01c6028fb33c, role_id=de8f2438056f4af9879423f8a59e0e0b)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:35.887312 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6e090e-d7e6-439b-afa1-63f73b5f1a88 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:35.924453 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ed7146-9214-4c4b-9832-239b94f58400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:35.925125 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ed7146-9214-4c4b-9832-239b94f58400 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:35.925410 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ed7146-9214-4c4b-9832-239b94f58400 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:35.925687 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ed7146-9214-4c4b-9832-239b94f58400 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:35.937197 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ed7146-9214-4c4b-9832-239b94f58400 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:41:35.943103 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application [None req-49ed7146-9214-4c4b-9832-239b94f58400 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 21:41:35.943103 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:41:35.943103 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:41:35.943103 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:41:35.943103 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:41:35.943103 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:41:35.943103 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:41:35.943103 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:41:35.943103 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:41:35.943103 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:41:35.943103 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:41:35.943103 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:41:35.943103 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:41:35.943103 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:41:35.943103 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:41:35.943103 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:41:35.943983 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:41:35.943983 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:41:35.943983 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:41:35.943983 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:41:35.943983 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:41:35.943983 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:41:35.943983 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:41:35.943983 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:41:35.943983 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:41:35.943983 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:41:35.943983 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:41:35.943983 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application with Lock( Aug 18 21:41:35.943983 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:41:35.943983 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:41:35.943983 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:41:35.943983 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:41:35.944815 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:41:35.944815 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:41:35.944815 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:41:35.944815 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:41:35.944815 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:41:35.944815 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:41:35.944815 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:41:35.944815 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:41:35.944815 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:41:35.944815 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:41:35.944815 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 21:41:35.944815 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:41:35.944815 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 199/389] 10.222.0.27 () {56 vars in 1114 bytes} [Thu Aug 18 21:41:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:41:35.955372 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ed7146-9214-4c4b-9832-239b94f58400 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:35.979042 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 191/390] 10.222.0.27 () {58 vars in 1442 bytes} [Thu Aug 18 21:41:35 2022] PUT /identity/v3/projects/e475732a8fb6447b8d2ccca84af2071a/groups/900265762daa4681948a01c6028fb33c/roles/de8f2438056f4af9879423f8a59e0e0b => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 21:41:36.024874 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427f1575-b4cd-493f-ae79-bb96e3025dc7 None None] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:36.025530 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427f1575-b4cd-493f-ae79-bb96e3025dc7 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:36.025684 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427f1575-b4cd-493f-ae79-bb96e3025dc7 None None] PATH_INFO: `/` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:36.027381 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 192/391] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:41:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 21:41:36.033809 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a24625-216b-4d30-bab6-f0859d4cbe95 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:36.034201 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a24625-216b-4d30-bab6-f0859d4cbe95 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:36.034584 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a24625-216b-4d30-bab6-f0859d4cbe95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:36.054141 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-e2a24625-216b-4d30-bab6-f0859d4cbe95 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:41:36.054734 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:36.056065 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-e2a24625-216b-4d30-bab6-f0859d4cbe95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:41:36.095071 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ed7146-9214-4c4b-9832-239b94f58400 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:36.148177 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f10d2aa-c183-43ee-a568-e65129bd637e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:36.149082 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f10d2aa-c183-43ee-a568-e65129bd637e None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:36.149365 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f10d2aa-c183-43ee-a568-e65129bd637e None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:36.149638 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f10d2aa-c183-43ee-a568-e65129bd637e None admin] PATH_INFO: `/v3/roles` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:36.151157 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f10d2aa-c183-43ee-a568-e65129bd637e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:41:36.151465 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f10d2aa-c183-43ee-a568-e65129bd637e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:36.153217 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f10d2aa-c183-43ee-a568-e65129bd637e None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:36.180875 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 200/392] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Aug 18 21:41:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:36.184214 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f10d2aa-c183-43ee-a568-e65129bd637e None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:36.211360 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 193/393] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:41:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 21:41:36.302353 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f10d2aa-c183-43ee-a568-e65129bd637e None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:36.333309 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:36.338956 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1edaec0-3fb6-4a4f-ac60-bdea79427d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:36.339694 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1edaec0-3fb6-4a4f-ac60-bdea79427d94 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:36.340034 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1edaec0-3fb6-4a4f-ac60-bdea79427d94 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:36.340312 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1edaec0-3fb6-4a4f-ac60-bdea79427d94 None admin] PATH_INFO: `/v3/groups/900265762daa4681948a01c6028fb33c` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:36.341447 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1edaec0-3fb6-4a4f-ac60-bdea79427d94 None admin] RBAC: Authorizing `identity:get_group(group_id=900265762daa4681948a01c6028fb33c)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:36.343033 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1edaec0-3fb6-4a4f-ac60-bdea79427d94 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:36.346553 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 201/394] 10.222.0.27 () {56 vars in 1180 bytes} [Thu Aug 18 21:41:36 2022] GET /identity/v3/groups/900265762daa4681948a01c6028fb33c => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:36.351364 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a24625-216b-4d30-bab6-f0859d4cbe95 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:36.464324 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a24625-216b-4d30-bab6-f0859d4cbe95 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:36.479900 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:36.507191 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c25e3f-1784-4e26-ae75-c5dec4c1a5c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:36.508117 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c25e3f-1784-4e26-ae75-c5dec4c1a5c6 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:36.508576 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c25e3f-1784-4e26-ae75-c5dec4c1a5c6 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:36.509076 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c25e3f-1784-4e26-ae75-c5dec4c1a5c6 None admin] PATH_INFO: `/v3/projects/e475732a8fb6447b8d2ccca84af2071a` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:36.510512 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c25e3f-1784-4e26-ae75-c5dec4c1a5c6 None admin] RBAC: Authorizing `identity:get_project(project_id=e475732a8fb6447b8d2ccca84af2071a)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:36.515258 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c25e3f-1784-4e26-ae75-c5dec4c1a5c6 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:36.517747 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 194/395] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Aug 18 21:41:36 2022] GET /identity/v3/projects/e475732a8fb6447b8d2ccca84af2071a => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:36.523672 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1edaec0-3fb6-4a4f-ac60-bdea79427d94 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:36.529957 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c25e3f-1784-4e26-ae75-c5dec4c1a5c6 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:36.702191 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1edaec0-3fb6-4a4f-ac60-bdea79427d94 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:36.717063 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c25e3f-1784-4e26-ae75-c5dec4c1a5c6 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:36.740981 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73676e67-019d-4f79-b983-3540534cc89c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:36.741965 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73676e67-019d-4f79-b983-3540534cc89c None admin] REQUEST_METHOD: `PUT` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:36.742499 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73676e67-019d-4f79-b983-3540534cc89c None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:36.742948 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73676e67-019d-4f79-b983-3540534cc89c None admin] PATH_INFO: `/v3/projects/e475732a8fb6447b8d2ccca84af2071a/groups/900265762daa4681948a01c6028fb33c/roles/66171a9efb5344c7a903946f238a3808` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:36.745342 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73676e67-019d-4f79-b983-3540534cc89c None admin] RBAC: Authorizing `identity:create_grant(project_id=e475732a8fb6447b8d2ccca84af2071a, group_id=900265762daa4681948a01c6028fb33c, role_id=66171a9efb5344c7a903946f238a3808)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:36.746994 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73676e67-019d-4f79-b983-3540534cc89c None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:36.760346 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385de818-f677-40e2-b1ff-553745ca554c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:36.761007 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385de818-f677-40e2-b1ff-553745ca554c None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:36.761291 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385de818-f677-40e2-b1ff-553745ca554c None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:36.761570 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385de818-f677-40e2-b1ff-553745ca554c None admin] PATH_INFO: `/v3/roles/member` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:36.772850 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385de818-f677-40e2-b1ff-553745ca554c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:41:36.777674 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application [None req-385de818-f677-40e2-b1ff-553745ca554c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 21:41:36.777674 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:41:36.777674 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:41:36.777674 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:41:36.777674 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:41:36.777674 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:41:36.777674 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:41:36.777674 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:41:36.777674 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:41:36.777674 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:41:36.777674 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:41:36.777674 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:41:36.777674 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:41:36.777674 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:41:36.777674 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:41:36.777674 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:41:36.778563 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:41:36.778563 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:41:36.778563 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:41:36.778563 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:41:36.778563 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:41:36.778563 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:41:36.778563 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:41:36.778563 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:41:36.778563 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:41:36.778563 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:41:36.778563 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:41:36.778563 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application with Lock( Aug 18 21:41:36.778563 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:41:36.778563 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:41:36.778563 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:41:36.778563 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:41:36.779339 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:41:36.779339 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:41:36.779339 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:41:36.779339 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:41:36.779339 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:41:36.779339 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:41:36.779339 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:41:36.779339 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:41:36.779339 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:41:36.779339 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:41:36.779339 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 21:41:36.779339 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:41:36.783952 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 195/396] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Aug 18 21:41:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:41:36.785072 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f82c4f6-0648-4901-89fc-2fbae43f9502 None None] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:36.785358 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f82c4f6-0648-4901-89fc-2fbae43f9502 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:36.785631 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f82c4f6-0648-4901-89fc-2fbae43f9502 None None] PATH_INFO: `/` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:36.786889 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 196/397] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:41:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:41:36.787582 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f82c4f6-0648-4901-89fc-2fbae43f9502 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:36.824936 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 202/398] 10.222.0.27 () {58 vars in 1442 bytes} [Thu Aug 18 21:41:36 2022] PUT /identity/v3/projects/e475732a8fb6447b8d2ccca84af2071a/groups/900265762daa4681948a01c6028fb33c/roles/66171a9efb5344c7a903946f238a3808 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:41:36.826785 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc786e5-7195-4698-8e9f-d25b34d69ee1 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:36.827721 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc786e5-7195-4698-8e9f-d25b34d69ee1 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:36.827721 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc786e5-7195-4698-8e9f-d25b34d69ee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:36.841853 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:36.865350 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-5cc786e5-7195-4698-8e9f-d25b34d69ee1 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:41:36.866672 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-5cc786e5-7195-4698-8e9f-d25b34d69ee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:41:36.928473 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:36.930318 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f82c4f6-0648-4901-89fc-2fbae43f9502 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:36.943750 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 203/399] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:41:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 21:41:36.948217 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2661379e-e574-4cb0-8be4-293660b18817 None None] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:36.948217 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2661379e-e574-4cb0-8be4-293660b18817 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:36.948217 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2661379e-e574-4cb0-8be4-293660b18817 None None] PATH_INFO: `/` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:36.948217 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 204/400] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:41:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:41:36.952161 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82277cdf-1c01-4886-b95d-f4898a941d04 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:36.952510 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82277cdf-1c01-4886-b95d-f4898a941d04 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:36.952757 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82277cdf-1c01-4886-b95d-f4898a941d04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:36.971511 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-82277cdf-1c01-4886-b95d-f4898a941d04 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:41:36.972789 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-82277cdf-1c01-4886-b95d-f4898a941d04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:41:36.975274 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c08a17a-dba2-40ee-88cf-82a027fe9f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:36.977124 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c08a17a-dba2-40ee-88cf-82a027fe9f4c None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:36.977335 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c08a17a-dba2-40ee-88cf-82a027fe9f4c None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:36.977575 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c08a17a-dba2-40ee-88cf-82a027fe9f4c None admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:36.978253 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c08a17a-dba2-40ee-88cf-82a027fe9f4c None admin] RBAC: Adding query filter params (name=member) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:41:36.978554 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c08a17a-dba2-40ee-88cf-82a027fe9f4c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:36.979938 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c08a17a-dba2-40ee-88cf-82a027fe9f4c None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:36.989145 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 197/401] 10.222.0.27 () {56 vars in 1101 bytes} [Thu Aug 18 21:41:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:36.994935 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c08a17a-dba2-40ee-88cf-82a027fe9f4c None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:37.068033 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 205/402] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:41:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 21:41:37.127866 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:37.131663 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c08a17a-dba2-40ee-88cf-82a027fe9f4c None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:37.166828 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2ddc0f-6716-4a2b-9db6-20f780a0b0b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:37.167829 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2ddc0f-6716-4a2b-9db6-20f780a0b0b8 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:37.168311 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2ddc0f-6716-4a2b-9db6-20f780a0b0b8 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:37.168745 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2ddc0f-6716-4a2b-9db6-20f780a0b0b8 None admin] PATH_INFO: `/v3/groups/900265762daa4681948a01c6028fb33c` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:37.170025 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2ddc0f-6716-4a2b-9db6-20f780a0b0b8 None admin] RBAC: Authorizing `identity:get_group(group_id=900265762daa4681948a01c6028fb33c)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:37.171671 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2ddc0f-6716-4a2b-9db6-20f780a0b0b8 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:37.174488 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 198/403] 10.222.0.27 () {56 vars in 1180 bytes} [Thu Aug 18 21:41:36 2022] GET /identity/v3/groups/900265762daa4681948a01c6028fb33c => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 21:41:37.179826 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82277cdf-1c01-4886-b95d-f4898a941d04 None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:37.291929 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2ddc0f-6716-4a2b-9db6-20f780a0b0b8 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:37.299270 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82277cdf-1c01-4886-b95d-f4898a941d04 None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:37.320507 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:37.340475 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c6d721-742e-4bad-972a-cfad1463b898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:37.341270 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c6d721-742e-4bad-972a-cfad1463b898 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:37.341552 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c6d721-742e-4bad-972a-cfad1463b898 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:37.341827 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c6d721-742e-4bad-972a-cfad1463b898 None admin] PATH_INFO: `/v3/projects/5cfc98a315f14e00a8cddaa2c57a9da6` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:37.343199 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c6d721-742e-4bad-972a-cfad1463b898 None admin] RBAC: Authorizing `identity:get_project(project_id=5cfc98a315f14e00a8cddaa2c57a9da6)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:37.346071 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c6d721-742e-4bad-972a-cfad1463b898 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:37.348265 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 206/404] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Aug 18 21:41:37 2022] GET /identity/v3/projects/5cfc98a315f14e00a8cddaa2c57a9da6 => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:37.353391 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c6d721-742e-4bad-972a-cfad1463b898 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:37.457457 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2ddc0f-6716-4a2b-9db6-20f780a0b0b8 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:37.474287 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c6d721-742e-4bad-972a-cfad1463b898 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:37.501087 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c9dd79-066b-498f-9157-f163adb1f1ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:37.502325 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c9dd79-066b-498f-9157-f163adb1f1ed None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:37.502935 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c9dd79-066b-498f-9157-f163adb1f1ed None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:37.503485 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c9dd79-066b-498f-9157-f163adb1f1ed None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:37.512056 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc715ec-9237-47e1-a10a-7e48416b0e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:37.512841 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc715ec-9237-47e1-a10a-7e48416b0e20 None admin] REQUEST_METHOD: `PUT` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:37.513119 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc715ec-9237-47e1-a10a-7e48416b0e20 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:37.513390 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc715ec-9237-47e1-a10a-7e48416b0e20 None admin] PATH_INFO: `/v3/projects/5cfc98a315f14e00a8cddaa2c57a9da6/groups/900265762daa4681948a01c6028fb33c/roles/de8f2438056f4af9879423f8a59e0e0b` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:37.515742 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc715ec-9237-47e1-a10a-7e48416b0e20 None admin] RBAC: Authorizing `identity:create_grant(project_id=5cfc98a315f14e00a8cddaa2c57a9da6, group_id=900265762daa4681948a01c6028fb33c, role_id=de8f2438056f4af9879423f8a59e0e0b)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:37.517309 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc715ec-9237-47e1-a10a-7e48416b0e20 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:37.517572 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c9dd79-066b-498f-9157-f163adb1f1ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:41:37.524103 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application [None req-b6c9dd79-066b-498f-9157-f163adb1f1ed None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 21:41:37.524103 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:41:37.524103 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:41:37.524103 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:41:37.524103 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:41:37.524103 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:41:37.524103 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:41:37.524103 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:41:37.524103 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:41:37.524103 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:41:37.524103 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:41:37.524103 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:41:37.524103 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:41:37.524103 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:41:37.524103 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:41:37.524103 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:41:37.525049 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:41:37.525049 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:41:37.525049 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:41:37.525049 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:41:37.525049 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:41:37.525049 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:41:37.525049 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:41:37.525049 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:41:37.525049 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:41:37.525049 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:41:37.525049 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:41:37.525049 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application with Lock( Aug 18 21:41:37.525049 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:41:37.525049 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:41:37.525049 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:41:37.525049 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:41:37.525838 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:41:37.525838 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:41:37.525838 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:41:37.525838 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:41:37.525838 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:41:37.525838 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:41:37.525838 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:41:37.525838 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:41:37.525838 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:41:37.525838 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:41:37.525838 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 21:41:37.525838 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:41:37.525838 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 199/405] 10.222.0.27 () {56 vars in 1114 bytes} [Thu Aug 18 21:41:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:41:37.526969 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c9dd79-066b-498f-9157-f163adb1f1ed None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:37.557831 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:37.610788 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 207/406] 10.222.0.27 () {58 vars in 1442 bytes} [Thu Aug 18 21:41:37 2022] PUT /identity/v3/projects/5cfc98a315f14e00a8cddaa2c57a9da6/groups/900265762daa4681948a01c6028fb33c/roles/de8f2438056f4af9879423f8a59e0e0b => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:41:37.611738 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc715ec-9237-47e1-a10a-7e48416b0e20 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:37.639006 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c9dd79-066b-498f-9157-f163adb1f1ed None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:37.665477 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:37.689831 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2158ee-a484-4301-8892-bcdd636e454b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:37.690943 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2158ee-a484-4301-8892-bcdd636e454b None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:37.691452 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2158ee-a484-4301-8892-bcdd636e454b None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:37.692427 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2158ee-a484-4301-8892-bcdd636e454b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:37.709533 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2158ee-a484-4301-8892-bcdd636e454b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:41:37.716045 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application [None req-0f2158ee-a484-4301-8892-bcdd636e454b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 21:41:37.716045 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:41:37.716045 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:41:37.716045 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:41:37.716045 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:41:37.716045 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:41:37.716045 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:41:37.716045 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:41:37.716045 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:41:37.716045 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:41:37.716045 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:41:37.716045 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:41:37.716045 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:41:37.716045 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:41:37.716045 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:41:37.716045 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:41:37.723606 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:41:37.723606 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:41:37.723606 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:41:37.723606 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:41:37.723606 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:41:37.723606 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:41:37.723606 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:41:37.723606 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:41:37.723606 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:41:37.723606 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:41:37.723606 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:41:37.723606 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application with Lock( Aug 18 21:41:37.723606 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:41:37.723606 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:41:37.723606 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:41:37.723606 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:41:37.724434 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:41:37.724434 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:41:37.724434 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:41:37.724434 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:41:37.724434 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:41:37.724434 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:41:37.724434 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:41:37.724434 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:41:37.724434 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:41:37.724434 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:41:37.724434 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 21:41:37.724434 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:41:37.724434 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 200/407] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Aug 18 21:41:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:41:37.729040 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2158ee-a484-4301-8892-bcdd636e454b None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:37.800225 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc715ec-9237-47e1-a10a-7e48416b0e20 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:37.846852 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94771a9f-d615-433a-8a6e-1b765fd79f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:37.847433 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94771a9f-d615-433a-8a6e-1b765fd79f27 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:37.847716 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94771a9f-d615-433a-8a6e-1b765fd79f27 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:37.847985 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94771a9f-d615-433a-8a6e-1b765fd79f27 None admin] PATH_INFO: `/v3/roles` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:37.849277 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:37.850226 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94771a9f-d615-433a-8a6e-1b765fd79f27 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:41:37.850716 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94771a9f-d615-433a-8a6e-1b765fd79f27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:37.852727 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94771a9f-d615-433a-8a6e-1b765fd79f27 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:37.866415 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2158ee-a484-4301-8892-bcdd636e454b None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:37.866860 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 208/408] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Aug 18 21:41:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:37.872485 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94771a9f-d615-433a-8a6e-1b765fd79f27 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:37.921346 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10da644d-1176-443f-abd9-2872138c42b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:37.923102 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10da644d-1176-443f-abd9-2872138c42b9 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:37.924478 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10da644d-1176-443f-abd9-2872138c42b9 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:37.924784 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10da644d-1176-443f-abd9-2872138c42b9 None admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:37.925466 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10da644d-1176-443f-abd9-2872138c42b9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:41:37.925798 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10da644d-1176-443f-abd9-2872138c42b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:37.929203 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10da644d-1176-443f-abd9-2872138c42b9 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:37.947483 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 201/409] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Aug 18 21:41:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:37.969923 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10da644d-1176-443f-abd9-2872138c42b9 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:38.045559 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94771a9f-d615-433a-8a6e-1b765fd79f27 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:38.055322 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:38.084523 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3302ee84-01d9-41b4-bfc0-6e414e94e5ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:38.085190 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3302ee84-01d9-41b4-bfc0-6e414e94e5ee None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:38.085468 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3302ee84-01d9-41b4-bfc0-6e414e94e5ee None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:38.085735 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3302ee84-01d9-41b4-bfc0-6e414e94e5ee None admin] PATH_INFO: `/v3/groups/900265762daa4681948a01c6028fb33c` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:38.087495 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3302ee84-01d9-41b4-bfc0-6e414e94e5ee None admin] RBAC: Authorizing `identity:get_group(group_id=900265762daa4681948a01c6028fb33c)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:38.089076 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3302ee84-01d9-41b4-bfc0-6e414e94e5ee None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:38.092569 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 209/410] 10.222.0.27 () {56 vars in 1180 bytes} [Thu Aug 18 21:41:37 2022] GET /identity/v3/groups/900265762daa4681948a01c6028fb33c => generated 226 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 21:41:38.096052 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3302ee84-01d9-41b4-bfc0-6e414e94e5ee None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:38.132989 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10da644d-1176-443f-abd9-2872138c42b9 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:38.206944 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaf96e1-63f2-4eb1-a208-24424ec180d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:38.207944 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaf96e1-63f2-4eb1-a208-24424ec180d8 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:38.208427 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaf96e1-63f2-4eb1-a208-24424ec180d8 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:38.209058 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaf96e1-63f2-4eb1-a208-24424ec180d8 None admin] PATH_INFO: `/v3/groups/317888c0f57d4ee0bb65ecf107e32250` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:38.213302 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaf96e1-63f2-4eb1-a208-24424ec180d8 None admin] RBAC: Authorizing `identity:get_group(group_id=317888c0f57d4ee0bb65ecf107e32250)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:38.215148 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaf96e1-63f2-4eb1-a208-24424ec180d8 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:38.217105 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 202/411] 10.222.0.27 () {56 vars in 1180 bytes} [Thu Aug 18 21:41:37 2022] GET /identity/v3/groups/317888c0f57d4ee0bb65ecf107e32250 => generated 229 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 21:41:38.225077 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaf96e1-63f2-4eb1-a208-24424ec180d8 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:38.246556 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3302ee84-01d9-41b4-bfc0-6e414e94e5ee None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:38.268737 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:38.317345 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760e059b-5273-46e8-9605-905dbe3bedfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:38.317976 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760e059b-5273-46e8-9605-905dbe3bedfe None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:38.318254 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760e059b-5273-46e8-9605-905dbe3bedfe None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:38.318515 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760e059b-5273-46e8-9605-905dbe3bedfe None admin] PATH_INFO: `/v3/projects/5cfc98a315f14e00a8cddaa2c57a9da6` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:38.319652 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760e059b-5273-46e8-9605-905dbe3bedfe None admin] RBAC: Authorizing `identity:get_project(project_id=5cfc98a315f14e00a8cddaa2c57a9da6)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:38.321116 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760e059b-5273-46e8-9605-905dbe3bedfe None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:38.323041 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 210/412] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Aug 18 21:41:38 2022] GET /identity/v3/projects/5cfc98a315f14e00a8cddaa2c57a9da6 => generated 302 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:38.333575 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760e059b-5273-46e8-9605-905dbe3bedfe None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:38.411365 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:38.414999 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaf96e1-63f2-4eb1-a208-24424ec180d8 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:38.458159 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aec608-8fa1-4347-810a-868f476ca49d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:38.459153 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aec608-8fa1-4347-810a-868f476ca49d None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:38.459437 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aec608-8fa1-4347-810a-868f476ca49d None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:38.459708 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aec608-8fa1-4347-810a-868f476ca49d None admin] PATH_INFO: `/v3/projects/c586edb6eda041a285eb97d5b15554f4` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:38.461800 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85aec608-8fa1-4347-810a-868f476ca49d None admin] RBAC: Authorizing `identity:get_project(project_id=c586edb6eda041a285eb97d5b15554f4)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:38.463742 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85aec608-8fa1-4347-810a-868f476ca49d None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:38.466305 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 203/413] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Aug 18 21:41:38 2022] GET /identity/v3/projects/c586edb6eda041a285eb97d5b15554f4 => generated 344 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 21:41:38.467741 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23578550-7365-4597-ab74-594fab16e3d3 None None] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:38.468299 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23578550-7365-4597-ab74-594fab16e3d3 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:38.469196 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23578550-7365-4597-ab74-594fab16e3d3 None None] PATH_INFO: `/` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:38.471503 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 204/414] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:41:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:41:38.472057 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23578550-7365-4597-ab74-594fab16e3d3 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:38.488294 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760e059b-5273-46e8-9605-905dbe3bedfe None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:38.534480 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c762e2-ac5e-49fd-a5b3-44ce50087493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:38.535188 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c762e2-ac5e-49fd-a5b3-44ce50087493 None admin] REQUEST_METHOD: `PUT` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:38.535465 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c762e2-ac5e-49fd-a5b3-44ce50087493 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:38.535735 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c762e2-ac5e-49fd-a5b3-44ce50087493 None admin] PATH_INFO: `/v3/projects/5cfc98a315f14e00a8cddaa2c57a9da6/groups/900265762daa4681948a01c6028fb33c/roles/66171a9efb5344c7a903946f238a3808` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:38.539720 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c762e2-ac5e-49fd-a5b3-44ce50087493 None admin] RBAC: Authorizing `identity:create_grant(project_id=5cfc98a315f14e00a8cddaa2c57a9da6, group_id=900265762daa4681948a01c6028fb33c, role_id=66171a9efb5344c7a903946f238a3808)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:38.542057 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c762e2-ac5e-49fd-a5b3-44ce50087493 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:38.581350 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:38.597517 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23578550-7365-4597-ab74-594fab16e3d3 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:38.631089 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d153ef9f-81e3-466c-8854-2cc0409996f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:38.631741 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d153ef9f-81e3-466c-8854-2cc0409996f6 None admin] REQUEST_METHOD: `PUT` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:38.632076 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d153ef9f-81e3-466c-8854-2cc0409996f6 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:38.632355 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d153ef9f-81e3-466c-8854-2cc0409996f6 None admin] PATH_INFO: `/v3/projects/c586edb6eda041a285eb97d5b15554f4/groups/317888c0f57d4ee0bb65ecf107e32250/roles/0833202e2a3d47d1b6b3af57006641b1` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:38.634376 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d153ef9f-81e3-466c-8854-2cc0409996f6 None admin] RBAC: Authorizing `identity:create_grant(project_id=c586edb6eda041a285eb97d5b15554f4, group_id=317888c0f57d4ee0bb65ecf107e32250, role_id=0833202e2a3d47d1b6b3af57006641b1)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:38.635866 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d153ef9f-81e3-466c-8854-2cc0409996f6 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:38.644408 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 211/415] 10.222.0.27 () {58 vars in 1442 bytes} [Thu Aug 18 21:41:38 2022] PUT /identity/v3/projects/5cfc98a315f14e00a8cddaa2c57a9da6/groups/900265762daa4681948a01c6028fb33c/roles/66171a9efb5344c7a903946f238a3808 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:41:38.646203 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b71ea5-8a5f-4eae-b7f7-556ec7f14d3c None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:38.646687 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b71ea5-8a5f-4eae-b7f7-556ec7f14d3c None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:38.647587 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b71ea5-8a5f-4eae-b7f7-556ec7f14d3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:38.677647 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-48b71ea5-8a5f-4eae-b7f7-556ec7f14d3c None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:41:38.678846 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-48b71ea5-8a5f-4eae-b7f7-556ec7f14d3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:41:38.752613 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 205/416] 10.222.0.27 () {58 vars in 1442 bytes} [Thu Aug 18 21:41:38 2022] PUT /identity/v3/projects/c586edb6eda041a285eb97d5b15554f4/groups/317888c0f57d4ee0bb65ecf107e32250/roles/0833202e2a3d47d1b6b3af57006641b1 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 21:41:38.769119 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 212/417] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:41:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 21:41:39.056140 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d153ef9f-81e3-466c-8854-2cc0409996f6 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:39.178103 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19ec17d-5787-4d30-9cf1-395b5b84ffca None None] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:39.178467 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19ec17d-5787-4d30-9cf1-395b5b84ffca None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:39.178646 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19ec17d-5787-4d30-9cf1-395b5b84ffca None None] PATH_INFO: `/` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:39.180220 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 213/418] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:41:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:41:39.185236 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a2469f-ac66-42c0-a553-e0bcb5c47e02 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:39.185514 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a2469f-ac66-42c0-a553-e0bcb5c47e02 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:39.185616 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d153ef9f-81e3-466c-8854-2cc0409996f6 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:39.186040 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a2469f-ac66-42c0-a553-e0bcb5c47e02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:39.203868 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-68a2469f-ac66-42c0-a553-e0bcb5c47e02 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:41:39.205089 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-68a2469f-ac66-42c0-a553-e0bcb5c47e02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:41:39.240009 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403ed51d-897a-4fef-a906-65871e8027e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:39.240665 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403ed51d-897a-4fef-a906-65871e8027e3 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:39.240940 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403ed51d-897a-4fef-a906-65871e8027e3 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:39.241206 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403ed51d-897a-4fef-a906-65871e8027e3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:39.250343 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:39.253778 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403ed51d-897a-4fef-a906-65871e8027e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:41:39.259249 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application [None req-403ed51d-897a-4fef-a906-65871e8027e3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 21:41:39.259249 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:41:39.259249 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:41:39.259249 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:41:39.259249 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:41:39.259249 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:41:39.259249 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:41:39.259249 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:41:39.259249 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:41:39.259249 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:41:39.259249 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:41:39.259249 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:41:39.259249 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:41:39.259249 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:41:39.259249 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:41:39.259249 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:41:39.260130 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:41:39.260130 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:41:39.260130 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:41:39.260130 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:41:39.260130 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:41:39.260130 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:41:39.260130 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:41:39.260130 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:41:39.260130 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:41:39.260130 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:41:39.260130 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:41:39.260130 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application with Lock( Aug 18 21:41:39.260130 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:41:39.260130 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:41:39.260130 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:41:39.260130 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:41:39.261468 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:41:39.261468 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:41:39.261468 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:41:39.261468 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:41:39.261468 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:41:39.261468 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:41:39.261468 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:41:39.261468 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:41:39.261468 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:41:39.261468 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:41:39.261468 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 21:41:39.261468 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:41:39.261468 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 206/419] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Aug 18 21:41:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:41:39.268490 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403ed51d-897a-4fef-a906-65871e8027e3 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:39.278498 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:39.323055 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 214/420] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:41:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 21:41:39.399916 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403ed51d-897a-4fef-a906-65871e8027e3 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:39.444009 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c9fdc5-882d-4bae-9717-c07fcd084dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:39.445053 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c9fdc5-882d-4bae-9717-c07fcd084dbd None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:39.445534 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c9fdc5-882d-4bae-9717-c07fcd084dbd None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:39.446004 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c9fdc5-882d-4bae-9717-c07fcd084dbd None admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:39.446869 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c9fdc5-882d-4bae-9717-c07fcd084dbd None admin] RBAC: Adding query filter params (name=member) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:41:39.447364 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c9fdc5-882d-4bae-9717-c07fcd084dbd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:39.448988 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c9fdc5-882d-4bae-9717-c07fcd084dbd None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:39.458872 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 207/421] 10.222.0.27 () {56 vars in 1101 bytes} [Thu Aug 18 21:41:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:39.464561 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a2469f-ac66-42c0-a553-e0bcb5c47e02 None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:39.602334 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a2469f-ac66-42c0-a553-e0bcb5c47e02 None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:39.642287 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab04e8e-9253-4c23-94e8-21849ad6e98c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:39.642905 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab04e8e-9253-4c23-94e8-21849ad6e98c None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:39.643183 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab04e8e-9253-4c23-94e8-21849ad6e98c None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:39.643452 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab04e8e-9253-4c23-94e8-21849ad6e98c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:39.664550 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c9fdc5-882d-4bae-9717-c07fcd084dbd None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:39.683725 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:39.722983 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab04e8e-9253-4c23-94e8-21849ad6e98c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:39.724861 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab04e8e-9253-4c23-94e8-21849ad6e98c None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:39.765502 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:39.804768 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c9fdc5-882d-4bae-9717-c07fcd084dbd None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:39.844947 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0154c24-659a-4ea4-9b13-5fbaf99ede32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:39.845966 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0154c24-659a-4ea4-9b13-5fbaf99ede32 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:39.846610 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0154c24-659a-4ea4-9b13-5fbaf99ede32 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:39.848373 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0154c24-659a-4ea4-9b13-5fbaf99ede32 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:39.868914 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0154c24-659a-4ea4-9b13-5fbaf99ede32 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:41:39.875855 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application [None req-a0154c24-659a-4ea4-9b13-5fbaf99ede32 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 21:41:39.875855 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:41:39.875855 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:41:39.875855 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:41:39.875855 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:41:39.875855 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:41:39.875855 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:41:39.875855 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:41:39.875855 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:41:39.875855 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:41:39.875855 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:41:39.875855 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:41:39.875855 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:41:39.875855 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:41:39.875855 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:41:39.875855 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:41:39.876755 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:41:39.876755 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:41:39.876755 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:41:39.876755 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:41:39.876755 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:41:39.876755 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:41:39.876755 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:41:39.876755 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:41:39.876755 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:41:39.876755 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:41:39.876755 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:41:39.876755 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application with Lock( Aug 18 21:41:39.876755 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:41:39.876755 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:41:39.876755 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:41:39.876755 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:41:39.877546 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:41:39.877546 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:41:39.877546 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:41:39.877546 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:41:39.877546 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:41:39.877546 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:41:39.877546 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:41:39.877546 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:41:39.877546 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:41:39.877546 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:41:39.877546 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 21:41:39.877546 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:41:39.879350 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 208/422] 10.222.0.27 () {56 vars in 1114 bytes} [Thu Aug 18 21:41:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:41:39.886163 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0154c24-659a-4ea4-9b13-5fbaf99ede32 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:39.890642 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 215/423] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Aug 18 21:41:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 21:41:39.895902 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab04e8e-9253-4c23-94e8-21849ad6e98c None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:39.969857 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:40.010528 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0154c24-659a-4ea4-9b13-5fbaf99ede32 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:40.015099 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab04e8e-9253-4c23-94e8-21849ad6e98c None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:40.041452 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:40.051473 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca8d6a2-6ed5-4624-ae95-3f3c14a44f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:40.052148 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca8d6a2-6ed5-4624-ae95-3f3c14a44f1e None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:40.056436 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca8d6a2-6ed5-4624-ae95-3f3c14a44f1e None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:40.056436 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca8d6a2-6ed5-4624-ae95-3f3c14a44f1e None admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:40.056436 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca8d6a2-6ed5-4624-ae95-3f3c14a44f1e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:41:40.056436 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca8d6a2-6ed5-4624-ae95-3f3c14a44f1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:40.056936 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca8d6a2-6ed5-4624-ae95-3f3c14a44f1e None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:40.065585 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61dfe8b-9ecc-4143-8dec-fe0f5f05d2fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:40.066486 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61dfe8b-9ecc-4143-8dec-fe0f5f05d2fc None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:40.066637 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 209/424] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Aug 18 21:41:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:40.067047 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61dfe8b-9ecc-4143-8dec-fe0f5f05d2fc None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:40.067464 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61dfe8b-9ecc-4143-8dec-fe0f5f05d2fc None admin] PATH_INFO: `/v3/projects/e475732a8fb6447b8d2ccca84af2071a` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:40.067960 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b5458e-3b76-4b22-a3d4-6d0a25cf8f5b None None] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:40.068247 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b5458e-3b76-4b22-a3d4-6d0a25cf8f5b None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:40.068648 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b5458e-3b76-4b22-a3d4-6d0a25cf8f5b None None] PATH_INFO: `/` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:40.069371 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61dfe8b-9ecc-4143-8dec-fe0f5f05d2fc None admin] RBAC: Authorizing `identity:get_project(project_id=e475732a8fb6447b8d2ccca84af2071a)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:40.073919 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 210/425] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:41:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:41:40.073919 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b5458e-3b76-4b22-a3d4-6d0a25cf8f5b None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:40.076259 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61dfe8b-9ecc-4143-8dec-fe0f5f05d2fc None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:40.078727 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 216/426] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Aug 18 21:41:39 2022] GET /identity/v3/projects/e475732a8fb6447b8d2ccca84af2071a => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:40.080268 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c4069a-d6d9-4cff-b3a8-638dc59ebd32 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:40.081208 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c4069a-d6d9-4cff-b3a8-638dc59ebd32 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:40.081634 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c4069a-d6d9-4cff-b3a8-638dc59ebd32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:40.108373 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-61c4069a-d6d9-4cff-b3a8-638dc59ebd32 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:41:40.110147 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-61c4069a-d6d9-4cff-b3a8-638dc59ebd32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:41:40.199300 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b5458e-3b76-4b22-a3d4-6d0a25cf8f5b None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:40.220450 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 217/427] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:41:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 21:41:40.220450 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c4069a-d6d9-4cff-b3a8-638dc59ebd32 None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:40.256303 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5392829d-a6a6-46f0-8ead-f010c796aae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:40.256920 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5392829d-a6a6-46f0-8ead-f010c796aae7 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:40.257202 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5392829d-a6a6-46f0-8ead-f010c796aae7 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:40.257478 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5392829d-a6a6-46f0-8ead-f010c796aae7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:40.323450 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:40.373346 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:40.390270 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5392829d-a6a6-46f0-8ead-f010c796aae7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:40.392498 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5392829d-a6a6-46f0-8ead-f010c796aae7 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:40.396360 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c4069a-d6d9-4cff-b3a8-638dc59ebd32 None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:40.460024 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe7c65d-6bae-45ea-ab0f-740df473e1f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:40.460583 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe7c65d-6bae-45ea-ab0f-740df473e1f3 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:40.460883 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe7c65d-6bae-45ea-ab0f-740df473e1f3 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:40.461154 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe7c65d-6bae-45ea-ab0f-740df473e1f3 None admin] PATH_INFO: `/v3/groups/900265762daa4681948a01c6028fb33c` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:40.462381 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe7c65d-6bae-45ea-ab0f-740df473e1f3 None admin] RBAC: Authorizing `identity:get_group(group_id=900265762daa4681948a01c6028fb33c)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:40.463816 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe7c65d-6bae-45ea-ab0f-740df473e1f3 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:40.465425 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 218/428] 10.222.0.27 () {56 vars in 1180 bytes} [Thu Aug 18 21:41:40 2022] GET /identity/v3/groups/900265762daa4681948a01c6028fb33c => generated 226 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:40.472703 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe7c65d-6bae-45ea-ab0f-740df473e1f3 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:40.572796 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 211/429] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Aug 18 21:41:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 18 21:41:40.579341 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5392829d-a6a6-46f0-8ead-f010c796aae7 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:40.633873 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe7c65d-6bae-45ea-ab0f-740df473e1f3 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:40.665358 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:40.672398 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34714af5-e86f-4f01-a715-97cf3413bd49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:40.673357 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34714af5-e86f-4f01-a715-97cf3413bd49 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:40.673829 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34714af5-e86f-4f01-a715-97cf3413bd49 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:40.674262 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34714af5-e86f-4f01-a715-97cf3413bd49 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:40.685343 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34714af5-e86f-4f01-a715-97cf3413bd49 None admin] RBAC: Adding query filter params (group.id=900265762daa4681948a01c6028fb33c, role.id=de8f2438056f4af9879423f8a59e0e0b, scope.project.id=e475732a8fb6447b8d2ccca84af2071a) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:41:40.685343 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34714af5-e86f-4f01-a715-97cf3413bd49 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:40.685343 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34714af5-e86f-4f01-a715-97cf3413bd49 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:40.685343 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 219/430] 10.222.0.27 () {56 vars in 1376 bytes} [Thu Aug 18 21:41:40 2022] GET /identity/v3/role_assignments?group.id=900265762daa4681948a01c6028fb33c&scope.project.id=e475732a8fb6447b8d2ccca84af2071a&role.id=de8f2438056f4af9879423f8a59e0e0b => generated 611 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:40.685343 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34714af5-e86f-4f01-a715-97cf3413bd49 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:40.717299 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:40.730733 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5392829d-a6a6-46f0-8ead-f010c796aae7 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:40.802780 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce695029-366b-448f-9fd8-14cf78015602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:40.803425 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce695029-366b-448f-9fd8-14cf78015602 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:40.803715 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce695029-366b-448f-9fd8-14cf78015602 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:40.804424 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce695029-366b-448f-9fd8-14cf78015602 None admin] PATH_INFO: `/v3/projects/e475732a8fb6447b8d2ccca84af2071a` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:40.809570 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce695029-366b-448f-9fd8-14cf78015602 None admin] RBAC: Authorizing `identity:get_project(project_id=e475732a8fb6447b8d2ccca84af2071a)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:40.811110 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce695029-366b-448f-9fd8-14cf78015602 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:40.813162 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 212/431] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Aug 18 21:41:40 2022] GET /identity/v3/projects/e475732a8fb6447b8d2ccca84af2071a => generated 298 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 21:41:40.818319 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce695029-366b-448f-9fd8-14cf78015602 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:40.819494 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34714af5-e86f-4f01-a715-97cf3413bd49 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:40.865919 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febe9edf-7888-4038-9f5e-ed12fd8d9f69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:40.866959 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febe9edf-7888-4038-9f5e-ed12fd8d9f69 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:40.867431 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febe9edf-7888-4038-9f5e-ed12fd8d9f69 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:40.867888 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febe9edf-7888-4038-9f5e-ed12fd8d9f69 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:40.880709 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febe9edf-7888-4038-9f5e-ed12fd8d9f69 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:41:40.886884 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application [None req-febe9edf-7888-4038-9f5e-ed12fd8d9f69 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 21:41:40.886884 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:41:40.886884 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:41:40.886884 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:41:40.886884 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:41:40.886884 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:41:40.886884 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:41:40.886884 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:41:40.886884 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:41:40.886884 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:41:40.886884 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:41:40.886884 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:41:40.886884 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:41:40.886884 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:41:40.886884 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:41:40.886884 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:41:40.887744 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:41:40.887744 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:41:40.887744 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:41:40.887744 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:41:40.887744 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:41:40.887744 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:41:40.887744 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:41:40.887744 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:41:40.887744 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:41:40.887744 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:41:40.887744 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:41:40.887744 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application with Lock( Aug 18 21:41:40.887744 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:41:40.887744 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:41:40.887744 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:41:40.887744 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:41:40.888581 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:41:40.888581 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:41:40.888581 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:41:40.888581 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:41:40.888581 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:41:40.888581 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:41:40.888581 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:41:40.888581 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:41:40.888581 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:41:40.888581 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:41:40.888581 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 21:41:40.888581 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:41:40.892327 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 220/432] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Aug 18 21:41:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:41:40.898313 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febe9edf-7888-4038-9f5e-ed12fd8d9f69 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:40.944022 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce695029-366b-448f-9fd8-14cf78015602 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:40.962121 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:40.990346 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4790e292-13e1-4436-a0c9-a89e8f5d5c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:40.991344 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4790e292-13e1-4436-a0c9-a89e8f5d5c61 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:40.991813 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4790e292-13e1-4436-a0c9-a89e8f5d5c61 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:40.992311 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4790e292-13e1-4436-a0c9-a89e8f5d5c61 None admin] PATH_INFO: `/v3/groups/900265762daa4681948a01c6028fb33c` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:40.994142 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4790e292-13e1-4436-a0c9-a89e8f5d5c61 None admin] RBAC: Authorizing `identity:get_group(group_id=900265762daa4681948a01c6028fb33c)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:40.996787 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4790e292-13e1-4436-a0c9-a89e8f5d5c61 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:40.999246 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 213/433] 10.222.0.27 () {56 vars in 1180 bytes} [Thu Aug 18 21:41:40 2022] GET /identity/v3/groups/900265762daa4681948a01c6028fb33c => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:41.006149 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4790e292-13e1-4436-a0c9-a89e8f5d5c61 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:41.019598 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febe9edf-7888-4038-9f5e-ed12fd8d9f69 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:41.040138 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:41.067521 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d574202-0350-4bfb-aa49-0f45831f1a27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:41.068130 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d574202-0350-4bfb-aa49-0f45831f1a27 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:41.068405 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d574202-0350-4bfb-aa49-0f45831f1a27 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:41.068721 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d574202-0350-4bfb-aa49-0f45831f1a27 None admin] PATH_INFO: `/v3/roles` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:41.069384 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d574202-0350-4bfb-aa49-0f45831f1a27 None admin] RBAC: Adding query filter params (name=member) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:41:41.070991 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d574202-0350-4bfb-aa49-0f45831f1a27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:41.071167 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d574202-0350-4bfb-aa49-0f45831f1a27 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:41.080563 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 221/434] 10.222.0.27 () {56 vars in 1101 bytes} [Thu Aug 18 21:41:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 21:41:41.081638 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d731a7-b18c-4d71-aed5-33d0172ca84b None None] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:41.081917 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d731a7-b18c-4d71-aed5-33d0172ca84b None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:41.082186 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d731a7-b18c-4d71-aed5-33d0172ca84b None None] PATH_INFO: `/` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:41.088005 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 222/435] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:41:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:41:41.089159 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d37749b-9a64-476a-8f5a-a78841c60f88 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:41.089437 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d37749b-9a64-476a-8f5a-a78841c60f88 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:41.089711 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d37749b-9a64-476a-8f5a-a78841c60f88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:41.111693 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-5d37749b-9a64-476a-8f5a-a78841c60f88 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:41:41.112545 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-5d37749b-9a64-476a-8f5a-a78841c60f88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:41:41.150636 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4790e292-13e1-4436-a0c9-a89e8f5d5c61 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:41.192789 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5972aa7e-1595-4767-a9e8-e78e8b84bb3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:41.193724 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5972aa7e-1595-4767-a9e8-e78e8b84bb3c None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:41.194003 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5972aa7e-1595-4767-a9e8-e78e8b84bb3c None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:41.194272 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5972aa7e-1595-4767-a9e8-e78e8b84bb3c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:41.194995 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5972aa7e-1595-4767-a9e8-e78e8b84bb3c None admin] RBAC: Adding query filter params (group.id=900265762daa4681948a01c6028fb33c, role.id=66171a9efb5344c7a903946f238a3808, scope.project.id=e475732a8fb6447b8d2ccca84af2071a) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:41:41.195299 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5972aa7e-1595-4767-a9e8-e78e8b84bb3c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:41.197433 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5972aa7e-1595-4767-a9e8-e78e8b84bb3c None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:41.205195 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 214/436] 10.222.0.27 () {56 vars in 1376 bytes} [Thu Aug 18 21:41:41 2022] GET /identity/v3/role_assignments?group.id=900265762daa4681948a01c6028fb33c&scope.project.id=e475732a8fb6447b8d2ccca84af2071a&role.id=66171a9efb5344c7a903946f238a3808 => generated 611 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 21:41:41.205793 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5972aa7e-1595-4767-a9e8-e78e8b84bb3c None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:41.211344 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 223/437] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:41:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 21:41:41.286800 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81163ee-d37d-4eba-9d30-1c759d0927a9 None None] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:41.287153 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81163ee-d37d-4eba-9d30-1c759d0927a9 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:41.287431 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81163ee-d37d-4eba-9d30-1c759d0927a9 None None] PATH_INFO: `/` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:41.288889 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 224/438] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:41:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:41:41.295804 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fac43b9-4445-4d2d-8e11-810c3f049fb9 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:41.296128 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fac43b9-4445-4d2d-8e11-810c3f049fb9 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:41.296352 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fac43b9-4445-4d2d-8e11-810c3f049fb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:41.326620 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:41.329978 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-1fac43b9-4445-4d2d-8e11-810c3f049fb9 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:41:41.331233 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-1fac43b9-4445-4d2d-8e11-810c3f049fb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:41:41.338966 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5972aa7e-1595-4767-a9e8-e78e8b84bb3c None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:41.379004 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977029f1-1fcf-4a2a-9aa0-c761a33d0865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:41.379864 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977029f1-1fcf-4a2a-9aa0-c761a33d0865 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:41.380289 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977029f1-1fcf-4a2a-9aa0-c761a33d0865 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:41.380737 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977029f1-1fcf-4a2a-9aa0-c761a33d0865 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:41.411102 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:41.446020 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 225/439] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:41:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 21:41:41.467658 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977029f1-1fcf-4a2a-9aa0-c761a33d0865 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:41.469536 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977029f1-1fcf-4a2a-9aa0-c761a33d0865 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:41.517044 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fac43b9-4445-4d2d-8e11-810c3f049fb9 None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:41.580013 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:41.594858 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 215/440] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Aug 18 21:41:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 21:41:41.600783 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977029f1-1fcf-4a2a-9aa0-c761a33d0865 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:41.649601 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fac43b9-4445-4d2d-8e11-810c3f049fb9 None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:41.695167 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f73d32-ca3d-48e3-a526-a551f69f0c05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:41.695804 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f73d32-ca3d-48e3-a526-a551f69f0c05 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:41.696107 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f73d32-ca3d-48e3-a526-a551f69f0c05 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:41.696377 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f73d32-ca3d-48e3-a526-a551f69f0c05 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:41.711386 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f73d32-ca3d-48e3-a526-a551f69f0c05 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:41:41.716162 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application [None req-42f73d32-ca3d-48e3-a526-a551f69f0c05 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 21:41:41.716162 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:41:41.716162 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:41:41.716162 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:41:41.716162 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:41:41.716162 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:41:41.716162 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:41:41.716162 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:41:41.716162 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:41:41.716162 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:41:41.716162 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:41:41.716162 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:41:41.716162 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:41:41.716162 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:41:41.716162 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:41:41.716162 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:41:41.717366 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:41:41.717366 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:41:41.717366 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:41:41.717366 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:41:41.717366 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:41:41.717366 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:41:41.717366 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:41:41.717366 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:41:41.717366 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:41:41.717366 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:41:41.717366 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:41:41.717366 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application with Lock( Aug 18 21:41:41.717366 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:41:41.717366 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:41:41.717366 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:41:41.717366 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:41:41.718405 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:41:41.718405 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:41:41.718405 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:41:41.718405 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:41:41.718405 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:41:41.718405 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:41:41.718405 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:41:41.718405 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:41:41.718405 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:41:41.718405 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:41:41.718405 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 21:41:41.718405 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:41:41.718405 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 226/441] 10.222.0.27 () {56 vars in 1114 bytes} [Thu Aug 18 21:41:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 21:41:41.718405 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f73d32-ca3d-48e3-a526-a551f69f0c05 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:41.739602 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977029f1-1fcf-4a2a-9aa0-c761a33d0865 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:41.760323 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:41.776319 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751c1b9a-1f17-4a71-ae01-ff0a65bcc1ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:41.776980 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751c1b9a-1f17-4a71-ae01-ff0a65bcc1ee None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:41.777259 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751c1b9a-1f17-4a71-ae01-ff0a65bcc1ee None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:41.777530 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751c1b9a-1f17-4a71-ae01-ff0a65bcc1ee None admin] PATH_INFO: `/v3/projects/5cfc98a315f14e00a8cddaa2c57a9da6` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:41.778739 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751c1b9a-1f17-4a71-ae01-ff0a65bcc1ee None admin] RBAC: Authorizing `identity:get_project(project_id=5cfc98a315f14e00a8cddaa2c57a9da6)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:41.780200 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751c1b9a-1f17-4a71-ae01-ff0a65bcc1ee None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:41.782723 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 216/442] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Aug 18 21:41:41 2022] GET /identity/v3/projects/5cfc98a315f14e00a8cddaa2c57a9da6 => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:41.783608 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751c1b9a-1f17-4a71-ae01-ff0a65bcc1ee None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:41.830160 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f73d32-ca3d-48e3-a526-a551f69f0c05 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:41.840880 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:41.863991 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f21a9e-0305-4ec5-8f7c-2c22f203a46f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:41.864706 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f21a9e-0305-4ec5-8f7c-2c22f203a46f None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:41.864989 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f21a9e-0305-4ec5-8f7c-2c22f203a46f None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:41.865262 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f21a9e-0305-4ec5-8f7c-2c22f203a46f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:41.876027 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f21a9e-0305-4ec5-8f7c-2c22f203a46f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:41:41.880816 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application [None req-83f21a9e-0305-4ec5-8f7c-2c22f203a46f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 21:41:41.880816 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:41:41.880816 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:41:41.880816 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:41:41.880816 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:41:41.880816 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:41:41.880816 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:41:41.880816 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:41:41.880816 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:41:41.880816 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:41:41.880816 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:41:41.880816 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:41:41.880816 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:41:41.880816 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:41:41.880816 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:41:41.880816 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:41:41.881858 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:41:41.881858 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:41:41.881858 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:41:41.881858 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:41:41.881858 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:41:41.881858 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:41:41.881858 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:41:41.881858 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:41:41.881858 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:41:41.881858 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:41:41.881858 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:41:41.881858 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application with Lock( Aug 18 21:41:41.881858 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:41:41.881858 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:41:41.881858 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:41:41.881858 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:41:41.882969 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:41:41.882969 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:41:41.882969 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:41:41.882969 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:41:41.882969 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:41:41.882969 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:41:41.882969 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:41:41.882969 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:41:41.882969 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:41:41.882969 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:41:41.882969 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 21:41:41.882969 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:41:41.882969 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 227/443] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Aug 18 21:41:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:41:41.882969 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f21a9e-0305-4ec5-8f7c-2c22f203a46f None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:41.887039 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751c1b9a-1f17-4a71-ae01-ff0a65bcc1ee None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:41.921242 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74a86e8-38b9-456d-a9b0-4684f8b70bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:41.921870 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74a86e8-38b9-456d-a9b0-4684f8b70bd3 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:41.922148 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74a86e8-38b9-456d-a9b0-4684f8b70bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:41.922511 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74a86e8-38b9-456d-a9b0-4684f8b70bd3 None admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:41.923189 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74a86e8-38b9-456d-a9b0-4684f8b70bd3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:41:41.923478 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74a86e8-38b9-456d-a9b0-4684f8b70bd3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:41.924882 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74a86e8-38b9-456d-a9b0-4684f8b70bd3 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:41.932523 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 217/444] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Aug 18 21:41:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:41.933335 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74a86e8-38b9-456d-a9b0-4684f8b70bd3 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:41.981484 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:41.987203 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f21a9e-0305-4ec5-8f7c-2c22f203a46f None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:42.021109 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01a6bf1-c094-4e83-9179-35cc0af97788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:42.021725 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01a6bf1-c094-4e83-9179-35cc0af97788 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:42.022007 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01a6bf1-c094-4e83-9179-35cc0af97788 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:42.022273 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01a6bf1-c094-4e83-9179-35cc0af97788 None admin] PATH_INFO: `/v3/groups/900265762daa4681948a01c6028fb33c` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:42.023368 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01a6bf1-c094-4e83-9179-35cc0af97788 None admin] RBAC: Authorizing `identity:get_group(group_id=900265762daa4681948a01c6028fb33c)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:42.024845 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01a6bf1-c094-4e83-9179-35cc0af97788 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:42.026394 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 228/445] 10.222.0.27 () {56 vars in 1180 bytes} [Thu Aug 18 21:41:41 2022] GET /identity/v3/groups/900265762daa4681948a01c6028fb33c => generated 226 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:42.027148 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01a6bf1-c094-4e83-9179-35cc0af97788 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:42.037009 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74a86e8-38b9-456d-a9b0-4684f8b70bd3 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:42.055850 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:42.070074 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b398f558-7c73-47f5-838c-441cbda52ef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:42.070782 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b398f558-7c73-47f5-838c-441cbda52ef1 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:42.071061 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b398f558-7c73-47f5-838c-441cbda52ef1 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:42.071321 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b398f558-7c73-47f5-838c-441cbda52ef1 None admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:42.071984 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b398f558-7c73-47f5-838c-441cbda52ef1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:41:42.072283 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b398f558-7c73-47f5-838c-441cbda52ef1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:42.073687 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b398f558-7c73-47f5-838c-441cbda52ef1 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:42.083454 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 218/446] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Aug 18 21:41:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:42.084107 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b398f558-7c73-47f5-838c-441cbda52ef1 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:42.128481 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01a6bf1-c094-4e83-9179-35cc0af97788 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:42.163100 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4714ba-24cb-431d-b41f-c91d6b98ebd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:42.163705 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4714ba-24cb-431d-b41f-c91d6b98ebd5 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:42.163994 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4714ba-24cb-431d-b41f-c91d6b98ebd5 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:42.164308 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4714ba-24cb-431d-b41f-c91d6b98ebd5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:42.182830 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b398f558-7c73-47f5-838c-441cbda52ef1 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:42.196298 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:42.216962 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9401edc4-b944-4c2a-805d-6312456eefa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:42.217561 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9401edc4-b944-4c2a-805d-6312456eefa7 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:42.217885 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9401edc4-b944-4c2a-805d-6312456eefa7 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:42.218150 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9401edc4-b944-4c2a-805d-6312456eefa7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:42.219236 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9401edc4-b944-4c2a-805d-6312456eefa7 None admin] RBAC: Adding query filter params (group.id=900265762daa4681948a01c6028fb33c, role.id=de8f2438056f4af9879423f8a59e0e0b, scope.project.id=5cfc98a315f14e00a8cddaa2c57a9da6) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:41:42.219543 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9401edc4-b944-4c2a-805d-6312456eefa7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:42.221035 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9401edc4-b944-4c2a-805d-6312456eefa7 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:42.226618 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 219/447] 10.222.0.27 () {56 vars in 1376 bytes} [Thu Aug 18 21:41:42 2022] GET /identity/v3/role_assignments?group.id=900265762daa4681948a01c6028fb33c&scope.project.id=5cfc98a315f14e00a8cddaa2c57a9da6&role.id=de8f2438056f4af9879423f8a59e0e0b => generated 611 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:42.227386 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9401edc4-b944-4c2a-805d-6312456eefa7 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:42.232852 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4714ba-24cb-431d-b41f-c91d6b98ebd5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:42.234421 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4714ba-24cb-431d-b41f-c91d6b98ebd5 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:42.290737 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:42.357747 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9401edc4-b944-4c2a-805d-6312456eefa7 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:42.362783 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 229/448] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Aug 18 21:41:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 21:41:42.368744 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4714ba-24cb-431d-b41f-c91d6b98ebd5 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:42.398694 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c9a271-9fc5-4e73-a6bc-860da03f7e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:42.399645 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c9a271-9fc5-4e73-a6bc-860da03f7e38 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:42.399925 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c9a271-9fc5-4e73-a6bc-860da03f7e38 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:42.400196 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c9a271-9fc5-4e73-a6bc-860da03f7e38 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:42.444526 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:42.485778 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c9a271-9fc5-4e73-a6bc-860da03f7e38 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:42.487264 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c9a271-9fc5-4e73-a6bc-860da03f7e38 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:42.488947 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4714ba-24cb-431d-b41f-c91d6b98ebd5 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:42.531779 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54120f7e-e0d9-4cb6-9871-3dcc7e47aea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:42.532469 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54120f7e-e0d9-4cb6-9871-3dcc7e47aea0 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:42.532823 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54120f7e-e0d9-4cb6-9871-3dcc7e47aea0 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:42.533466 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54120f7e-e0d9-4cb6-9871-3dcc7e47aea0 None admin] PATH_INFO: `/v3/projects/5cfc98a315f14e00a8cddaa2c57a9da6` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:42.534936 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54120f7e-e0d9-4cb6-9871-3dcc7e47aea0 None admin] RBAC: Authorizing `identity:get_project(project_id=5cfc98a315f14e00a8cddaa2c57a9da6)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:42.536372 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54120f7e-e0d9-4cb6-9871-3dcc7e47aea0 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:42.538286 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 230/449] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Aug 18 21:41:42 2022] GET /identity/v3/projects/5cfc98a315f14e00a8cddaa2c57a9da6 => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:42.539243 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:42.544134 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54120f7e-e0d9-4cb6-9871-3dcc7e47aea0 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:42.603669 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 220/450] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Aug 18 21:41:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 21:41:42.609916 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c9a271-9fc5-4e73-a6bc-860da03f7e38 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:42.656370 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54120f7e-e0d9-4cb6-9871-3dcc7e47aea0 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:42.685987 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:42.691581 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023d77bf-5147-44e7-9a3f-97434a8d4478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:42.699153 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023d77bf-5147-44e7-9a3f-97434a8d4478 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:42.699153 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023d77bf-5147-44e7-9a3f-97434a8d4478 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:42.699153 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023d77bf-5147-44e7-9a3f-97434a8d4478 None admin] PATH_INFO: `/v3/groups/900265762daa4681948a01c6028fb33c` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:42.699153 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023d77bf-5147-44e7-9a3f-97434a8d4478 None admin] RBAC: Authorizing `identity:get_group(group_id=900265762daa4681948a01c6028fb33c)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:42.699153 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023d77bf-5147-44e7-9a3f-97434a8d4478 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:42.699153 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 231/451] 10.222.0.27 () {56 vars in 1180 bytes} [Thu Aug 18 21:41:42 2022] GET /identity/v3/groups/900265762daa4681948a01c6028fb33c => generated 226 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 21:41:42.702941 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023d77bf-5147-44e7-9a3f-97434a8d4478 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:42.708212 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c9a271-9fc5-4e73-a6bc-860da03f7e38 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:42.742742 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f857e8c-1d8e-4b28-82bb-3140a41706aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:42.743363 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f857e8c-1d8e-4b28-82bb-3140a41706aa None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:42.743641 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f857e8c-1d8e-4b28-82bb-3140a41706aa None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:42.743912 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f857e8c-1d8e-4b28-82bb-3140a41706aa None admin] PATH_INFO: `/v3/projects/c586edb6eda041a285eb97d5b15554f4` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:42.745049 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f857e8c-1d8e-4b28-82bb-3140a41706aa None admin] RBAC: Authorizing `identity:get_project(project_id=c586edb6eda041a285eb97d5b15554f4)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:42.746505 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f857e8c-1d8e-4b28-82bb-3140a41706aa None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:42.748277 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 221/452] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Aug 18 21:41:42 2022] GET /identity/v3/projects/c586edb6eda041a285eb97d5b15554f4 => generated 344 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 21:41:42.754294 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f857e8c-1d8e-4b28-82bb-3140a41706aa None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:42.769157 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:42.802616 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023d77bf-5147-44e7-9a3f-97434a8d4478 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:42.835787 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e645d0-66f2-4a46-a915-b2521cd5817c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:42.836388 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e645d0-66f2-4a46-a915-b2521cd5817c None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:42.836762 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e645d0-66f2-4a46-a915-b2521cd5817c None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:42.837040 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e645d0-66f2-4a46-a915-b2521cd5817c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:42.837758 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e645d0-66f2-4a46-a915-b2521cd5817c None admin] RBAC: Adding query filter params (group.id=900265762daa4681948a01c6028fb33c, role.id=66171a9efb5344c7a903946f238a3808, scope.project.id=5cfc98a315f14e00a8cddaa2c57a9da6) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:41:42.838073 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e645d0-66f2-4a46-a915-b2521cd5817c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:42.839502 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e645d0-66f2-4a46-a915-b2521cd5817c None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:42.845705 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 232/453] 10.222.0.27 () {56 vars in 1376 bytes} [Thu Aug 18 21:41:42 2022] GET /identity/v3/role_assignments?group.id=900265762daa4681948a01c6028fb33c&scope.project.id=5cfc98a315f14e00a8cddaa2c57a9da6&role.id=66171a9efb5344c7a903946f238a3808 => generated 611 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 21:41:42.854139 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f857e8c-1d8e-4b28-82bb-3140a41706aa None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:42.891579 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b695778-fc39-42b1-bc1e-c74a50fa1162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:42.892137 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b695778-fc39-42b1-bc1e-c74a50fa1162 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:42.892412 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b695778-fc39-42b1-bc1e-c74a50fa1162 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:42.892709 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b695778-fc39-42b1-bc1e-c74a50fa1162 None admin] PATH_INFO: `/v3/groups/317888c0f57d4ee0bb65ecf107e32250` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:42.893905 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b695778-fc39-42b1-bc1e-c74a50fa1162 None admin] RBAC: Authorizing `identity:get_group(group_id=317888c0f57d4ee0bb65ecf107e32250)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:42.895374 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b695778-fc39-42b1-bc1e-c74a50fa1162 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:42.897082 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 222/454] 10.222.0.27 () {56 vars in 1180 bytes} [Thu Aug 18 21:41:42 2022] GET /identity/v3/groups/317888c0f57d4ee0bb65ecf107e32250 => generated 229 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 21:41:42.903070 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e645d0-66f2-4a46-a915-b2521cd5817c None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:42.967296 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:43.006859 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e645d0-66f2-4a46-a915-b2521cd5817c None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:43.041086 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbd677d-a58b-4a37-a5e1-ed8354d75470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:43.041681 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbd677d-a58b-4a37-a5e1-ed8354d75470 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:43.041958 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbd677d-a58b-4a37-a5e1-ed8354d75470 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:43.042229 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbd677d-a58b-4a37-a5e1-ed8354d75470 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:43.042949 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbd677d-a58b-4a37-a5e1-ed8354d75470 None admin] RBAC: Adding query filter params (group.id=317888c0f57d4ee0bb65ecf107e32250, role.id=0833202e2a3d47d1b6b3af57006641b1, scope.project.id=c586edb6eda041a285eb97d5b15554f4) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:41:43.043249 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbd677d-a58b-4a37-a5e1-ed8354d75470 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:43.044695 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbd677d-a58b-4a37-a5e1-ed8354d75470 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:43.051013 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 233/455] 10.222.0.27 () {56 vars in 1376 bytes} [Thu Aug 18 21:41:42 2022] GET /identity/v3/role_assignments?group.id=317888c0f57d4ee0bb65ecf107e32250&scope.project.id=c586edb6eda041a285eb97d5b15554f4&role.id=0833202e2a3d47d1b6b3af57006641b1 => generated 611 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:45.361611 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1bc471-121f-48f3-9143-cbb7c35acde2 None None] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:45.362120 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1bc471-121f-48f3-9143-cbb7c35acde2 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:45.362200 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1bc471-121f-48f3-9143-cbb7c35acde2 None None] PATH_INFO: `/` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:45.363769 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 223/456] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:41:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 21:41:45.368778 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201b546f-72eb-4793-818b-6aebf1cb8c44 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:45.369584 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201b546f-72eb-4793-818b-6aebf1cb8c44 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:45.370063 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201b546f-72eb-4793-818b-6aebf1cb8c44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:45.397597 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-201b546f-72eb-4793-818b-6aebf1cb8c44 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:41:45.399188 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-201b546f-72eb-4793-818b-6aebf1cb8c44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:41:45.495789 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 234/457] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:41:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 21:41:45.568584 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ede61-e650-489c-9a13-1c235b405d99 None None] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:45.569325 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ede61-e650-489c-9a13-1c235b405d99 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:45.569803 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ede61-e650-489c-9a13-1c235b405d99 None None] PATH_INFO: `/` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:45.571364 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 224/458] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:41:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:41:45.582659 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4384620e-50fb-4ab8-bf8c-66b1d8e234d3 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:45.583187 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4384620e-50fb-4ab8-bf8c-66b1d8e234d3 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:45.583660 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4384620e-50fb-4ab8-bf8c-66b1d8e234d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:45.610366 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-4384620e-50fb-4ab8-bf8c-66b1d8e234d3 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:41:45.611996 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-4384620e-50fb-4ab8-bf8c-66b1d8e234d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:41:45.686730 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:45.704756 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 235/459] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:41:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 21:41:45.884911 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ad6e7c-431f-4a74-8784-fc366993c8c2 None None] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:45.885433 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ad6e7c-431f-4a74-8784-fc366993c8c2 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:45.885855 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ad6e7c-431f-4a74-8784-fc366993c8c2 None None] PATH_INFO: `/` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:45.887353 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 225/460] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:41:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:41:45.893057 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea51cf1c-52cf-46e0-bdb1-984710179ac8 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:45.893522 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea51cf1c-52cf-46e0-bdb1-984710179ac8 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:45.893942 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea51cf1c-52cf-46e0-bdb1-984710179ac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:45.899750 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ad6e7c-431f-4a74-8784-fc366993c8c2 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:45.936488 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-ea51cf1c-52cf-46e0-bdb1-984710179ac8 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:41:45.937963 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-ea51cf1c-52cf-46e0-bdb1-984710179ac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:41:45.996323 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:46.045877 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ad6e7c-431f-4a74-8784-fc366993c8c2 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:46.077109 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 236/461] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:41:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 21:41:46.078718 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea51cf1c-52cf-46e0-bdb1-984710179ac8 None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:46.108625 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3257d93b-4086-4ad4-b0ca-fc00147d8f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:46.109881 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3257d93b-4086-4ad4-b0ca-fc00147d8f9f None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:46.110165 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3257d93b-4086-4ad4-b0ca-fc00147d8f9f None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:46.110438 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3257d93b-4086-4ad4-b0ca-fc00147d8f9f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:46.126070 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3257d93b-4086-4ad4-b0ca-fc00147d8f9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:46.127788 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3257d93b-4086-4ad4-b0ca-fc00147d8f9f None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:46.155222 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application [None req-3257d93b-4086-4ad4-b0ca-fc00147d8f9f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:41:46.155222 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:41:46.155222 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:41:46.155222 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:41:46.155222 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:41:46.155222 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:41:46.155222 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:41:46.155222 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:41:46.155222 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:41:46.155222 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:41:46.155222 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:41:46.155222 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:41:46.155222 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 21:41:46.155222 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 21:41:46.155222 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 21:41:46.155222 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 21:41:46.156494 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:41:46.156494 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:41:46.156494 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:41:46.156494 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:41:46.156494 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:41:46.156494 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:41:46.156494 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:41:46.156494 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application with Lock( Aug 18 21:41:46.156494 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:41:46.156494 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:41:46.156494 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:41:46.156494 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:41:46.156494 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:41:46.156494 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:41:46.156494 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:41:46.156494 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:41:46.156494 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 21:41:46.157536 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 21:41:46.157536 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:41:46.157536 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:41:46.159184 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 226/462] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 18 21:41:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 21:41:46.164950 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3257d93b-4086-4ad4-b0ca-fc00147d8f9f None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:46.192292 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea51cf1c-52cf-46e0-bdb1-984710179ac8 None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:46.210866 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:46.237711 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff46929-e0cc-4503-8223-9e6e0ba30de6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:46.238668 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff46929-e0cc-4503-8223-9e6e0ba30de6 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:46.239046 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff46929-e0cc-4503-8223-9e6e0ba30de6 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:46.239775 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff46929-e0cc-4503-8223-9e6e0ba30de6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:46.253257 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff46929-e0cc-4503-8223-9e6e0ba30de6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:46.255825 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff46929-e0cc-4503-8223-9e6e0ba30de6 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:46.274159 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application [None req-0ff46929-e0cc-4503-8223-9e6e0ba30de6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:41:46.274159 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:41:46.274159 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:41:46.274159 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:41:46.274159 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:41:46.274159 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:41:46.274159 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:41:46.274159 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:41:46.274159 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:41:46.274159 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:41:46.274159 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:41:46.274159 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:41:46.274159 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 21:41:46.274159 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 21:41:46.274159 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 21:41:46.274159 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 21:41:46.275099 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:41:46.275099 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:41:46.275099 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:41:46.275099 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:41:46.275099 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:41:46.275099 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:41:46.275099 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:41:46.275099 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application with Lock( Aug 18 21:41:46.275099 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:41:46.275099 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:41:46.275099 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:41:46.275099 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:41:46.275099 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:41:46.275099 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:41:46.275099 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:41:46.275099 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:41:46.275099 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 21:41:46.275954 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 21:41:46.275954 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:41:46.275954 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:41:46.276539 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 237/463] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 18 21:41:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:41:46.277723 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf931c5-b982-4465-a161-781cf588388c None None] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:46.278004 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf931c5-b982-4465-a161-781cf588388c None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:46.278278 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf931c5-b982-4465-a161-781cf588388c None None] PATH_INFO: `/` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:46.283672 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 238/464] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:41:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:41:46.284965 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9565174b-173c-41ef-ae88-d43143312edc None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:46.285249 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9565174b-173c-41ef-ae88-d43143312edc None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:46.285519 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9565174b-173c-41ef-ae88-d43143312edc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:46.309707 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-9565174b-173c-41ef-ae88-d43143312edc None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:41:46.311185 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-9565174b-173c-41ef-ae88-d43143312edc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:41:46.323265 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3257d93b-4086-4ad4-b0ca-fc00147d8f9f None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:46.367443 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0670f658-6fda-4e72-9a9f-73756235ede5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:46.369013 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0670f658-6fda-4e72-9a9f-73756235ede5 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:46.369301 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0670f658-6fda-4e72-9a9f-73756235ede5 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:46.369576 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0670f658-6fda-4e72-9a9f-73756235ede5 None admin] PATH_INFO: `/v3/domains` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:46.370232 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0670f658-6fda-4e72-9a9f-73756235ede5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:41:46.370533 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0670f658-6fda-4e72-9a9f-73756235ede5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:46.372857 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0670f658-6fda-4e72-9a9f-73756235ede5 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:46.377188 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:46.392470 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 227/465] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 18 21:41:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 21:41:46.394345 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0670f658-6fda-4e72-9a9f-73756235ede5 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:46.403068 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 239/466] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:41:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 21:41:46.404550 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9565174b-173c-41ef-ae88-d43143312edc None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:46.539404 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:46.543004 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9565174b-173c-41ef-ae88-d43143312edc None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:46.546463 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0670f658-6fda-4e72-9a9f-73756235ede5 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:46.582955 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fbf341-f309-4359-97c2-4c44047e302a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:46.583904 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fbf341-f309-4359-97c2-4c44047e302a None admin] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:46.584477 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fbf341-f309-4359-97c2-4c44047e302a None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:46.584935 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fbf341-f309-4359-97c2-4c44047e302a None admin] PATH_INFO: `/v3/users` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:46.585896 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fbf341-f309-4359-97c2-4c44047e302a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:46.587633 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fbf341-f309-4359-97c2-4c44047e302a None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:46.593111 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eef062d-127b-4ddf-9c91-971a29332dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:46.593935 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eef062d-127b-4ddf-9c91-971a29332dcc None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:46.594286 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eef062d-127b-4ddf-9c91-971a29332dcc None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:46.594623 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eef062d-127b-4ddf-9c91-971a29332dcc None admin] PATH_INFO: `/v3/domains` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:46.595332 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eef062d-127b-4ddf-9c91-971a29332dcc None admin] RBAC: Adding query filter params (name=Default) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:41:46.595692 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eef062d-127b-4ddf-9c91-971a29332dcc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:46.597185 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eef062d-127b-4ddf-9c91-971a29332dcc None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:46.610547 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 228/467] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 18 21:41:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:46.615841 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eef062d-127b-4ddf-9c91-971a29332dcc None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:46.668634 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 240/468] 10.222.0.27 () {60 vars in 1132 bytes} [Thu Aug 18 21:41:46 2022] POST /identity/v3/users => generated 246 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:41:46.670490 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fbf341-f309-4359-97c2-4c44047e302a None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:46.672809 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:46.756189 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eef062d-127b-4ddf-9c91-971a29332dcc None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:46.796244 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76815fc1-7441-42a4-bd55-e5463cad9efc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:46.796876 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76815fc1-7441-42a4-bd55-e5463cad9efc None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:46.797728 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76815fc1-7441-42a4-bd55-e5463cad9efc None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:46.798056 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76815fc1-7441-42a4-bd55-e5463cad9efc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:46.810502 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76815fc1-7441-42a4-bd55-e5463cad9efc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:46.812073 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76815fc1-7441-42a4-bd55-e5463cad9efc None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:46.821764 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fbf341-f309-4359-97c2-4c44047e302a None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:46.830424 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application [None req-76815fc1-7441-42a4-bd55-e5463cad9efc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:41:46.830424 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:41:46.830424 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:41:46.830424 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:41:46.830424 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:41:46.830424 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:41:46.830424 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:41:46.830424 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:41:46.830424 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:41:46.830424 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:41:46.830424 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:41:46.830424 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:41:46.830424 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 21:41:46.830424 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 21:41:46.830424 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 21:41:46.830424 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 21:41:46.831333 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:41:46.831333 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:41:46.831333 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:41:46.831333 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:41:46.831333 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:41:46.831333 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:41:46.831333 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:41:46.831333 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application with Lock( Aug 18 21:41:46.831333 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:41:46.831333 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:41:46.831333 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:41:46.831333 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:41:46.831333 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:41:46.831333 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:41:46.831333 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:41:46.831333 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:41:46.831333 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 21:41:46.832228 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 21:41:46.832228 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:41:46.832228 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:41:46.832228 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 229/469] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 18 21:41:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:41:46.832438 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76815fc1-7441-42a4-bd55-e5463cad9efc None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:46.877931 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a92cf6-5658-4feb-a916-7aaf9e762bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:46.878555 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a92cf6-5658-4feb-a916-7aaf9e762bd3 None admin] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:46.878835 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a92cf6-5658-4feb-a916-7aaf9e762bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:46.879120 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a92cf6-5658-4feb-a916-7aaf9e762bd3 None admin] PATH_INFO: `/v3/users` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:46.879751 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a92cf6-5658-4feb-a916-7aaf9e762bd3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:46.881221 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a92cf6-5658-4feb-a916-7aaf9e762bd3 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:46.951947 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 241/470] 10.222.0.27 () {60 vars in 1132 bytes} [Thu Aug 18 21:41:46 2022] POST /identity/v3/users => generated 248 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:41:46.953431 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a92cf6-5658-4feb-a916-7aaf9e762bd3 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:46.958947 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76815fc1-7441-42a4-bd55-e5463cad9efc None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:46.967567 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:46.975252 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:46.997830 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085a1840-ba56-48c1-87ce-7bf2c1448202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:46.998483 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085a1840-ba56-48c1-87ce-7bf2c1448202 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:46.998763 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085a1840-ba56-48c1-87ce-7bf2c1448202 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:46.999061 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085a1840-ba56-48c1-87ce-7bf2c1448202 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:47.010654 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085a1840-ba56-48c1-87ce-7bf2c1448202 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:47.012198 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085a1840-ba56-48c1-87ce-7bf2c1448202 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:47.028611 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application [None req-085a1840-ba56-48c1-87ce-7bf2c1448202 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:41:47.028611 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:41:47.028611 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:41:47.028611 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:41:47.028611 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:41:47.028611 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:41:47.028611 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:41:47.028611 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:41:47.028611 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:41:47.028611 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:41:47.028611 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:41:47.028611 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:41:47.028611 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 21:41:47.028611 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 21:41:47.028611 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 21:41:47.028611 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 21:41:47.029582 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:41:47.029582 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:41:47.029582 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:41:47.029582 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:41:47.029582 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:41:47.029582 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:41:47.029582 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:41:47.029582 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application with Lock( Aug 18 21:41:47.029582 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:41:47.029582 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:41:47.029582 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:41:47.029582 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:41:47.029582 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:41:47.029582 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:41:47.029582 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:41:47.029582 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:41:47.029582 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 21:41:47.031029 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 21:41:47.031029 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:41:47.031029 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:41:47.031029 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 230/471] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 18 21:41:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:41:47.031029 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ee1fce-2fff-4628-b73e-9b394b29f1ce None None] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:47.031911 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ee1fce-2fff-4628-b73e-9b394b29f1ce None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:47.032110 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ee1fce-2fff-4628-b73e-9b394b29f1ce None None] PATH_INFO: `/` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:47.034019 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 231/472] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:41:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:41:47.038580 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ee1fce-2fff-4628-b73e-9b394b29f1ce None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:47.108071 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a92cf6-5658-4feb-a916-7aaf9e762bd3 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:47.153111 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27decea4-32e4-4320-a668-424f18e1e59e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:47.154106 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27decea4-32e4-4320-a668-424f18e1e59e None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:47.154586 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27decea4-32e4-4320-a668-424f18e1e59e None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:47.155041 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27decea4-32e4-4320-a668-424f18e1e59e None admin] PATH_INFO: `/v3/domains` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:47.155694 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27decea4-32e4-4320-a668-424f18e1e59e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:41:47.155998 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27decea4-32e4-4320-a668-424f18e1e59e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:47.157999 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27decea4-32e4-4320-a668-424f18e1e59e None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:47.173926 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 242/473] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 18 21:41:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:47.174528 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ee1fce-2fff-4628-b73e-9b394b29f1ce None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:47.175093 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617411d5-204a-416f-9014-ab97adb17d26 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:47.175378 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617411d5-204a-416f-9014-ab97adb17d26 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:47.175650 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617411d5-204a-416f-9014-ab97adb17d26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:47.194677 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-617411d5-204a-416f-9014-ab97adb17d26 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:41:47.196765 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-617411d5-204a-416f-9014-ab97adb17d26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:41:47.223341 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6341f5fa-1cd9-42de-9e37-96f6d8fa045a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:47.223949 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6341f5fa-1cd9-42de-9e37-96f6d8fa045a None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:47.224329 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6341f5fa-1cd9-42de-9e37-96f6d8fa045a None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:47.224620 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6341f5fa-1cd9-42de-9e37-96f6d8fa045a None admin] PATH_INFO: `/v3/domains` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:47.225404 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6341f5fa-1cd9-42de-9e37-96f6d8fa045a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:41:47.225706 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6341f5fa-1cd9-42de-9e37-96f6d8fa045a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:47.227194 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6341f5fa-1cd9-42de-9e37-96f6d8fa045a None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:47.241328 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 232/474] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 18 21:41:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 21:41:47.242155 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6341f5fa-1cd9-42de-9e37-96f6d8fa045a None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:47.281335 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 243/475] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:41:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 21:41:47.281526 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:47.282210 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617411d5-204a-416f-9014-ab97adb17d26 None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:47.288120 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:47.399520 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617411d5-204a-416f-9014-ab97adb17d26 None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:47.441749 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7727c114-2184-4b65-a8c9-fe0b15905c3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:47.442491 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7727c114-2184-4b65-a8c9-fe0b15905c3f None admin] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:47.442776 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7727c114-2184-4b65-a8c9-fe0b15905c3f None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:47.443049 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7727c114-2184-4b65-a8c9-fe0b15905c3f None admin] PATH_INFO: `/v3/users` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:47.443689 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7727c114-2184-4b65-a8c9-fe0b15905c3f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:47.445707 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7727c114-2184-4b65-a8c9-fe0b15905c3f None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:47.478661 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6341f5fa-1cd9-42de-9e37-96f6d8fa045a None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:47.518494 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3257a5e2-472f-4fee-844a-9bc154ff0622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:47.519141 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3257a5e2-472f-4fee-844a-9bc154ff0622 None admin] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:47.519426 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3257a5e2-472f-4fee-844a-9bc154ff0622 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:47.519698 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3257a5e2-472f-4fee-844a-9bc154ff0622 None admin] PATH_INFO: `/v3/users` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:47.520335 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3257a5e2-472f-4fee-844a-9bc154ff0622 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:47.521797 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3257a5e2-472f-4fee-844a-9bc154ff0622 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:47.547479 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 244/476] 10.222.0.27 () {60 vars in 1132 bytes} [Thu Aug 18 21:41:47 2022] POST /identity/v3/users => generated 249 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:41:47.569649 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7727c114-2184-4b65-a8c9-fe0b15905c3f None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:47.605546 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 233/477] 10.222.0.27 () {60 vars in 1132 bytes} [Thu Aug 18 21:41:47 2022] POST /identity/v3/users => generated 248 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:41:47.655251 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:47.717002 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7727c114-2184-4b65-a8c9-fe0b15905c3f None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:47.754977 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc7bc31-5aba-4ffb-9ac7-5b7733a724ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:47.755607 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc7bc31-5aba-4ffb-9ac7-5b7733a724ab None admin] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:47.755887 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc7bc31-5aba-4ffb-9ac7-5b7733a724ab None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:47.756160 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc7bc31-5aba-4ffb-9ac7-5b7733a724ab None admin] PATH_INFO: `/v3/roles` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:47.756890 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc7bc31-5aba-4ffb-9ac7-5b7733a724ab None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:47.758291 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc7bc31-5aba-4ffb-9ac7-5b7733a724ab None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:47.797662 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.sql.core [None req-ffc7bc31-5aba-4ffb-9ac7-5b7733a724ab None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 18 21:41:47.797662 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 18 21:41:47.797662 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [parameters: {'id': '201075e73f51468bbd4a09b61819e25a', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 18 21:41:47.797662 dv-cinder-853678-3-smb devstack@keystone.service[88096]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88096) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 18 21:41:47.815429 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application [None req-ffc7bc31-5aba-4ffb-9ac7-5b7733a724ab None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 18 21:41:47.815429 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:41:47.815429 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 18 21:41:47.815429 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 18 21:41:47.815429 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 18 21:41:47.815429 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 18 21:41:47.815429 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 18 21:41:47.815429 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application result = self._query(query) Aug 18 21:41:47.815429 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 18 21:41:47.815429 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application conn.query(q) Aug 18 21:41:47.815429 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 18 21:41:47.815429 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 18 21:41:47.815429 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 18 21:41:47.815429 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application result.read() Aug 18 21:41:47.815429 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 18 21:41:47.816322 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 18 21:41:47.816322 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 18 21:41:47.816322 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 18 21:41:47.816322 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 18 21:41:47.816322 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 18 21:41:47.816322 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 18 21:41:47.816322 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 18 21:41:47.816322 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 18 21:41:47.816322 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:41:47.816322 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 18 21:41:47.816322 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:41:47.816322 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:41:47.816322 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 18 21:41:47.816322 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 18 21:41:47.816322 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 18 21:41:47.816322 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return ref.to_dict() Aug 18 21:41:47.816322 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 18 21:41:47.816322 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application next(self.gen) Aug 18 21:41:47.817252 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 18 21:41:47.817252 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application yield resource Aug 18 21:41:47.817252 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 18 21:41:47.817252 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application next(self.gen) Aug 18 21:41:47.817252 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 18 21:41:47.817252 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application self.session.rollback() Aug 18 21:41:47.817252 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 18 21:41:47.817252 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application self.force_reraise() Aug 18 21:41:47.817252 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 18 21:41:47.817252 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise self.value Aug 18 21:41:47.817252 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 18 21:41:47.817252 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 18 21:41:47.817252 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 18 21:41:47.817252 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application session.commit() Aug 18 21:41:47.817252 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 18 21:41:47.817252 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 18 21:41:47.817252 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 18 21:41:47.818185 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application self._prepare_impl() Aug 18 21:41:47.818185 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 18 21:41:47.818185 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application self.session.flush() Aug 18 21:41:47.818185 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 18 21:41:47.818185 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application self._flush(objects) Aug 18 21:41:47.818185 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 18 21:41:47.818185 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 18 21:41:47.818185 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 18 21:41:47.818185 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application compat.raise_( Aug 18 21:41:47.818185 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 18 21:41:47.818185 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception Aug 18 21:41:47.818185 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 18 21:41:47.818185 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application flush_context.execute() Aug 18 21:41:47.818185 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 18 21:41:47.818185 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application rec.execute(self) Aug 18 21:41:47.818185 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 18 21:41:47.818185 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 18 21:41:47.819128 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 18 21:41:47.819128 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 18 21:41:47.819128 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 18 21:41:47.819128 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 18 21:41:47.819128 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 18 21:41:47.819128 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 18 21:41:47.819128 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 18 21:41:47.819128 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 18 21:41:47.819128 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 18 21:41:47.819128 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 18 21:41:47.819128 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 18 21:41:47.819128 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 18 21:41:47.819128 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 18 21:41:47.819128 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 18 21:41:47.819128 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 18 21:41:47.819128 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception Aug 18 21:41:47.819937 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 18 21:41:47.819937 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 18 21:41:47.819937 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 18 21:41:47.819937 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 18 21:41:47.819937 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 18 21:41:47.819937 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application result = self._query(query) Aug 18 21:41:47.819937 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 18 21:41:47.819937 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application conn.query(q) Aug 18 21:41:47.819937 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 18 21:41:47.819937 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 18 21:41:47.819937 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 18 21:41:47.819937 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application result.read() Aug 18 21:41:47.819937 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 18 21:41:47.819937 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 18 21:41:47.819937 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 18 21:41:47.819937 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 18 21:41:47.821871 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 18 21:41:47.821871 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 18 21:41:47.821871 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 18 21:41:47.821871 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 18 21:41:47.821871 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 18 21:41:47.821871 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 18 21:41:47.821871 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application [parameters: {'id': '201075e73f51468bbd4a09b61819e25a', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 18 21:41:47.821871 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 18 21:41:47.821871 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:41:47.821871 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 21:41:47.821871 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:41:47.821871 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:41:47.821871 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:41:47.821871 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:41:47.821871 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:41:47.821871 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:41:47.823765 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:41:47.823765 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:41:47.823765 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:41:47.823765 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:41:47.823765 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:41:47.823765 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:41:47.823765 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 18 21:41:47.823765 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 18 21:41:47.823765 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:41:47.823765 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:41:47.823765 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 18 21:41:47.823765 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 18 21:41:47.823765 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 18 21:41:47.823765 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 18 21:41:47.823765 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 18 21:41:47.823765 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:41:47.825796 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 245/478] 10.222.0.27 () {60 vars in 1131 bytes} [Thu Aug 18 21:41:47 2022] POST /identity/v3/roles => generated 144 bytes in 248 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 18 21:41:47.825936 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3257a5e2-472f-4fee-844a-9bc154ff0622 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:47.911192 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:47.937119 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3257a5e2-472f-4fee-844a-9bc154ff0622 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:47.976856 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f4d3b0-ee63-4da7-b352-470b20513f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:47.977949 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f4d3b0-ee63-4da7-b352-470b20513f4c None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:47.978464 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f4d3b0-ee63-4da7-b352-470b20513f4c None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:47.978956 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f4d3b0-ee63-4da7-b352-470b20513f4c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:47.990699 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f4d3b0-ee63-4da7-b352-470b20513f4c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:41:47.996256 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application [None req-b3f4d3b0-ee63-4da7-b352-470b20513f4c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 21:41:47.996256 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:41:47.996256 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:41:47.996256 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:41:47.996256 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:41:47.996256 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:41:47.996256 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:41:47.996256 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:41:47.996256 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:41:47.996256 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:41:47.996256 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:41:47.996256 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:41:47.996256 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:41:47.996256 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:41:47.996256 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:41:47.996256 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:41:47.997140 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:41:47.997140 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:41:47.997140 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:41:47.997140 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:41:47.997140 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:41:47.997140 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:41:47.997140 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:41:47.997140 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:41:47.997140 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:41:47.997140 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:41:47.997140 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:41:47.997140 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application with Lock( Aug 18 21:41:47.997140 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:41:47.997140 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:41:47.997140 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:41:47.997140 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:41:47.997909 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:41:47.997909 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:41:47.997909 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:41:47.997909 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:41:47.997909 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:41:47.997909 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:41:47.997909 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:41:47.997909 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:41:47.997909 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:41:47.997909 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:41:47.997909 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 21:41:47.997909 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:41:48.001195 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 234/479] 10.222.0.27 () {56 vars in 1114 bytes} [Thu Aug 18 21:41:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:41:48.010086 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc7bc31-5aba-4ffb-9ac7-5b7733a724ab None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:48.121065 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc7bc31-5aba-4ffb-9ac7-5b7733a724ab None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:48.144934 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:48.162773 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed4b91a-86f4-434d-9242-a6752fb0a49d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:48.163665 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed4b91a-86f4-434d-9242-a6752fb0a49d None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:48.164119 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed4b91a-86f4-434d-9242-a6752fb0a49d None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:48.164581 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed4b91a-86f4-434d-9242-a6752fb0a49d None admin] PATH_INFO: `/v3/roles` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:48.165440 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed4b91a-86f4-434d-9242-a6752fb0a49d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:41:48.165911 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed4b91a-86f4-434d-9242-a6752fb0a49d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:48.167536 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed4b91a-86f4-434d-9242-a6752fb0a49d None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:48.181502 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 246/480] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Aug 18 21:41:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:48.856356 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa5d2e3-d448-4560-831d-01dda3ea5306 None None] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:48.856894 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa5d2e3-d448-4560-831d-01dda3ea5306 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:48.856967 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa5d2e3-d448-4560-831d-01dda3ea5306 None None] PATH_INFO: `/` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:48.858668 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 235/481] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:41:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:41:48.865209 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce67364-d3d1-41ea-a7c2-c6b01f1acd88 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:48.866057 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce67364-d3d1-41ea-a7c2-c6b01f1acd88 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:48.866525 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce67364-d3d1-41ea-a7c2-c6b01f1acd88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:48.893680 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-fce67364-d3d1-41ea-a7c2-c6b01f1acd88 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:41:48.895271 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-fce67364-d3d1-41ea-a7c2-c6b01f1acd88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:41:48.984318 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 247/482] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:41:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 21:41:49.300850 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f2c150-ced9-47a4-bc07-945c360abaa1 None None] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:49.301441 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f2c150-ced9-47a4-bc07-945c360abaa1 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:49.301915 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f2c150-ced9-47a4-bc07-945c360abaa1 None None] PATH_INFO: `/` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:49.304046 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 236/483] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:41:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:41:49.308616 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e9a056-db67-41be-a7a6-826af9419781 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:49.309140 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e9a056-db67-41be-a7a6-826af9419781 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:49.309613 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e9a056-db67-41be-a7a6-826af9419781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:49.335452 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-67e9a056-db67-41be-a7a6-826af9419781 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:41:49.337239 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-67e9a056-db67-41be-a7a6-826af9419781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:41:49.416323 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f2c150-ced9-47a4-bc07-945c360abaa1 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:49.416685 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 248/484] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:41:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 21:41:49.554349 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f2c150-ced9-47a4-bc07-945c360abaa1 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:49.601937 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb58d1b8-2c2a-41bd-98e5-924afbd3fdeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:49.602567 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb58d1b8-2c2a-41bd-98e5-924afbd3fdeb None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:49.602842 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb58d1b8-2c2a-41bd-98e5-924afbd3fdeb None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:49.603115 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb58d1b8-2c2a-41bd-98e5-924afbd3fdeb None admin] PATH_INFO: `/v3/roles/service` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:49.605115 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:49.617720 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb58d1b8-2c2a-41bd-98e5-924afbd3fdeb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:41:49.632240 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application [None req-cb58d1b8-2c2a-41bd-98e5-924afbd3fdeb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 21:41:49.632240 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:41:49.632240 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:41:49.632240 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:41:49.632240 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:41:49.632240 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:41:49.632240 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:41:49.632240 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:41:49.632240 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:41:49.632240 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:41:49.632240 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:41:49.632240 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:41:49.632240 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:41:49.632240 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:41:49.632240 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:41:49.632240 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:41:49.633184 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:41:49.633184 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:41:49.633184 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:41:49.633184 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:41:49.633184 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:41:49.633184 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:41:49.633184 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:41:49.633184 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:41:49.633184 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:41:49.633184 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:41:49.633184 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:41:49.633184 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application with Lock( Aug 18 21:41:49.633184 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:41:49.633184 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:41:49.633184 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:41:49.633184 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:41:49.633983 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:41:49.633983 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:41:49.633983 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:41:49.633983 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:41:49.633983 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:41:49.633983 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:41:49.633983 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:41:49.633983 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:41:49.633983 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:41:49.633983 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:41:49.633983 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 21:41:49.633983 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:41:49.633983 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 237/485] 10.222.0.27 () {56 vars in 1102 bytes} [Thu Aug 18 21:41:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:41:49.634630 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e9a056-db67-41be-a7a6-826af9419781 None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:49.714514 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:49.791219 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e9a056-db67-41be-a7a6-826af9419781 None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:49.849108 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d67f157-0598-4c47-9d2a-3c84ac637045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:49.849639 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d67f157-0598-4c47-9d2a-3c84ac637045 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:49.849921 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d67f157-0598-4c47-9d2a-3c84ac637045 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:49.850196 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d67f157-0598-4c47-9d2a-3c84ac637045 None admin] PATH_INFO: `/v3/roles` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:49.850863 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d67f157-0598-4c47-9d2a-3c84ac637045 None admin] RBAC: Adding query filter params (name=service) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:41:49.851164 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d67f157-0598-4c47-9d2a-3c84ac637045 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:49.852530 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d67f157-0598-4c47-9d2a-3c84ac637045 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:49.861638 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 249/486] 10.222.0.27 () {56 vars in 1103 bytes} [Thu Aug 18 21:41:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:49.863336 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb58d1b8-2c2a-41bd-98e5-924afbd3fdeb None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:49.867073 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d67f157-0598-4c47-9d2a-3c84ac637045 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:49.974785 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb58d1b8-2c2a-41bd-98e5-924afbd3fdeb None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:49.994917 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d67f157-0598-4c47-9d2a-3c84ac637045 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:50.009538 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:50.021204 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c062c3f1-581e-48da-a4bb-611f69610113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:50.032236 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c062c3f1-581e-48da-a4bb-611f69610113 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:50.032236 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c062c3f1-581e-48da-a4bb-611f69610113 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:50.032236 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c062c3f1-581e-48da-a4bb-611f69610113 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:50.034733 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c062c3f1-581e-48da-a4bb-611f69610113 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:41:50.039402 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application [None req-c062c3f1-581e-48da-a4bb-611f69610113 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 21:41:50.039402 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:41:50.039402 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:41:50.039402 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:41:50.039402 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:41:50.039402 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:41:50.039402 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:41:50.039402 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:41:50.039402 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:41:50.039402 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:41:50.039402 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:41:50.039402 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:41:50.039402 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:41:50.039402 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:41:50.039402 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:41:50.039402 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:41:50.040467 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:41:50.040467 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:41:50.040467 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:41:50.040467 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:41:50.040467 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:41:50.040467 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:41:50.040467 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:41:50.040467 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:41:50.040467 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:41:50.040467 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:41:50.040467 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:41:50.040467 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application with Lock( Aug 18 21:41:50.040467 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:41:50.040467 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:41:50.040467 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:41:50.040467 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:41:50.041466 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:41:50.041466 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:41:50.041466 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:41:50.041466 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:41:50.041466 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:41:50.041466 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:41:50.041466 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:41:50.041466 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:41:50.041466 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:41:50.041466 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:41:50.041466 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 21:41:50.041466 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:41:50.043793 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 238/487] 10.222.0.27 () {56 vars in 1102 bytes} [Thu Aug 18 21:41:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:41:50.044984 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a8fb73-47d5-4bd8-9e43-4d68196725b7 None None] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:50.045411 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a8fb73-47d5-4bd8-9e43-4d68196725b7 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:50.045843 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a8fb73-47d5-4bd8-9e43-4d68196725b7 None None] PATH_INFO: `/` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:50.051295 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 239/488] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:41:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:41:50.052320 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a8fb73-47d5-4bd8-9e43-4d68196725b7 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:50.062117 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd4ad4e-ca93-49b1-94cb-b74add4fc86a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:50.063283 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd4ad4e-ca93-49b1-94cb-b74add4fc86a None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:50.063771 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd4ad4e-ca93-49b1-94cb-b74add4fc86a None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:50.064884 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd4ad4e-ca93-49b1-94cb-b74add4fc86a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:50.078875 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd4ad4e-ca93-49b1-94cb-b74add4fc86a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:50.080635 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd4ad4e-ca93-49b1-94cb-b74add4fc86a None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:50.098845 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application [None req-9bd4ad4e-ca93-49b1-94cb-b74add4fc86a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:41:50.098845 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:41:50.098845 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:41:50.098845 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:41:50.098845 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:41:50.098845 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:41:50.098845 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:41:50.098845 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:41:50.098845 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:41:50.098845 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:41:50.098845 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:41:50.098845 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:41:50.098845 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 21:41:50.098845 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 21:41:50.098845 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 21:41:50.098845 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 21:41:50.100045 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:41:50.100045 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:41:50.100045 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:41:50.100045 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:41:50.100045 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:41:50.100045 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:41:50.100045 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:41:50.100045 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application with Lock( Aug 18 21:41:50.100045 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:41:50.100045 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:41:50.100045 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:41:50.100045 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:41:50.100045 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:41:50.100045 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:41:50.100045 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:41:50.100045 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:41:50.100045 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 21:41:50.101135 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 21:41:50.101135 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:41:50.101135 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:41:50.103700 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 250/489] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 18 21:41:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 21:41:50.105029 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a71d5af-a992-4aa0-a72e-055b3ef800ee None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:50.105483 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a71d5af-a992-4aa0-a72e-055b3ef800ee None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:50.105904 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a71d5af-a992-4aa0-a72e-055b3ef800ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:50.127758 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-4a71d5af-a992-4aa0-a72e-055b3ef800ee None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:41:50.129528 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-4a71d5af-a992-4aa0-a72e-055b3ef800ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:41:50.130240 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:50.181683 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a8fb73-47d5-4bd8-9e43-4d68196725b7 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:50.223247 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 251/490] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:41:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 21:41:50.224317 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a71d5af-a992-4aa0-a72e-055b3ef800ee None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:50.237923 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2be3fd3-6c68-4b0f-9d5b-38d7035b086c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:50.238746 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2be3fd3-6c68-4b0f-9d5b-38d7035b086c None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:50.239163 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2be3fd3-6c68-4b0f-9d5b-38d7035b086c None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:50.239537 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2be3fd3-6c68-4b0f-9d5b-38d7035b086c None admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:50.240533 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2be3fd3-6c68-4b0f-9d5b-38d7035b086c None admin] RBAC: Adding query filter params (name=service) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:41:50.241472 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2be3fd3-6c68-4b0f-9d5b-38d7035b086c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:50.243549 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2be3fd3-6c68-4b0f-9d5b-38d7035b086c None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:50.255437 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 240/491] 10.222.0.27 () {56 vars in 1103 bytes} [Thu Aug 18 21:41:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:50.257013 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64a67fb-44db-464b-8a27-b044dde54ad6 None None] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:50.257505 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64a67fb-44db-464b-8a27-b044dde54ad6 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:50.258001 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64a67fb-44db-464b-8a27-b044dde54ad6 None None] PATH_INFO: `/` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:50.263883 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 241/492] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:41:50 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:41:50.265351 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64a67fb-44db-464b-8a27-b044dde54ad6 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:50.331237 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:50.345084 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a71d5af-a992-4aa0-a72e-055b3ef800ee None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:50.383325 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6d55d1-f113-4d1c-9e71-2cefb6b35dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:50.383965 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64a67fb-44db-464b-8a27-b044dde54ad6 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:50.384214 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6d55d1-f113-4d1c-9e71-2cefb6b35dfe None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:50.384497 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6d55d1-f113-4d1c-9e71-2cefb6b35dfe None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:50.384816 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6d55d1-f113-4d1c-9e71-2cefb6b35dfe None admin] PATH_INFO: `/v3/domains` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:50.385460 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6d55d1-f113-4d1c-9e71-2cefb6b35dfe None admin] RBAC: Adding query filter params (name=Default) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:41:50.385763 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6d55d1-f113-4d1c-9e71-2cefb6b35dfe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:50.387257 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6d55d1-f113-4d1c-9e71-2cefb6b35dfe None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:50.400213 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 252/493] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 18 21:41:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:50.401685 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8f2f05-a066-47f8-bb4f-13b2096ca679 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:50.401972 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8f2f05-a066-47f8-bb4f-13b2096ca679 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:50.402247 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8f2f05-a066-47f8-bb4f-13b2096ca679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:50.405496 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:50.429545 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-3b8f2f05-a066-47f8-bb4f-13b2096ca679 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:41:50.430476 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058cfbef-bdd3-4606-b645-047d7ffbf8af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:50.430784 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-3b8f2f05-a066-47f8-bb4f-13b2096ca679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:41:50.431159 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058cfbef-bdd3-4606-b645-047d7ffbf8af None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:50.431687 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058cfbef-bdd3-4606-b645-047d7ffbf8af None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:50.432137 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058cfbef-bdd3-4606-b645-047d7ffbf8af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:50.444947 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058cfbef-bdd3-4606-b645-047d7ffbf8af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:50.446540 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058cfbef-bdd3-4606-b645-047d7ffbf8af None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:50.462254 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application [None req-058cfbef-bdd3-4606-b645-047d7ffbf8af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:41:50.462254 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:41:50.462254 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:41:50.462254 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:41:50.462254 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:41:50.462254 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:41:50.462254 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:41:50.462254 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:41:50.462254 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:41:50.462254 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:41:50.462254 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:41:50.462254 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:41:50.462254 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 21:41:50.462254 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 21:41:50.462254 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 21:41:50.462254 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 21:41:50.463367 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:41:50.463367 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:41:50.463367 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:41:50.463367 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:41:50.463367 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:41:50.463367 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:41:50.463367 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:41:50.463367 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application with Lock( Aug 18 21:41:50.463367 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:41:50.463367 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:41:50.463367 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:41:50.463367 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:41:50.463367 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:41:50.463367 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:41:50.463367 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:41:50.463367 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:41:50.463367 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 21:41:50.464300 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 21:41:50.464300 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:41:50.464300 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:41:50.464786 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 242/494] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 18 21:41:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:41:50.465750 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058cfbef-bdd3-4606-b645-047d7ffbf8af None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:50.520556 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 253/495] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:41:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 21:41:50.521956 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8f2f05-a066-47f8-bb4f-13b2096ca679 None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:50.576160 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058cfbef-bdd3-4606-b645-047d7ffbf8af None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:50.610853 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:50.613572 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb0c826-31b4-4207-8e49-ddd301d075da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:50.614208 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb0c826-31b4-4207-8e49-ddd301d075da None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:50.614482 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb0c826-31b4-4207-8e49-ddd301d075da None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:50.614772 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb0c826-31b4-4207-8e49-ddd301d075da None admin] PATH_INFO: `/v3/users/nova` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:50.622771 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb0c826-31b4-4207-8e49-ddd301d075da None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:50.624235 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb0c826-31b4-4207-8e49-ddd301d075da None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:50.638918 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8f2f05-a066-47f8-bb4f-13b2096ca679 None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:50.639072 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application [None req-1bb0c826-31b4-4207-8e49-ddd301d075da None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 18 21:41:50.639072 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:41:50.639072 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:41:50.639072 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:41:50.639072 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:41:50.639072 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:41:50.639072 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:41:50.639072 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:41:50.639072 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:41:50.639072 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:41:50.639072 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:41:50.639072 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:41:50.639072 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 21:41:50.639072 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 21:41:50.639072 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 21:41:50.639072 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 21:41:50.639939 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:41:50.639939 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:41:50.639939 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 21:41:50.639939 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 21:41:50.639939 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 21:41:50.639939 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 21:41:50.639939 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:41:50.639939 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:41:50.639939 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:41:50.639939 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:41:50.639939 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:41:50.639939 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application with Lock( Aug 18 21:41:50.639939 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:41:50.639939 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:41:50.639939 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:41:50.639939 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:41:50.639939 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:41:50.639939 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:41:50.641775 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:41:50.641775 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:41:50.641775 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 21:41:50.641775 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 21:41:50.641775 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 21:41:50.641775 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 21:41:50.641775 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 21:41:50.641775 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 21:41:50.641775 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 18 21:41:50.641775 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:41:50.641775 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 243/496] 10.222.0.27 () {56 vars in 1093 bytes} [Thu Aug 18 21:41:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:41:50.641775 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb0c826-31b4-4207-8e49-ddd301d075da None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:50.676693 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:50.679429 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5e3669-7114-4678-88e4-969c808c94d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:50.680260 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5e3669-7114-4678-88e4-969c808c94d7 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:50.680770 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5e3669-7114-4678-88e4-969c808c94d7 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:50.681241 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5e3669-7114-4678-88e4-969c808c94d7 None admin] PATH_INFO: `/v3/domains` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:50.682098 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5e3669-7114-4678-88e4-969c808c94d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:41:50.682595 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5e3669-7114-4678-88e4-969c808c94d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:50.684265 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5e3669-7114-4678-88e4-969c808c94d7 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:50.701783 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 254/497] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 18 21:41:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:50.703058 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5e3669-7114-4678-88e4-969c808c94d7 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:50.754909 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb0c826-31b4-4207-8e49-ddd301d075da None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:50.791136 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dbe06f-6ee8-45a7-b658-438a6385a99a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:50.791762 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dbe06f-6ee8-45a7-b658-438a6385a99a None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:50.792037 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dbe06f-6ee8-45a7-b658-438a6385a99a None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:50.792304 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dbe06f-6ee8-45a7-b658-438a6385a99a None admin] PATH_INFO: `/v3/roles/service` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:50.803998 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dbe06f-6ee8-45a7-b658-438a6385a99a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:41:50.809713 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application [None req-60dbe06f-6ee8-45a7-b658-438a6385a99a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 21:41:50.809713 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:41:50.809713 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:41:50.809713 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:41:50.809713 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:41:50.809713 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:41:50.809713 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:41:50.809713 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:41:50.809713 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:41:50.809713 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:41:50.809713 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:41:50.809713 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:41:50.809713 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:41:50.809713 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:41:50.809713 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:41:50.809713 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:41:50.810578 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:41:50.810578 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:41:50.810578 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:41:50.810578 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:41:50.810578 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:41:50.810578 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:41:50.810578 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:41:50.810578 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:41:50.810578 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:41:50.810578 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:41:50.810578 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:41:50.810578 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application with Lock( Aug 18 21:41:50.810578 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:41:50.810578 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:41:50.810578 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:41:50.810578 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:41:50.811378 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:41:50.811378 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:41:50.811378 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:41:50.811378 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:41:50.811378 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:41:50.811378 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:41:50.811378 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:41:50.811378 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:41:50.811378 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:41:50.811378 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:41:50.811378 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 21:41:50.811378 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:41:50.811378 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 244/498] 10.222.0.27 () {56 vars in 1102 bytes} [Thu Aug 18 21:41:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:41:50.812028 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dbe06f-6ee8-45a7-b658-438a6385a99a None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:50.818684 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5e3669-7114-4678-88e4-969c808c94d7 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:50.856249 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2697f9cb-4425-4dfd-83c8-7a3d86683380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:50.856884 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2697f9cb-4425-4dfd-83c8-7a3d86683380 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:50.857160 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2697f9cb-4425-4dfd-83c8-7a3d86683380 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:50.857428 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2697f9cb-4425-4dfd-83c8-7a3d86683380 None admin] PATH_INFO: `/v3/users` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:50.858141 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2697f9cb-4425-4dfd-83c8-7a3d86683380 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:41:50.858440 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2697f9cb-4425-4dfd-83c8-7a3d86683380 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:50.860564 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2697f9cb-4425-4dfd-83c8-7a3d86683380 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:50.879308 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:50.900437 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 255/499] 10.222.0.27 () {56 vars in 1133 bytes} [Thu Aug 18 21:41:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:50.901589 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2697f9cb-4425-4dfd-83c8-7a3d86683380 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:50.913232 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:50.926763 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dbe06f-6ee8-45a7-b658-438a6385a99a None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:50.961738 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7379081a-0a95-4322-905a-b7bb337b81fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:50.962358 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7379081a-0a95-4322-905a-b7bb337b81fc None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:50.962639 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7379081a-0a95-4322-905a-b7bb337b81fc None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:50.962911 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7379081a-0a95-4322-905a-b7bb337b81fc None admin] PATH_INFO: `/v3/users/glance` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:50.970673 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7379081a-0a95-4322-905a-b7bb337b81fc None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:50.972132 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7379081a-0a95-4322-905a-b7bb337b81fc None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:50.983398 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application [None req-7379081a-0a95-4322-905a-b7bb337b81fc None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 18 21:41:50.983398 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:41:50.983398 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:41:50.983398 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:41:50.983398 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:41:50.983398 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:41:50.983398 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:41:50.983398 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:41:50.983398 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:41:50.983398 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:41:50.983398 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:41:50.983398 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:41:50.983398 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 21:41:50.983398 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 21:41:50.983398 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 21:41:50.983398 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 21:41:50.984889 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:41:50.984889 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:41:50.984889 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 21:41:50.984889 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 21:41:50.984889 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 21:41:50.984889 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 21:41:50.984889 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:41:50.984889 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:41:50.984889 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:41:50.984889 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:41:50.984889 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:41:50.984889 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application with Lock( Aug 18 21:41:50.984889 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:41:50.984889 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:41:50.984889 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:41:50.984889 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:41:50.984889 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:41:50.984889 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:41:50.985782 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:41:50.985782 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:41:50.985782 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 21:41:50.985782 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 21:41:50.985782 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 21:41:50.985782 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 21:41:50.985782 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 21:41:50.985782 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 21:41:50.985782 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 18 21:41:50.985782 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:41:50.985782 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 245/500] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Aug 18 21:41:50 2022] GET /identity/v3/users/glance => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:41:50.986330 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7379081a-0a95-4322-905a-b7bb337b81fc None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:51.004909 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2697f9cb-4425-4dfd-83c8-7a3d86683380 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:51.038183 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9516c3f3-b165-4c91-a512-0abc3482319e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:51.038838 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9516c3f3-b165-4c91-a512-0abc3482319e None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:51.039121 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9516c3f3-b165-4c91-a512-0abc3482319e None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:51.039393 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9516c3f3-b165-4c91-a512-0abc3482319e None admin] PATH_INFO: `/v3/roles` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:51.040055 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9516c3f3-b165-4c91-a512-0abc3482319e None admin] RBAC: Adding query filter params (name=service) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:41:51.040355 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9516c3f3-b165-4c91-a512-0abc3482319e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:51.041772 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9516c3f3-b165-4c91-a512-0abc3482319e None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:51.049926 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 256/501] 10.222.0.27 () {56 vars in 1103 bytes} [Thu Aug 18 21:41:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:51.050706 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9516c3f3-b165-4c91-a512-0abc3482319e None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:51.087477 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7379081a-0a95-4322-905a-b7bb337b81fc None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:51.110013 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:51.121500 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb6b961-b3fb-4688-a676-a5bf72c63945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:51.122112 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb6b961-b3fb-4688-a676-a5bf72c63945 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:51.122386 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb6b961-b3fb-4688-a676-a5bf72c63945 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:51.122657 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb6b961-b3fb-4688-a676-a5bf72c63945 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:51.133327 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb6b961-b3fb-4688-a676-a5bf72c63945 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:41:51.138539 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application [None req-9eb6b961-b3fb-4688-a676-a5bf72c63945 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 21:41:51.138539 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:41:51.138539 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:41:51.138539 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:41:51.138539 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:41:51.138539 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:41:51.138539 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:41:51.138539 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:41:51.138539 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:41:51.138539 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:41:51.138539 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:41:51.138539 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:41:51.138539 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:41:51.138539 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:41:51.138539 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:41:51.138539 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:41:51.139434 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:41:51.139434 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:41:51.139434 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:41:51.139434 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:41:51.139434 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:41:51.139434 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:41:51.139434 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:41:51.139434 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:41:51.139434 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:41:51.139434 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:41:51.139434 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:41:51.139434 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application with Lock( Aug 18 21:41:51.139434 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:41:51.139434 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:41:51.139434 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:41:51.139434 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:41:51.140512 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:41:51.140512 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:41:51.140512 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:41:51.140512 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:41:51.140512 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:41:51.140512 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:41:51.140512 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:41:51.140512 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:41:51.140512 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:41:51.140512 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:41:51.140512 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 21:41:51.140512 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:41:51.140512 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 246/502] 10.222.0.27 () {56 vars in 1102 bytes} [Thu Aug 18 21:41:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:41:51.141222 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e525cc-3c6a-41d5-addf-dafd29e00f2b None None] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:51.141499 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e525cc-3c6a-41d5-addf-dafd29e00f2b None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:51.141776 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e525cc-3c6a-41d5-addf-dafd29e00f2b None None] PATH_INFO: `/` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:51.143045 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 247/503] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:41:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:41:51.143770 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e525cc-3c6a-41d5-addf-dafd29e00f2b None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:51.157001 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9516c3f3-b165-4c91-a512-0abc3482319e None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:51.190105 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6756fdf1-5d88-4d8f-8759-1f4160e4d063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:51.190698 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6756fdf1-5d88-4d8f-8759-1f4160e4d063 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:51.190974 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6756fdf1-5d88-4d8f-8759-1f4160e4d063 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:51.191241 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6756fdf1-5d88-4d8f-8759-1f4160e4d063 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:51.201939 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:51.257479 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6756fdf1-5d88-4d8f-8759-1f4160e4d063 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:51.258946 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6756fdf1-5d88-4d8f-8759-1f4160e4d063 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:51.292747 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e525cc-3c6a-41d5-addf-dafd29e00f2b None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:51.321676 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:51.326206 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ba5879-97b3-4e7a-998b-f5c21f32aba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:51.326800 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ba5879-97b3-4e7a-998b-f5c21f32aba2 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:51.327077 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ba5879-97b3-4e7a-998b-f5c21f32aba2 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:51.327351 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ba5879-97b3-4e7a-998b-f5c21f32aba2 None admin] PATH_INFO: `/v3/users` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:51.328111 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ba5879-97b3-4e7a-998b-f5c21f32aba2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:41:51.328512 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ba5879-97b3-4e7a-998b-f5c21f32aba2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:51.329977 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ba5879-97b3-4e7a-998b-f5c21f32aba2 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:51.362762 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 257/504] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Aug 18 21:41:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 21:41:51.363601 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6756fdf1-5d88-4d8f-8759-1f4160e4d063 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:51.369480 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 248/505] 10.222.0.27 () {56 vars in 1137 bytes} [Thu Aug 18 21:41:51 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:51.369480 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ba5879-97b3-4e7a-998b-f5c21f32aba2 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:51.432300 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:51.465177 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ba5879-97b3-4e7a-998b-f5c21f32aba2 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:51.467978 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6756fdf1-5d88-4d8f-8759-1f4160e4d063 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:51.503773 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75e7569-9bdd-4cd6-acd6-fa6eca01b137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:51.504363 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75e7569-9bdd-4cd6-acd6-fa6eca01b137 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:51.504668 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75e7569-9bdd-4cd6-acd6-fa6eca01b137 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:51.504935 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75e7569-9bdd-4cd6-acd6-fa6eca01b137 None admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:51.505584 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75e7569-9bdd-4cd6-acd6-fa6eca01b137 None admin] RBAC: Adding query filter params (name=service) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:41:51.505880 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75e7569-9bdd-4cd6-acd6-fa6eca01b137 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:51.506219 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6f700f-fcec-4790-a205-b064e4eac295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:51.506844 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6f700f-fcec-4790-a205-b064e4eac295 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:51.507122 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6f700f-fcec-4790-a205-b064e4eac295 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:51.507262 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75e7569-9bdd-4cd6-acd6-fa6eca01b137 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:51.507395 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6f700f-fcec-4790-a205-b064e4eac295 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:51.515328 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 249/506] 10.222.0.27 () {56 vars in 1103 bytes} [Thu Aug 18 21:41:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:51.516407 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4bb5cf-9b4a-44da-861b-02b091bec8cf None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:51.516715 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4bb5cf-9b4a-44da-861b-02b091bec8cf None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:51.516978 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4bb5cf-9b4a-44da-861b-02b091bec8cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:51.517861 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6f700f-fcec-4790-a205-b064e4eac295 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:51.519304 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6f700f-fcec-4790-a205-b064e4eac295 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:51.534469 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application [None req-7c6f700f-fcec-4790-a205-b064e4eac295 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:41:51.534469 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:41:51.534469 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:41:51.534469 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:41:51.534469 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:41:51.534469 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:41:51.534469 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:41:51.534469 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:41:51.534469 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:41:51.534469 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:41:51.534469 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:41:51.534469 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:41:51.534469 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 21:41:51.534469 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 21:41:51.534469 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 21:41:51.534469 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 21:41:51.535403 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:41:51.535403 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:41:51.535403 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:41:51.535403 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:41:51.535403 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:41:51.535403 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:41:51.535403 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:41:51.535403 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application with Lock( Aug 18 21:41:51.535403 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:41:51.535403 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:41:51.535403 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:41:51.535403 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:41:51.535403 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:41:51.535403 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:41:51.535403 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:41:51.535403 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:41:51.535403 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 21:41:51.536248 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 21:41:51.536248 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:41:51.536248 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:41:51.536420 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-cf4bb5cf-9b4a-44da-861b-02b091bec8cf None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:41:51.536490 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 258/507] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 18 21:41:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:41:51.536554 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-cf4bb5cf-9b4a-44da-861b-02b091bec8cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:41:51.536716 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6f700f-fcec-4790-a205-b064e4eac295 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:51.552398 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:51.601498 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 250/508] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:41:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 21:41:51.602412 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4bb5cf-9b4a-44da-861b-02b091bec8cf None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:51.644198 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6f700f-fcec-4790-a205-b064e4eac295 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:51.662043 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:51.679561 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087eb352-6322-49c7-b346-5af12dcf2030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:51.680187 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087eb352-6322-49c7-b346-5af12dcf2030 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:51.680469 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087eb352-6322-49c7-b346-5af12dcf2030 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:51.680768 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087eb352-6322-49c7-b346-5af12dcf2030 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:51.692425 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087eb352-6322-49c7-b346-5af12dcf2030 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:51.693835 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087eb352-6322-49c7-b346-5af12dcf2030 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:51.705693 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4bb5cf-9b4a-44da-861b-02b091bec8cf None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:51.708935 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application [None req-087eb352-6322-49c7-b346-5af12dcf2030 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:41:51.708935 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:41:51.708935 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:41:51.708935 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:41:51.708935 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:41:51.708935 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:41:51.708935 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:41:51.708935 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:41:51.708935 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:41:51.708935 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:41:51.708935 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:41:51.708935 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:41:51.708935 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 21:41:51.708935 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 21:41:51.708935 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 21:41:51.708935 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 21:41:51.709833 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:41:51.709833 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:41:51.709833 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:41:51.709833 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:41:51.709833 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:41:51.709833 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:41:51.709833 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:41:51.709833 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application with Lock( Aug 18 21:41:51.709833 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:41:51.709833 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:41:51.709833 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:41:51.709833 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:41:51.709833 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:41:51.709833 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:41:51.709833 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:41:51.709833 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:41:51.709833 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 21:41:51.710673 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 21:41:51.710673 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:41:51.710673 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:41:51.714611 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 259/509] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 18 21:41:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:41:51.715439 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087eb352-6322-49c7-b346-5af12dcf2030 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:51.740536 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ed19a6-d2b1-4871-988d-00369114cf61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:51.741147 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ed19a6-d2b1-4871-988d-00369114cf61 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:51.741425 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ed19a6-d2b1-4871-988d-00369114cf61 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:51.741694 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ed19a6-d2b1-4871-988d-00369114cf61 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:51.779285 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:51.811002 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ed19a6-d2b1-4871-988d-00369114cf61 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:51.813072 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ed19a6-d2b1-4871-988d-00369114cf61 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:51.819954 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087eb352-6322-49c7-b346-5af12dcf2030 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:51.854214 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921e4bab-bb9d-4b6b-82d6-5e2dc15d70f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:51.854919 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921e4bab-bb9d-4b6b-82d6-5e2dc15d70f1 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:51.855267 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921e4bab-bb9d-4b6b-82d6-5e2dc15d70f1 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:51.855611 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921e4bab-bb9d-4b6b-82d6-5e2dc15d70f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:51.866323 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921e4bab-bb9d-4b6b-82d6-5e2dc15d70f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:51.867758 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921e4bab-bb9d-4b6b-82d6-5e2dc15d70f1 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:51.869449 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:51.883353 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application [None req-921e4bab-bb9d-4b6b-82d6-5e2dc15d70f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:41:51.883353 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:41:51.883353 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:41:51.883353 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:41:51.883353 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:41:51.883353 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:41:51.883353 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:41:51.883353 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:41:51.883353 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:41:51.883353 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:41:51.883353 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:41:51.883353 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:41:51.883353 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 21:41:51.883353 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 21:41:51.883353 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 21:41:51.883353 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 21:41:51.884886 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:41:51.884886 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:41:51.884886 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:41:51.884886 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:41:51.884886 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:41:51.884886 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:41:51.884886 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:41:51.884886 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application with Lock( Aug 18 21:41:51.884886 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:41:51.884886 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:41:51.884886 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:41:51.884886 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:41:51.884886 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:41:51.884886 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:41:51.884886 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:41:51.884886 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:41:51.884886 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 21:41:51.885739 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 21:41:51.885739 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:41:51.885739 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:41:51.885739 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 260/510] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 18 21:41:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:41:51.885739 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921e4bab-bb9d-4b6b-82d6-5e2dc15d70f1 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:51.915067 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 251/511] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Aug 18 21:41:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 21:41:51.915904 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ed19a6-d2b1-4871-988d-00369114cf61 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:51.990583 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921e4bab-bb9d-4b6b-82d6-5e2dc15d70f1 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:52.004877 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:52.012024 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ed19a6-d2b1-4871-988d-00369114cf61 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:52.026234 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1a66ed-1efb-4c1f-ac4a-0c8241e49b43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:52.027287 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1a66ed-1efb-4c1f-ac4a-0c8241e49b43 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:52.027287 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1a66ed-1efb-4c1f-ac4a-0c8241e49b43 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:52.027439 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1a66ed-1efb-4c1f-ac4a-0c8241e49b43 None admin] PATH_INFO: `/v3/domains` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:52.028012 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1a66ed-1efb-4c1f-ac4a-0c8241e49b43 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:41:52.028307 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1a66ed-1efb-4c1f-ac4a-0c8241e49b43 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:52.029704 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1a66ed-1efb-4c1f-ac4a-0c8241e49b43 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:52.041695 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 261/512] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 18 21:41:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:52.042486 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1a66ed-1efb-4c1f-ac4a-0c8241e49b43 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:52.049048 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00476251-efcf-497e-b298-9edef83566fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:52.049647 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00476251-efcf-497e-b298-9edef83566fe None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:52.049925 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00476251-efcf-497e-b298-9edef83566fe None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:52.050317 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00476251-efcf-497e-b298-9edef83566fe None admin] PATH_INFO: `/v3/domains` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:52.050841 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00476251-efcf-497e-b298-9edef83566fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:41:52.051135 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00476251-efcf-497e-b298-9edef83566fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:52.052512 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00476251-efcf-497e-b298-9edef83566fe None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:52.063851 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 252/513] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 18 21:41:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:52.064676 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00476251-efcf-497e-b298-9edef83566fe None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:52.084240 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:52.141463 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1a66ed-1efb-4c1f-ac4a-0c8241e49b43 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:52.165508 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00476251-efcf-497e-b298-9edef83566fe None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:52.176865 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e916be01-88ba-47f4-b56f-6aeae38c1cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:52.177486 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e916be01-88ba-47f4-b56f-6aeae38c1cea None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:52.177761 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e916be01-88ba-47f4-b56f-6aeae38c1cea None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:52.178032 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e916be01-88ba-47f4-b56f-6aeae38c1cea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:52.188439 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e916be01-88ba-47f4-b56f-6aeae38c1cea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:52.189924 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e916be01-88ba-47f4-b56f-6aeae38c1cea None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:52.198448 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0436476-24b1-469b-afee-88e382805a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:52.199121 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0436476-24b1-469b-afee-88e382805a2f None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:52.199401 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0436476-24b1-469b-afee-88e382805a2f None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:52.199670 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0436476-24b1-469b-afee-88e382805a2f None admin] PATH_INFO: `/v3/domains` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:52.200304 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0436476-24b1-469b-afee-88e382805a2f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:41:52.200618 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0436476-24b1-469b-afee-88e382805a2f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:52.201977 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0436476-24b1-469b-afee-88e382805a2f None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:52.204847 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application [None req-e916be01-88ba-47f4-b56f-6aeae38c1cea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:41:52.204847 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:41:52.204847 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:41:52.204847 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:41:52.204847 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:41:52.204847 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:41:52.204847 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:41:52.204847 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:41:52.204847 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:41:52.204847 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:41:52.204847 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:41:52.204847 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:41:52.204847 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 21:41:52.204847 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 21:41:52.204847 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 21:41:52.204847 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 21:41:52.205886 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:41:52.205886 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:41:52.205886 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:41:52.205886 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:41:52.205886 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:41:52.205886 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:41:52.205886 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:41:52.205886 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application with Lock( Aug 18 21:41:52.205886 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:41:52.205886 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:41:52.205886 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:41:52.205886 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:41:52.205886 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:41:52.205886 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:41:52.205886 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:41:52.205886 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:41:52.205886 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 21:41:52.206934 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 21:41:52.206934 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:41:52.206934 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:41:52.206934 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 262/514] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 18 21:41:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:41:52.207190 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e916be01-88ba-47f4-b56f-6aeae38c1cea None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:52.222492 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 253/515] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 18 21:41:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:52.222492 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0436476-24b1-469b-afee-88e382805a2f None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:52.238750 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:52.301661 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:52.311297 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e916be01-88ba-47f4-b56f-6aeae38c1cea None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:52.322276 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0436476-24b1-469b-afee-88e382805a2f None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:52.345595 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a386af2-4508-4b01-885f-391e63b583a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:52.346221 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a386af2-4508-4b01-885f-391e63b583a9 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:52.346498 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a386af2-4508-4b01-885f-391e63b583a9 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:52.346772 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a386af2-4508-4b01-885f-391e63b583a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:52.356405 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee118ffc-33f3-40a4-994e-aff3e98a849d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:52.357009 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a386af2-4508-4b01-885f-391e63b583a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:52.357104 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee118ffc-33f3-40a4-994e-aff3e98a849d None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:52.357302 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee118ffc-33f3-40a4-994e-aff3e98a849d None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:52.357570 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee118ffc-33f3-40a4-994e-aff3e98a849d None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:52.358438 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a386af2-4508-4b01-885f-391e63b583a9 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:52.365102 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee118ffc-33f3-40a4-994e-aff3e98a849d None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:52.366535 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee118ffc-33f3-40a4-994e-aff3e98a849d None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:52.373046 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application [None req-3a386af2-4508-4b01-885f-391e63b583a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:41:52.373046 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:41:52.373046 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:41:52.373046 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:41:52.373046 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:41:52.373046 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:41:52.373046 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:41:52.373046 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:41:52.373046 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:41:52.373046 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:41:52.373046 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:41:52.373046 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:41:52.373046 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 21:41:52.373046 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 21:41:52.373046 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 21:41:52.373046 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 21:41:52.374104 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:41:52.374104 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:41:52.374104 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:41:52.374104 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:41:52.374104 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:41:52.374104 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:41:52.374104 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:41:52.374104 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application with Lock( Aug 18 21:41:52.374104 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:41:52.374104 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:41:52.374104 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:41:52.374104 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:41:52.374104 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:41:52.374104 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:41:52.374104 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:41:52.374104 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:41:52.374104 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 21:41:52.375527 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 21:41:52.375527 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:41:52.375527 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:41:52.375527 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 263/516] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 18 21:41:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:41:52.375527 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a386af2-4508-4b01-885f-391e63b583a9 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:52.378371 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application [None req-ee118ffc-33f3-40a4-994e-aff3e98a849d None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 18 21:41:52.378371 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:41:52.378371 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:41:52.378371 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:41:52.378371 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:41:52.378371 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:41:52.378371 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:41:52.378371 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:41:52.378371 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:41:52.378371 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:41:52.378371 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:41:52.378371 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:41:52.378371 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 21:41:52.378371 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 21:41:52.378371 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 21:41:52.378371 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 21:41:52.384243 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:41:52.384243 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:41:52.384243 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 21:41:52.384243 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 21:41:52.384243 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 21:41:52.384243 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 21:41:52.384243 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:41:52.384243 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:41:52.384243 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:41:52.384243 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:41:52.384243 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:41:52.384243 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application with Lock( Aug 18 21:41:52.384243 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:41:52.384243 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:41:52.384243 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:41:52.384243 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:41:52.384243 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:41:52.384243 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:41:52.385407 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:41:52.385407 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:41:52.385407 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 21:41:52.385407 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 21:41:52.385407 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 21:41:52.385407 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 21:41:52.385407 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 21:41:52.385407 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 21:41:52.385407 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 18 21:41:52.385407 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:41:52.385407 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 254/517] 10.222.0.27 () {56 vars in 1102 bytes} [Thu Aug 18 21:41:52 2022] GET /identity/v3/users/neutron => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:41:52.385407 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee118ffc-33f3-40a4-994e-aff3e98a849d None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:52.456989 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:52.478540 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a386af2-4508-4b01-885f-391e63b583a9 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:52.481699 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee118ffc-33f3-40a4-994e-aff3e98a849d None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:52.513254 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38c24a3-c073-412f-a37b-dcda924f0b3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:52.513874 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38c24a3-c073-412f-a37b-dcda924f0b3a None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:52.514149 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38c24a3-c073-412f-a37b-dcda924f0b3a None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:52.514422 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38c24a3-c073-412f-a37b-dcda924f0b3a None admin] PATH_INFO: `/v3/projects/service` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:52.516184 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb15131-ee00-48ab-85d8-f59fc02f0236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:52.516799 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb15131-ee00-48ab-85d8-f59fc02f0236 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:52.517077 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb15131-ee00-48ab-85d8-f59fc02f0236 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:52.517346 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb15131-ee00-48ab-85d8-f59fc02f0236 None admin] PATH_INFO: `/v3/domains` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:52.517978 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb15131-ee00-48ab-85d8-f59fc02f0236 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:41:52.518273 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb15131-ee00-48ab-85d8-f59fc02f0236 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:52.519645 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb15131-ee00-48ab-85d8-f59fc02f0236 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:52.521542 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38c24a3-c073-412f-a37b-dcda924f0b3a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:52.522954 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38c24a3-c073-412f-a37b-dcda924f0b3a None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:52.525825 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:52.531233 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 255/518] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 18 21:41:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:52.532165 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb15131-ee00-48ab-85d8-f59fc02f0236 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:52.535742 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application [None req-b38c24a3-c073-412f-a37b-dcda924f0b3a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 21:41:52.535742 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:41:52.535742 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:41:52.535742 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:41:52.535742 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:41:52.535742 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:41:52.535742 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:41:52.535742 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:41:52.535742 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:41:52.535742 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:41:52.535742 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:41:52.535742 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:41:52.535742 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 21:41:52.535742 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 21:41:52.535742 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 21:41:52.547614 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 21:41:52.547614 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:41:52.547614 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:41:52.547614 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:41:52.547614 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:41:52.547614 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:41:52.547614 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:41:52.547614 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:41:52.547614 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application with Lock( Aug 18 21:41:52.547614 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:41:52.547614 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:41:52.547614 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:41:52.547614 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:41:52.547614 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:41:52.547614 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:41:52.547614 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:41:52.547614 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:41:52.548647 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 21:41:52.548647 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 21:41:52.548647 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 21:41:52.548647 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 21:41:52.548647 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 21:41:52.548647 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 21:41:52.548647 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 21:41:52.548647 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:41:52.548647 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 264/519] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Aug 18 21:41:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:41:52.548647 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38c24a3-c073-412f-a37b-dcda924f0b3a None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:52.629930 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb15131-ee00-48ab-85d8-f59fc02f0236 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:52.638685 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38c24a3-c073-412f-a37b-dcda924f0b3a None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:52.663756 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cc63dd-246a-48bd-a2fe-64959c6d3219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:52.664401 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cc63dd-246a-48bd-a2fe-64959c6d3219 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:52.664713 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cc63dd-246a-48bd-a2fe-64959c6d3219 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:52.664988 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cc63dd-246a-48bd-a2fe-64959c6d3219 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:52.671816 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cc63dd-246a-48bd-a2fe-64959c6d3219 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:52.673363 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b52d84-a4c5-4604-92a4-20c96957631c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:52.673499 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cc63dd-246a-48bd-a2fe-64959c6d3219 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:52.673959 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b52d84-a4c5-4604-92a4-20c96957631c None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:52.674231 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b52d84-a4c5-4604-92a4-20c96957631c None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:52.674497 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b52d84-a4c5-4604-92a4-20c96957631c None admin] PATH_INFO: `/v3/domains` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:52.675127 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b52d84-a4c5-4604-92a4-20c96957631c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:41:52.675422 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b52d84-a4c5-4604-92a4-20c96957631c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:52.676795 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b52d84-a4c5-4604-92a4-20c96957631c None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:52.683641 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:52.684762 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application [None req-50cc63dd-246a-48bd-a2fe-64959c6d3219 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 18 21:41:52.684762 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:41:52.684762 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:41:52.684762 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:41:52.684762 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:41:52.684762 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:41:52.684762 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:41:52.684762 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:41:52.684762 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:41:52.684762 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:41:52.684762 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:41:52.684762 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:41:52.684762 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 21:41:52.684762 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 21:41:52.684762 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 21:41:52.684762 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 21:41:52.685759 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:41:52.685759 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:41:52.685759 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 21:41:52.685759 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 21:41:52.685759 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 21:41:52.685759 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 21:41:52.685759 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:41:52.685759 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:41:52.685759 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:41:52.685759 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:41:52.685759 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:41:52.685759 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application with Lock( Aug 18 21:41:52.685759 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:41:52.685759 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:41:52.685759 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:41:52.685759 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:41:52.685759 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:41:52.685759 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:41:52.686644 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:41:52.686644 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:41:52.686644 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 21:41:52.686644 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 21:41:52.686644 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 21:41:52.686644 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 21:41:52.686644 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 21:41:52.686644 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 21:41:52.686644 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 18 21:41:52.686644 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:41:52.686644 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 256/520] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Aug 18 21:41:52 2022] GET /identity/v3/users/cinder => generated 84 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:41:52.686644 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cc63dd-246a-48bd-a2fe-64959c6d3219 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:52.696825 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 265/521] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 18 21:41:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:52.696825 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b52d84-a4c5-4604-92a4-20c96957631c None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:52.745748 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:52.787647 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cc63dd-246a-48bd-a2fe-64959c6d3219 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:52.792797 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b52d84-a4c5-4604-92a4-20c96957631c None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:52.820943 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb0fc93-6d36-423a-a061-8f6d5f33ac14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:52.821468 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb0fc93-6d36-423a-a061-8f6d5f33ac14 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:52.821751 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb0fc93-6d36-423a-a061-8f6d5f33ac14 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:52.822027 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb0fc93-6d36-423a-a061-8f6d5f33ac14 None admin] PATH_INFO: `/v3/users` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:52.822754 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb0fc93-6d36-423a-a061-8f6d5f33ac14 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:41:52.823060 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb0fc93-6d36-423a-a061-8f6d5f33ac14 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:52.824497 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb0fc93-6d36-423a-a061-8f6d5f33ac14 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:52.828146 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcfe716-a800-407f-9a50-09b530554e3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:52.829390 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcfe716-a800-407f-9a50-09b530554e3e None admin] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:52.829683 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcfe716-a800-407f-9a50-09b530554e3e None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:52.829958 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcfe716-a800-407f-9a50-09b530554e3e None admin] PATH_INFO: `/v3/users` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:52.830589 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcfe716-a800-407f-9a50-09b530554e3e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:52.832014 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcfe716-a800-407f-9a50-09b530554e3e None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:52.842189 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 257/522] 10.222.0.27 () {56 vars in 1139 bytes} [Thu Aug 18 21:41:52 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:52.842992 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb0fc93-6d36-423a-a061-8f6d5f33ac14 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:52.917167 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 266/523] 10.222.0.27 () {60 vars in 1132 bytes} [Thu Aug 18 21:41:52 2022] POST /identity/v3/users => generated 247 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:41:52.918120 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcfe716-a800-407f-9a50-09b530554e3e None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:52.943118 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb0fc93-6d36-423a-a061-8f6d5f33ac14 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:52.961891 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:52.981711 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2228dea9-0c29-43a4-a5bb-5d2c6f7def04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:52.982481 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2228dea9-0c29-43a4-a5bb-5d2c6f7def04 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:52.982868 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2228dea9-0c29-43a4-a5bb-5d2c6f7def04 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:52.983256 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2228dea9-0c29-43a4-a5bb-5d2c6f7def04 None admin] PATH_INFO: `/v3/projects` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:52.984164 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2228dea9-0c29-43a4-a5bb-5d2c6f7def04 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:41:52.984792 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2228dea9-0c29-43a4-a5bb-5d2c6f7def04 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:52.986416 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2228dea9-0c29-43a4-a5bb-5d2c6f7def04 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:53.002472 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:53.007621 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 258/524] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Aug 18 21:41:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:53.008473 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2228dea9-0c29-43a4-a5bb-5d2c6f7def04 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:53.059119 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcfe716-a800-407f-9a50-09b530554e3e None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:53.098661 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10043da3-9190-430f-8ad3-8c2c254a9dc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:53.099261 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10043da3-9190-430f-8ad3-8c2c254a9dc1 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:53.099539 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10043da3-9190-430f-8ad3-8c2c254a9dc1 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:53.099812 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10043da3-9190-430f-8ad3-8c2c254a9dc1 None admin] PATH_INFO: `/v3/users` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:53.100546 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10043da3-9190-430f-8ad3-8c2c254a9dc1 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:41:53.100879 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10043da3-9190-430f-8ad3-8c2c254a9dc1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:53.102382 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10043da3-9190-430f-8ad3-8c2c254a9dc1 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:53.121488 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 267/525] 10.222.0.27 () {56 vars in 1137 bytes} [Thu Aug 18 21:41:52 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:53.123738 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10043da3-9190-430f-8ad3-8c2c254a9dc1 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:53.124091 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2228dea9-0c29-43a4-a5bb-5d2c6f7def04 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:53.162261 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef287a99-86db-4c47-a87b-c255f4d6545e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:53.162888 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef287a99-86db-4c47-a87b-c255f4d6545e None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:53.163166 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef287a99-86db-4c47-a87b-c255f4d6545e None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:53.163439 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef287a99-86db-4c47-a87b-c255f4d6545e None admin] PATH_INFO: `/v3/projects/service` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:53.170469 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef287a99-86db-4c47-a87b-c255f4d6545e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:53.172490 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef287a99-86db-4c47-a87b-c255f4d6545e None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:53.184355 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application [None req-ef287a99-86db-4c47-a87b-c255f4d6545e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 21:41:53.184355 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:41:53.184355 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:41:53.184355 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:41:53.184355 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:41:53.184355 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:41:53.184355 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:41:53.184355 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:41:53.184355 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:41:53.184355 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:41:53.184355 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:41:53.184355 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:41:53.184355 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 21:41:53.184355 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 21:41:53.184355 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 21:41:53.185481 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 21:41:53.185481 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:41:53.185481 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:41:53.185481 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:41:53.185481 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:41:53.185481 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:41:53.185481 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:41:53.185481 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:41:53.185481 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application with Lock( Aug 18 21:41:53.185481 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:41:53.185481 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:41:53.185481 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:41:53.185481 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:41:53.185481 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:41:53.185481 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:41:53.185481 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:41:53.185481 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:41:53.186503 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 21:41:53.186503 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 21:41:53.186503 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 21:41:53.186503 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 21:41:53.186503 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 21:41:53.186503 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 21:41:53.186503 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 21:41:53.186503 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:41:53.186503 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 259/526] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Aug 18 21:41:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:41:53.186960 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef287a99-86db-4c47-a87b-c255f4d6545e None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:53.226091 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:53.233911 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10043da3-9190-430f-8ad3-8c2c254a9dc1 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:53.249778 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:53.276706 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ea39cf-e5dd-434c-8d9c-22a5935a7e15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:53.277337 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ea39cf-e5dd-434c-8d9c-22a5935a7e15 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:53.277614 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ea39cf-e5dd-434c-8d9c-22a5935a7e15 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:53.277921 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ea39cf-e5dd-434c-8d9c-22a5935a7e15 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:53.303110 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef287a99-86db-4c47-a87b-c255f4d6545e None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:53.341682 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c52d979-5d7c-4072-b6ab-c0df49973902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:53.342280 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c52d979-5d7c-4072-b6ab-c0df49973902 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:53.342557 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c52d979-5d7c-4072-b6ab-c0df49973902 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:53.342829 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c52d979-5d7c-4072-b6ab-c0df49973902 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:53.343562 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c52d979-5d7c-4072-b6ab-c0df49973902 None admin] RBAC: Adding query filter params (role.id=30d8ac11e30e4b1d83940485e98d147c, scope.project.id=4b54801b90484d689034f838f85fc0a4, user.id=a39cd50340184779ac589bbcb7cac9aa) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:41:53.344528 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c52d979-5d7c-4072-b6ab-c0df49973902 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:53.346055 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c52d979-5d7c-4072-b6ab-c0df49973902 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:53.352105 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ea39cf-e5dd-434c-8d9c-22a5935a7e15 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:53.352230 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 260/527] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Aug 18 21:41:53 2022] GET /identity/v3/role_assignments?user.id=a39cd50340184779ac589bbcb7cac9aa&scope.project.id=4b54801b90484d689034f838f85fc0a4&role.id=30d8ac11e30e4b1d83940485e98d147c => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:53.352772 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c52d979-5d7c-4072-b6ab-c0df49973902 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:53.354464 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ea39cf-e5dd-434c-8d9c-22a5935a7e15 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:53.490784 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:53.494829 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c52d979-5d7c-4072-b6ab-c0df49973902 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:53.507831 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 268/528] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Aug 18 21:41:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 21:41:53.509654 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ea39cf-e5dd-434c-8d9c-22a5935a7e15 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:53.524933 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:53.535800 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0627105a-aa71-4a8b-8ca7-cee318395956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:53.536682 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0627105a-aa71-4a8b-8ca7-cee318395956 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:53.537115 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0627105a-aa71-4a8b-8ca7-cee318395956 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:53.537537 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0627105a-aa71-4a8b-8ca7-cee318395956 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:53.614825 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0627105a-aa71-4a8b-8ca7-cee318395956 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:53.616423 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0627105a-aa71-4a8b-8ca7-cee318395956 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:53.618014 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ea39cf-e5dd-434c-8d9c-22a5935a7e15 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:53.655885 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35e0d9f-7177-4b3a-a656-81cf8536403d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:53.656704 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35e0d9f-7177-4b3a-a656-81cf8536403d None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:53.657183 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35e0d9f-7177-4b3a-a656-81cf8536403d None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:53.657519 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35e0d9f-7177-4b3a-a656-81cf8536403d None admin] PATH_INFO: `/v3/projects` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:53.658292 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35e0d9f-7177-4b3a-a656-81cf8536403d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:41:53.658671 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35e0d9f-7177-4b3a-a656-81cf8536403d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:53.660270 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35e0d9f-7177-4b3a-a656-81cf8536403d None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:53.685114 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 269/529] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Aug 18 21:41:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:53.686085 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35e0d9f-7177-4b3a-a656-81cf8536403d None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:53.718114 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:53.722306 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 261/530] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Aug 18 21:41:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 21:41:53.723132 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0627105a-aa71-4a8b-8ca7-cee318395956 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:53.765970 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:53.798132 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35e0d9f-7177-4b3a-a656-81cf8536403d None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:53.832340 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0627105a-aa71-4a8b-8ca7-cee318395956 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:53.837235 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2255f829-3830-414d-bd32-787228bdbe38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:53.837992 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2255f829-3830-414d-bd32-787228bdbe38 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:53.838371 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2255f829-3830-414d-bd32-787228bdbe38 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:53.838789 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2255f829-3830-414d-bd32-787228bdbe38 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:53.850400 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2255f829-3830-414d-bd32-787228bdbe38 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:53.852210 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2255f829-3830-414d-bd32-787228bdbe38 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:53.869299 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application [None req-2255f829-3830-414d-bd32-787228bdbe38 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:41:53.869299 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:41:53.869299 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:41:53.869299 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:41:53.869299 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:41:53.869299 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:41:53.869299 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:41:53.869299 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:41:53.869299 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:41:53.869299 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:41:53.869299 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:41:53.869299 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:41:53.869299 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 21:41:53.869299 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 21:41:53.869299 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 21:41:53.869299 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 21:41:53.870325 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:41:53.870325 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:41:53.870325 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:41:53.870325 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:41:53.870325 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:41:53.870325 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:41:53.870325 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:41:53.870325 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application with Lock( Aug 18 21:41:53.870325 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:41:53.870325 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:41:53.870325 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:41:53.870325 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:41:53.870325 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:41:53.870325 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:41:53.870325 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:41:53.870325 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:41:53.870325 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 21:41:53.871173 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 21:41:53.871173 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:41:53.871173 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:41:53.871173 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 270/531] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 18 21:41:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:41:53.872552 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2255f829-3830-414d-bd32-787228bdbe38 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:53.873100 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90957f6d-221f-4219-abdb-50a0deaf12e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:53.873904 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90957f6d-221f-4219-abdb-50a0deaf12e0 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:53.874379 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90957f6d-221f-4219-abdb-50a0deaf12e0 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:53.874824 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90957f6d-221f-4219-abdb-50a0deaf12e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:53.876752 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90957f6d-221f-4219-abdb-50a0deaf12e0 None admin] RBAC: Adding query filter params (role.id=30d8ac11e30e4b1d83940485e98d147c, scope.project.id=4b54801b90484d689034f838f85fc0a4, user.id=85dfef6a910547da9706d294e7d40fd0) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:41:53.877255 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90957f6d-221f-4219-abdb-50a0deaf12e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:53.878911 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90957f6d-221f-4219-abdb-50a0deaf12e0 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:53.885037 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 262/532] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Aug 18 21:41:53 2022] GET /identity/v3/role_assignments?user.id=85dfef6a910547da9706d294e7d40fd0&scope.project.id=4b54801b90484d689034f838f85fc0a4&role.id=30d8ac11e30e4b1d83940485e98d147c => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:53.886029 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90957f6d-221f-4219-abdb-50a0deaf12e0 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:54.020010 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:54.069921 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90957f6d-221f-4219-abdb-50a0deaf12e0 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:54.084970 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2255f829-3830-414d-bd32-787228bdbe38 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:54.111604 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:54.139224 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ff642f-f9c9-4025-bdb7-157452db30da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:54.139224 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ff642f-f9c9-4025-bdb7-157452db30da None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:54.139224 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ff642f-f9c9-4025-bdb7-157452db30da None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:54.139224 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ff642f-f9c9-4025-bdb7-157452db30da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:54.139630 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace65c16-95e8-4830-960d-fd541596048f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:54.139630 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace65c16-95e8-4830-960d-fd541596048f None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:54.139630 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace65c16-95e8-4830-960d-fd541596048f None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:54.139630 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace65c16-95e8-4830-960d-fd541596048f None admin] PATH_INFO: `/v3/domains` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:54.139932 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace65c16-95e8-4830-960d-fd541596048f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:41:54.139932 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace65c16-95e8-4830-960d-fd541596048f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:54.139932 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace65c16-95e8-4830-960d-fd541596048f None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:54.149003 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ff642f-f9c9-4025-bdb7-157452db30da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:54.150564 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ff642f-f9c9-4025-bdb7-157452db30da None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:54.155598 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 263/533] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 18 21:41:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:54.161417 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace65c16-95e8-4830-960d-fd541596048f None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:54.166169 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application [None req-c0ff642f-f9c9-4025-bdb7-157452db30da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:41:54.166169 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:41:54.166169 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:41:54.166169 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:41:54.166169 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:41:54.166169 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:41:54.166169 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:41:54.166169 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:41:54.166169 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:41:54.166169 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:41:54.166169 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:41:54.166169 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:41:54.166169 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 21:41:54.166169 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 21:41:54.166169 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 21:41:54.166169 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 21:41:54.167234 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:41:54.167234 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:41:54.167234 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:41:54.167234 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:41:54.167234 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:41:54.167234 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:41:54.167234 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:41:54.167234 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application with Lock( Aug 18 21:41:54.167234 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:41:54.167234 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:41:54.167234 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:41:54.167234 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:41:54.167234 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:41:54.167234 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:41:54.167234 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:41:54.167234 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:41:54.167234 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 21:41:54.168278 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 21:41:54.168278 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:41:54.168278 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:41:54.168278 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 271/534] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 18 21:41:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:41:54.174766 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ff642f-f9c9-4025-bdb7-157452db30da None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:54.287219 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace65c16-95e8-4830-960d-fd541596048f None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:54.336467 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:54.363091 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ff642f-f9c9-4025-bdb7-157452db30da None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:54.365707 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf6df2d-3f43-407e-a371-c363532d6494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:54.366364 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf6df2d-3f43-407e-a371-c363532d6494 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:54.366650 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf6df2d-3f43-407e-a371-c363532d6494 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:54.366928 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf6df2d-3f43-407e-a371-c363532d6494 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:54.378050 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf6df2d-3f43-407e-a371-c363532d6494 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:54.379516 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf6df2d-3f43-407e-a371-c363532d6494 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:54.398754 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application [None req-edf6df2d-3f43-407e-a371-c363532d6494 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 21:41:54.398754 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:41:54.398754 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:41:54.398754 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:41:54.398754 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:41:54.398754 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:41:54.398754 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:41:54.398754 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:41:54.398754 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:41:54.398754 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:41:54.398754 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:41:54.398754 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:41:54.398754 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 21:41:54.398754 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 21:41:54.398754 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 21:41:54.399795 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 21:41:54.399795 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:41:54.399795 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:41:54.399795 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:41:54.399795 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:41:54.399795 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:41:54.399795 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:41:54.399795 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:41:54.399795 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application with Lock( Aug 18 21:41:54.399795 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:41:54.399795 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:41:54.399795 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:41:54.399795 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:41:54.399795 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:41:54.399795 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:41:54.399795 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:41:54.399795 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:41:54.400928 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 21:41:54.400928 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 21:41:54.400928 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 21:41:54.400928 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 21:41:54.400928 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 21:41:54.400928 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 21:41:54.400928 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 21:41:54.400928 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:41:54.402486 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 264/535] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Aug 18 21:41:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:41:54.412565 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c10db7-6cec-42d0-9c48-c3d20bdef490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:54.413215 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c10db7-6cec-42d0-9c48-c3d20bdef490 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:54.413493 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c10db7-6cec-42d0-9c48-c3d20bdef490 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:54.413766 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c10db7-6cec-42d0-9c48-c3d20bdef490 None admin] PATH_INFO: `/v3/domains` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:54.413892 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf6df2d-3f43-407e-a371-c363532d6494 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:54.414578 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c10db7-6cec-42d0-9c48-c3d20bdef490 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:41:54.414880 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c10db7-6cec-42d0-9c48-c3d20bdef490 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:54.416253 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c10db7-6cec-42d0-9c48-c3d20bdef490 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:54.437059 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 272/536] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 18 21:41:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:54.442773 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c10db7-6cec-42d0-9c48-c3d20bdef490 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:54.482478 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:54.615492 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c10db7-6cec-42d0-9c48-c3d20bdef490 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:54.619674 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf6df2d-3f43-407e-a371-c363532d6494 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:54.673130 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9674c81-f1dc-4f15-83a7-bf7317dcca3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:54.673684 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9674c81-f1dc-4f15-83a7-bf7317dcca3d None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:54.673962 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9674c81-f1dc-4f15-83a7-bf7317dcca3d None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:54.674225 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9674c81-f1dc-4f15-83a7-bf7317dcca3d None admin] PATH_INFO: `/v3/projects/service` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:54.681399 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9674c81-f1dc-4f15-83a7-bf7317dcca3d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:54.682974 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9674c81-f1dc-4f15-83a7-bf7317dcca3d None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:54.695036 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application [None req-a9674c81-f1dc-4f15-83a7-bf7317dcca3d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 21:41:54.695036 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:41:54.695036 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:41:54.695036 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:41:54.695036 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:41:54.695036 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:41:54.695036 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:41:54.695036 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:41:54.695036 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:41:54.695036 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:41:54.695036 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:41:54.695036 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:41:54.695036 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 21:41:54.695036 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 21:41:54.695036 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 21:41:54.696045 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 21:41:54.696045 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:41:54.696045 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:41:54.696045 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:41:54.696045 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:41:54.696045 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:41:54.696045 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:41:54.696045 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:41:54.696045 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application with Lock( Aug 18 21:41:54.696045 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:41:54.696045 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:41:54.696045 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:41:54.696045 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:41:54.696045 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:41:54.696045 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:41:54.696045 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:41:54.696045 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:41:54.697107 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 21:41:54.697107 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 21:41:54.697107 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 21:41:54.697107 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 21:41:54.697107 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 21:41:54.697107 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 21:41:54.697107 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 21:41:54.697107 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:41:54.697107 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 273/537] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Aug 18 21:41:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 21:41:54.702757 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4fa7b6-65b9-42fa-8c9a-669da6605db1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:54.703411 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4fa7b6-65b9-42fa-8c9a-669da6605db1 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:54.703689 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4fa7b6-65b9-42fa-8c9a-669da6605db1 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:54.704077 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4fa7b6-65b9-42fa-8c9a-669da6605db1 None admin] PATH_INFO: `/v3/projects` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:54.705453 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9674c81-f1dc-4f15-83a7-bf7317dcca3d None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:54.706391 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4fa7b6-65b9-42fa-8c9a-669da6605db1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:41:54.706699 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4fa7b6-65b9-42fa-8c9a-669da6605db1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:54.708141 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4fa7b6-65b9-42fa-8c9a-669da6605db1 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:54.737391 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 265/538] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Aug 18 21:41:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:54.743342 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4fa7b6-65b9-42fa-8c9a-669da6605db1 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:54.844758 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:54.851265 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9674c81-f1dc-4f15-83a7-bf7317dcca3d None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:54.851563 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:54.888576 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eb9498-6c31-43d6-be9b-e72fab9d91b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:54.889205 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eb9498-6c31-43d6-be9b-e72fab9d91b2 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:54.889484 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eb9498-6c31-43d6-be9b-e72fab9d91b2 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:54.889768 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eb9498-6c31-43d6-be9b-e72fab9d91b2 None admin] PATH_INFO: `/v3/projects` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:54.891252 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7eb9498-6c31-43d6-be9b-e72fab9d91b2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:41:54.891646 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7eb9498-6c31-43d6-be9b-e72fab9d91b2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:54.893393 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7eb9498-6c31-43d6-be9b-e72fab9d91b2 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:54.906855 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 274/539] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Aug 18 21:41:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:54.912487 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eb9498-6c31-43d6-be9b-e72fab9d91b2 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:54.982739 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4fa7b6-65b9-42fa-8c9a-669da6605db1 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:55.018693 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49990915-42d3-49dc-8cdf-c73e01055332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:55.019438 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49990915-42d3-49dc-8cdf-c73e01055332 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:55.019820 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49990915-42d3-49dc-8cdf-c73e01055332 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:55.020193 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49990915-42d3-49dc-8cdf-c73e01055332 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:55.021052 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49990915-42d3-49dc-8cdf-c73e01055332 None admin] RBAC: Adding query filter params (role.id=30d8ac11e30e4b1d83940485e98d147c, scope.project.id=4b54801b90484d689034f838f85fc0a4, user.id=6a937971ad1a4b0c8697c764f214d446) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:41:55.021465 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49990915-42d3-49dc-8cdf-c73e01055332 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:55.023102 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49990915-42d3-49dc-8cdf-c73e01055332 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:55.029185 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 266/540] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Aug 18 21:41:54 2022] GET /identity/v3/role_assignments?user.id=6a937971ad1a4b0c8697c764f214d446&scope.project.id=4b54801b90484d689034f838f85fc0a4&role.id=30d8ac11e30e4b1d83940485e98d147c => generated 259 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:55.030588 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8f3479-c5cb-409e-ad0c-6c521c4a7db0 None None] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:55.030972 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8f3479-c5cb-409e-ad0c-6c521c4a7db0 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:55.031381 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8f3479-c5cb-409e-ad0c-6c521c4a7db0 None None] PATH_INFO: `/` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:55.037374 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 267/541] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:41:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:41:55.038952 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a922830-ceb2-4858-bd46-a19856ad40a8 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:55.039063 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eb9498-6c31-43d6-be9b-e72fab9d91b2 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:55.039414 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a922830-ceb2-4858-bd46-a19856ad40a8 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:55.039786 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a922830-ceb2-4858-bd46-a19856ad40a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:55.059051 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-0a922830-ceb2-4858-bd46-a19856ad40a8 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:41:55.060282 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-0a922830-ceb2-4858-bd46-a19856ad40a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:41:55.085298 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9092cfc5-be36-4dc4-9869-b0b979417296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:55.086021 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9092cfc5-be36-4dc4-9869-b0b979417296 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:55.086302 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9092cfc5-be36-4dc4-9869-b0b979417296 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:55.086605 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9092cfc5-be36-4dc4-9869-b0b979417296 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:55.087875 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9092cfc5-be36-4dc4-9869-b0b979417296 None admin] RBAC: Adding query filter params (role.id=30d8ac11e30e4b1d83940485e98d147c, scope.project.id=4b54801b90484d689034f838f85fc0a4, user.id=22b6a7c36f8a4795a75271b8079821c7) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:41:55.088239 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9092cfc5-be36-4dc4-9869-b0b979417296 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:55.089887 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9092cfc5-be36-4dc4-9869-b0b979417296 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:55.098860 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 275/542] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Aug 18 21:41:54 2022] GET /identity/v3/role_assignments?user.id=22b6a7c36f8a4795a75271b8079821c7&scope.project.id=4b54801b90484d689034f838f85fc0a4&role.id=30d8ac11e30e4b1d83940485e98d147c => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 21:41:55.227534 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 268/543] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:41:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 21:41:55.549272 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9092cfc5-be36-4dc4-9869-b0b979417296 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:55.574337 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:55.669368 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdf76ea-d3dd-4385-8c61-0c0b299b8907 None None] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:55.669690 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdf76ea-d3dd-4385-8c61-0c0b299b8907 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:55.669911 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdf76ea-d3dd-4385-8c61-0c0b299b8907 None None] PATH_INFO: `/` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:55.671473 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 269/544] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:41:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:41:55.673183 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9092cfc5-be36-4dc4-9869-b0b979417296 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:55.677436 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7e01ef-9a5c-4725-bc2a-ad0b4cfc1e03 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:55.677723 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7e01ef-9a5c-4725-bc2a-ad0b4cfc1e03 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:55.678000 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7e01ef-9a5c-4725-bc2a-ad0b4cfc1e03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:55.711711 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0276e9-1f89-4a11-9703-3c416f623117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:55.712389 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0276e9-1f89-4a11-9703-3c416f623117 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:55.712694 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0276e9-1f89-4a11-9703-3c416f623117 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:55.712968 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0276e9-1f89-4a11-9703-3c416f623117 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:55.724739 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0276e9-1f89-4a11-9703-3c416f623117 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:41:55.729641 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-cc7e01ef-9a5c-4725-bc2a-ad0b4cfc1e03 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:41:55.730006 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application [None req-1c0276e9-1f89-4a11-9703-3c416f623117 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 21:41:55.730006 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:41:55.730006 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:41:55.730006 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:41:55.730006 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:41:55.730006 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:41:55.730006 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:41:55.730006 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:41:55.730006 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:41:55.730006 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:41:55.730006 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:41:55.730006 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:41:55.730006 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:41:55.730006 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:41:55.730006 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:41:55.730006 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:41:55.732032 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:41:55.732032 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:41:55.732032 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:41:55.732032 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:41:55.732032 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:41:55.732032 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:41:55.732032 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:41:55.732032 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:41:55.732032 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:41:55.732032 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:41:55.732032 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:41:55.732032 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application with Lock( Aug 18 21:41:55.732032 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:41:55.732032 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:41:55.732032 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:41:55.732032 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:41:55.733552 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:41:55.733552 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:41:55.733552 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:41:55.733552 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:41:55.733552 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:41:55.733552 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:41:55.733552 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:41:55.733552 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:41:55.733552 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:41:55.733552 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:41:55.733552 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 21:41:55.733552 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:41:55.734322 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-cc7e01ef-9a5c-4725-bc2a-ad0b4cfc1e03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:41:55.734987 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 276/545] 10.222.0.27 () {56 vars in 1102 bytes} [Thu Aug 18 21:41:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:41:55.739562 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0276e9-1f89-4a11-9703-3c416f623117 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:55.800282 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:55.838770 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 270/546] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:41:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 21:41:55.882710 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:55.901658 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0276e9-1f89-4a11-9703-3c416f623117 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:55.941716 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0923f843-c371-49d0-b632-4fefe653c9c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:55.942329 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0923f843-c371-49d0-b632-4fefe653c9c6 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:55.942639 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0923f843-c371-49d0-b632-4fefe653c9c6 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:55.942928 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0923f843-c371-49d0-b632-4fefe653c9c6 None admin] PATH_INFO: `/v3/roles` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:55.943594 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0923f843-c371-49d0-b632-4fefe653c9c6 None admin] RBAC: Adding query filter params (name=service) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:41:55.943901 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0923f843-c371-49d0-b632-4fefe653c9c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:55.945319 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0923f843-c371-49d0-b632-4fefe653c9c6 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:55.956796 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 277/547] 10.222.0.27 () {56 vars in 1103 bytes} [Thu Aug 18 21:41:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:55.960167 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7e01ef-9a5c-4725-bc2a-ad0b4cfc1e03 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:56.123719 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7e01ef-9a5c-4725-bc2a-ad0b4cfc1e03 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:56.177304 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79dd43d-f3c0-4c99-8d44-d29f85b269c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:56.177946 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79dd43d-f3c0-4c99-8d44-d29f85b269c2 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:56.178232 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79dd43d-f3c0-4c99-8d44-d29f85b269c2 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:56.178511 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79dd43d-f3c0-4c99-8d44-d29f85b269c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:56.192305 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79dd43d-f3c0-4c99-8d44-d29f85b269c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:56.193809 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79dd43d-f3c0-4c99-8d44-d29f85b269c2 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:56.212206 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application [None req-f79dd43d-f3c0-4c99-8d44-d29f85b269c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:41:56.212206 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:41:56.212206 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:41:56.212206 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:41:56.212206 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:41:56.212206 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:41:56.212206 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:41:56.212206 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:41:56.212206 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:41:56.212206 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:41:56.212206 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:41:56.212206 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:41:56.212206 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 21:41:56.212206 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 21:41:56.212206 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 21:41:56.212206 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 21:41:56.213211 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:41:56.213211 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:41:56.213211 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:41:56.213211 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:41:56.213211 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:41:56.213211 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:41:56.213211 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:41:56.213211 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application with Lock( Aug 18 21:41:56.213211 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:41:56.213211 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:41:56.213211 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:41:56.213211 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:41:56.213211 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:41:56.213211 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:41:56.213211 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:41:56.213211 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:41:56.213211 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 21:41:56.214069 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 21:41:56.214069 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:41:56.214069 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:41:56.214069 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 271/548] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 18 21:41:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:41:56.219294 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0923f843-c371-49d0-b632-4fefe653c9c6 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:56.224925 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac64663-db02-49e1-88fa-a6e125314585 None None] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:56.225227 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac64663-db02-49e1-88fa-a6e125314585 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:56.225466 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac64663-db02-49e1-88fa-a6e125314585 None None] PATH_INFO: `/` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:56.227040 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 272/549] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:41:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:41:56.232041 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e631c993-0f91-4fa2-b328-8a560218e59d None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:56.232327 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e631c993-0f91-4fa2-b328-8a560218e59d None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:56.232625 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e631c993-0f91-4fa2-b328-8a560218e59d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:56.281163 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-e631c993-0f91-4fa2-b328-8a560218e59d None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:41:56.282796 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-e631c993-0f91-4fa2-b328-8a560218e59d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:41:56.313736 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:56.353041 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0923f843-c371-49d0-b632-4fefe653c9c6 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:56.381951 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 273/550] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:41:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 21:41:56.382959 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e631c993-0f91-4fa2-b328-8a560218e59d None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:56.407615 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2b1ad1-1adc-436e-9061-73fe611cb7f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:56.409086 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2b1ad1-1adc-436e-9061-73fe611cb7f1 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:56.409372 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2b1ad1-1adc-436e-9061-73fe611cb7f1 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:56.409648 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2b1ad1-1adc-436e-9061-73fe611cb7f1 None admin] PATH_INFO: `/v3/domains` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:56.410522 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2b1ad1-1adc-436e-9061-73fe611cb7f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:41:56.410824 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2b1ad1-1adc-436e-9061-73fe611cb7f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:56.412215 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2b1ad1-1adc-436e-9061-73fe611cb7f1 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:56.444768 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 278/551] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 18 21:41:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:56.450646 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2b1ad1-1adc-436e-9061-73fe611cb7f1 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:56.456894 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:56.574356 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e631c993-0f91-4fa2-b328-8a560218e59d None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:56.615246 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed706b3c-e624-451e-ad5f-26698af12a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:56.616156 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed706b3c-e624-451e-ad5f-26698af12a6c None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:56.616436 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed706b3c-e624-451e-ad5f-26698af12a6c None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:56.616739 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed706b3c-e624-451e-ad5f-26698af12a6c None admin] PATH_INFO: `/v3/roles/service` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:56.628933 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed706b3c-e624-451e-ad5f-26698af12a6c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:41:56.634383 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application [None req-ed706b3c-e624-451e-ad5f-26698af12a6c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 21:41:56.634383 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:41:56.634383 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:41:56.634383 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:41:56.634383 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:41:56.634383 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:41:56.634383 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:41:56.634383 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:41:56.634383 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:41:56.634383 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:41:56.634383 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:41:56.634383 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:41:56.634383 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:41:56.634383 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:41:56.634383 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:41:56.634383 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:41:56.635273 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:41:56.635273 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:41:56.635273 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:41:56.635273 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:41:56.635273 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:41:56.635273 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:41:56.635273 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:41:56.635273 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:41:56.635273 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:41:56.635273 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:41:56.635273 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:41:56.635273 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application with Lock( Aug 18 21:41:56.635273 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:41:56.635273 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:41:56.635273 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:41:56.635273 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:41:56.636095 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:41:56.636095 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:41:56.636095 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:41:56.636095 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:41:56.636095 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:41:56.636095 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:41:56.636095 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:41:56.636095 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:41:56.636095 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:41:56.636095 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:41:56.636095 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 21:41:56.636095 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:41:56.636095 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 274/552] 10.222.0.27 () {56 vars in 1102 bytes} [Thu Aug 18 21:41:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:41:56.643062 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed706b3c-e624-451e-ad5f-26698af12a6c None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:56.658216 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:56.660184 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2b1ad1-1adc-436e-9061-73fe611cb7f1 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:56.708481 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5649d67f-2c48-495d-9e11-b557d09c513a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:56.709141 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5649d67f-2c48-495d-9e11-b557d09c513a None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:56.709416 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5649d67f-2c48-495d-9e11-b557d09c513a None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:56.709686 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5649d67f-2c48-495d-9e11-b557d09c513a None admin] PATH_INFO: `/v3/users/swift` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:56.719976 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5649d67f-2c48-495d-9e11-b557d09c513a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:56.721925 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5649d67f-2c48-495d-9e11-b557d09c513a None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:56.741465 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application [None req-5649d67f-2c48-495d-9e11-b557d09c513a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 18 21:41:56.741465 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:41:56.741465 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:41:56.741465 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:41:56.741465 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:41:56.741465 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:41:56.741465 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:41:56.741465 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:41:56.741465 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:41:56.741465 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:41:56.741465 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:41:56.741465 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:41:56.741465 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 21:41:56.741465 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 21:41:56.741465 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 21:41:56.741465 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 21:41:56.742539 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:41:56.742539 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:41:56.742539 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 21:41:56.742539 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 21:41:56.742539 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 21:41:56.742539 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 21:41:56.742539 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:41:56.742539 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:41:56.742539 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:41:56.742539 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:41:56.742539 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:41:56.742539 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application with Lock( Aug 18 21:41:56.742539 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:41:56.742539 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:41:56.742539 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:41:56.742539 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:41:56.742539 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:41:56.742539 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:41:56.743445 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:41:56.743445 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:41:56.743445 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 21:41:56.743445 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 21:41:56.743445 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 21:41:56.743445 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 21:41:56.743445 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 21:41:56.743445 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 21:41:56.743445 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 18 21:41:56.743445 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:41:56.743445 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 279/553] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Aug 18 21:41:56 2022] GET /identity/v3/users/swift => generated 83 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:41:56.744412 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5649d67f-2c48-495d-9e11-b557d09c513a None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:56.767836 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed706b3c-e624-451e-ad5f-26698af12a6c None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:56.805833 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c2da94-03ca-4374-8390-cf423841ca3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:56.806437 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c2da94-03ca-4374-8390-cf423841ca3c None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:56.806706 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c2da94-03ca-4374-8390-cf423841ca3c None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:56.806980 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c2da94-03ca-4374-8390-cf423841ca3c None admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:56.807649 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c2da94-03ca-4374-8390-cf423841ca3c None admin] RBAC: Adding query filter params (name=service) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:41:56.807952 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c2da94-03ca-4374-8390-cf423841ca3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:56.809370 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c2da94-03ca-4374-8390-cf423841ca3c None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:56.820715 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:56.822978 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 275/554] 10.222.0.27 () {56 vars in 1103 bytes} [Thu Aug 18 21:41:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:56.823879 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c2da94-03ca-4374-8390-cf423841ca3c None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:56.873838 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5649d67f-2c48-495d-9e11-b557d09c513a None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:56.905508 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:56.916552 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a561eb-dc8b-441b-bbdb-0d4c5afb5ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:56.917527 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a561eb-dc8b-441b-bbdb-0d4c5afb5ba2 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:56.917811 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a561eb-dc8b-441b-bbdb-0d4c5afb5ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:56.918087 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a561eb-dc8b-441b-bbdb-0d4c5afb5ba2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:56.932682 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a561eb-dc8b-441b-bbdb-0d4c5afb5ba2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:41:56.940186 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application [None req-a7a561eb-dc8b-441b-bbdb-0d4c5afb5ba2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 21:41:56.940186 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:41:56.940186 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:41:56.940186 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:41:56.940186 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:41:56.940186 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:41:56.940186 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:41:56.940186 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:41:56.940186 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:41:56.940186 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:41:56.940186 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:41:56.940186 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:41:56.940186 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:41:56.940186 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:41:56.940186 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:41:56.940186 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:41:56.941363 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:41:56.941363 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:41:56.941363 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:41:56.941363 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:41:56.941363 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:41:56.941363 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:41:56.941363 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:41:56.941363 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:41:56.941363 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:41:56.941363 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:41:56.941363 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:41:56.941363 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application with Lock( Aug 18 21:41:56.941363 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:41:56.941363 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:41:56.941363 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:41:56.941363 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:41:56.942319 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:41:56.942319 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:41:56.942319 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:41:56.942319 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:41:56.942319 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:41:56.942319 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:41:56.942319 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:41:56.942319 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:41:56.942319 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:41:56.942319 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:41:56.942319 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 21:41:56.942319 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:41:56.942319 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 280/555] 10.222.0.27 () {56 vars in 1102 bytes} [Thu Aug 18 21:41:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:41:56.943010 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a561eb-dc8b-441b-bbdb-0d4c5afb5ba2 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:56.950293 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c2da94-03ca-4374-8390-cf423841ca3c None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:56.990506 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6069e31c-7071-49b4-b507-66c8ac2764ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:56.991568 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6069e31c-7071-49b4-b507-66c8ac2764ab None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:56.992043 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6069e31c-7071-49b4-b507-66c8ac2764ab None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:56.992457 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6069e31c-7071-49b4-b507-66c8ac2764ab None admin] PATH_INFO: `/v3/users` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:56.993506 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6069e31c-7071-49b4-b507-66c8ac2764ab None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:41:56.993955 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6069e31c-7071-49b4-b507-66c8ac2764ab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:56.995651 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6069e31c-7071-49b4-b507-66c8ac2764ab None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:57.021077 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 276/556] 10.222.0.27 () {56 vars in 1135 bytes} [Thu Aug 18 21:41:56 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:57.022274 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6069e31c-7071-49b4-b507-66c8ac2764ab None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:57.064174 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a561eb-dc8b-441b-bbdb-0d4c5afb5ba2 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:57.089058 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:57.101296 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a8f554-5f08-436c-aca6-ecd36952bca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:57.102387 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a8f554-5f08-436c-aca6-ecd36952bca0 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:57.102387 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a8f554-5f08-436c-aca6-ecd36952bca0 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:57.102579 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a8f554-5f08-436c-aca6-ecd36952bca0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:57.113034 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a8f554-5f08-436c-aca6-ecd36952bca0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:57.115044 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a8f554-5f08-436c-aca6-ecd36952bca0 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:57.130906 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application [None req-a4a8f554-5f08-436c-aca6-ecd36952bca0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:41:57.130906 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:41:57.130906 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:41:57.130906 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:41:57.130906 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:41:57.130906 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:41:57.130906 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:41:57.130906 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:41:57.130906 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:41:57.130906 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:41:57.130906 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:41:57.130906 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:41:57.130906 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 21:41:57.130906 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 21:41:57.130906 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 21:41:57.130906 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 21:41:57.132693 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:41:57.132693 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:41:57.132693 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:41:57.132693 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:41:57.132693 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:41:57.132693 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:41:57.132693 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:41:57.132693 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application with Lock( Aug 18 21:41:57.132693 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:41:57.132693 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:41:57.132693 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:41:57.132693 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:41:57.132693 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:41:57.132693 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:41:57.132693 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:41:57.132693 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:41:57.132693 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 21:41:57.133800 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 21:41:57.133800 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:41:57.133800 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:41:57.136748 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 281/557] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 18 21:41:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:41:57.137626 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a8f554-5f08-436c-aca6-ecd36952bca0 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:57.148148 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6069e31c-7071-49b4-b507-66c8ac2764ab None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:57.184075 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:57.191687 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b2bd70-7c73-4005-8200-7e4c7f8fb70d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:57.192488 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b2bd70-7c73-4005-8200-7e4c7f8fb70d None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:57.192978 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b2bd70-7c73-4005-8200-7e4c7f8fb70d None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:57.193492 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b2bd70-7c73-4005-8200-7e4c7f8fb70d None admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:57.194393 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b2bd70-7c73-4005-8200-7e4c7f8fb70d None admin] RBAC: Adding query filter params (name=service) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:41:57.194879 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b2bd70-7c73-4005-8200-7e4c7f8fb70d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:57.196405 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b2bd70-7c73-4005-8200-7e4c7f8fb70d None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:57.211023 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 277/558] 10.222.0.27 () {56 vars in 1103 bytes} [Thu Aug 18 21:41:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:57.212326 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b2bd70-7c73-4005-8200-7e4c7f8fb70d None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:57.244724 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a8f554-5f08-436c-aca6-ecd36952bca0 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:57.280143 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f1fccc-4ff7-413a-9df3-d53554d952ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:57.280847 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f1fccc-4ff7-413a-9df3-d53554d952ae None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:57.281741 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f1fccc-4ff7-413a-9df3-d53554d952ae None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:57.281933 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f1fccc-4ff7-413a-9df3-d53554d952ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:57.327879 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:57.332119 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b2bd70-7c73-4005-8200-7e4c7f8fb70d None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:57.354401 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f1fccc-4ff7-413a-9df3-d53554d952ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:57.355870 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f1fccc-4ff7-413a-9df3-d53554d952ae None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:57.367185 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bd4abe-5969-4518-a82f-41bb0f2ffe10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:57.367789 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bd4abe-5969-4518-a82f-41bb0f2ffe10 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:57.368068 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bd4abe-5969-4518-a82f-41bb0f2ffe10 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:57.368343 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bd4abe-5969-4518-a82f-41bb0f2ffe10 None admin] PATH_INFO: `/v3/domains` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:57.369016 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bd4abe-5969-4518-a82f-41bb0f2ffe10 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:41:57.369319 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bd4abe-5969-4518-a82f-41bb0f2ffe10 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:57.370695 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bd4abe-5969-4518-a82f-41bb0f2ffe10 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:57.382480 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 278/559] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 18 21:41:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:57.383275 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bd4abe-5969-4518-a82f-41bb0f2ffe10 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:57.435780 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:57.454097 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 282/560] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Aug 18 21:41:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 21:41:57.455596 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5137f1-42f9-4a40-b3a0-ddaf3701a940 None None] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:57.455888 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5137f1-42f9-4a40-b3a0-ddaf3701a940 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:57.456168 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5137f1-42f9-4a40-b3a0-ddaf3701a940 None None] PATH_INFO: `/` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:57.457442 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 283/561] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:41:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:41:57.461765 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a339a8be-4994-4711-80d8-0698f7c8f8ce None None] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:57.462047 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a339a8be-4994-4711-80d8-0698f7c8f8ce None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:57.462317 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a339a8be-4994-4711-80d8-0698f7c8f8ce None None] PATH_INFO: `/` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:57.463539 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 284/562] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:41:57 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:41:57.464232 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a339a8be-4994-4711-80d8-0698f7c8f8ce None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:57.486442 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bd4abe-5969-4518-a82f-41bb0f2ffe10 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:57.521712 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc30b78-dece-421a-b63e-6501dd829c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:57.522338 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc30b78-dece-421a-b63e-6501dd829c87 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:57.522617 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc30b78-dece-421a-b63e-6501dd829c87 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:57.522895 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc30b78-dece-421a-b63e-6501dd829c87 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:57.534068 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc30b78-dece-421a-b63e-6501dd829c87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:57.535598 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc30b78-dece-421a-b63e-6501dd829c87 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:57.541099 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:57.550099 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application [None req-8bc30b78-dece-421a-b63e-6501dd829c87 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:41:57.550099 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:41:57.550099 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:41:57.550099 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:41:57.550099 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:41:57.550099 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:41:57.550099 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:41:57.550099 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:41:57.550099 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:41:57.550099 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:41:57.550099 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:41:57.550099 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:41:57.550099 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 21:41:57.550099 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 21:41:57.550099 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 21:41:57.550099 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 21:41:57.551023 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:41:57.551023 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:41:57.551023 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:41:57.551023 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:41:57.551023 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:41:57.551023 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:41:57.551023 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:41:57.551023 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application with Lock( Aug 18 21:41:57.551023 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:41:57.551023 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:41:57.551023 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:41:57.551023 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:41:57.551023 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:41:57.551023 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:41:57.551023 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:41:57.551023 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:41:57.551023 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 21:41:57.551910 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 21:41:57.551910 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:41:57.551910 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:41:57.551910 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 279/563] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 18 21:41:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:41:57.552227 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc30b78-dece-421a-b63e-6501dd829c87 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:57.571415 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a339a8be-4994-4711-80d8-0698f7c8f8ce None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:57.607667 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa92705-d61b-4159-8128-17a57f9e60a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:57.608316 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa92705-d61b-4159-8128-17a57f9e60a1 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:57.608619 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa92705-d61b-4159-8128-17a57f9e60a1 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:57.608904 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa92705-d61b-4159-8128-17a57f9e60a1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:57.616820 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa92705-d61b-4159-8128-17a57f9e60a1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:57.618246 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa92705-d61b-4159-8128-17a57f9e60a1 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:57.629984 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application [None req-baa92705-d61b-4159-8128-17a57f9e60a1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 18 21:41:57.629984 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:41:57.629984 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:41:57.629984 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:41:57.629984 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:41:57.629984 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:41:57.629984 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:41:57.629984 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:41:57.629984 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:41:57.629984 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:41:57.629984 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:41:57.629984 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:41:57.629984 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 21:41:57.629984 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 21:41:57.629984 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 21:41:57.629984 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 21:41:57.630966 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:41:57.630966 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:41:57.630966 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 21:41:57.630966 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 21:41:57.630966 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 21:41:57.630966 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 21:41:57.630966 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:41:57.630966 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:41:57.630966 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:41:57.630966 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:41:57.630966 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:41:57.630966 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application with Lock( Aug 18 21:41:57.630966 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:41:57.630966 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:41:57.630966 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:41:57.630966 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:41:57.630966 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:41:57.630966 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:41:57.631931 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:41:57.631931 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:41:57.631931 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 21:41:57.631931 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 21:41:57.631931 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 21:41:57.631931 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 21:41:57.631931 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 21:41:57.631931 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 21:41:57.631931 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 18 21:41:57.631931 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:41:57.631931 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 285/564] 10.222.0.27 () {56 vars in 1093 bytes} [Thu Aug 18 21:41:57 2022] GET /identity/v3/users/nova => generated 82 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:41:57.632532 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091bbc9e-f8f9-4a3c-ba3e-d681818dd061 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:57.632532 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091bbc9e-f8f9-4a3c-ba3e-d681818dd061 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:57.632760 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091bbc9e-f8f9-4a3c-ba3e-d681818dd061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:57.650323 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-091bbc9e-f8f9-4a3c-ba3e-d681818dd061 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:41:57.651546 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-091bbc9e-f8f9-4a3c-ba3e-d681818dd061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:41:57.656255 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc30b78-dece-421a-b63e-6501dd829c87 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:57.658837 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:57.691118 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe00411-c8f8-4171-aa42-6c6c3881c83a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:57.691666 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe00411-c8f8-4171-aa42-6c6c3881c83a None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:57.691946 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe00411-c8f8-4171-aa42-6c6c3881c83a None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:57.692221 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe00411-c8f8-4171-aa42-6c6c3881c83a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:57.703836 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe00411-c8f8-4171-aa42-6c6c3881c83a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:57.705352 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe00411-c8f8-4171-aa42-6c6c3881c83a None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:57.718516 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 286/565] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:41:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 21:41:57.719687 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application [None req-bbe00411-c8f8-4171-aa42-6c6c3881c83a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:41:57.719687 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:41:57.719687 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:41:57.719687 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:41:57.719687 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:41:57.719687 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:41:57.719687 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:41:57.719687 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:41:57.719687 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:41:57.719687 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:41:57.719687 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:41:57.719687 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:41:57.719687 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 21:41:57.719687 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 21:41:57.719687 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 21:41:57.719687 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 21:41:57.720651 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:41:57.720651 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:41:57.720651 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:41:57.720651 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:41:57.720651 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:41:57.720651 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:41:57.720651 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:41:57.720651 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application with Lock( Aug 18 21:41:57.720651 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:41:57.720651 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:41:57.720651 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:41:57.720651 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:41:57.720651 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:41:57.720651 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:41:57.720651 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:41:57.720651 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:41:57.720651 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 21:41:57.721532 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 21:41:57.721532 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:41:57.721532 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:41:57.721711 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff8862-6878-468b-a819-52237b30b5e6 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:57.721711 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff8862-6878-468b-a819-52237b30b5e6 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:57.721711 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff8862-6878-468b-a819-52237b30b5e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:57.721901 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 280/566] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 18 21:41:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:41:57.722545 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe00411-c8f8-4171-aa42-6c6c3881c83a None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:57.741445 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-19ff8862-6878-468b-a819-52237b30b5e6 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:41:57.742937 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-19ff8862-6878-468b-a819-52237b30b5e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:41:57.802729 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:57.810859 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 287/567] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:41:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 21:41:57.811672 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ff8862-6878-468b-a819-52237b30b5e6 None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:57.846037 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe00411-c8f8-4171-aa42-6c6c3881c83a None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:57.882838 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d433b9-2841-4253-a05e-fd0772f870cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:57.883620 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d433b9-2841-4253-a05e-fd0772f870cb None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:57.883969 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d433b9-2841-4253-a05e-fd0772f870cb None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:57.884311 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d433b9-2841-4253-a05e-fd0772f870cb None admin] PATH_INFO: `/v3/domains` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:57.885064 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d433b9-2841-4253-a05e-fd0772f870cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:41:57.885433 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d433b9-2841-4253-a05e-fd0772f870cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:57.886890 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d433b9-2841-4253-a05e-fd0772f870cb None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:57.903800 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 281/568] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 18 21:41:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:57.903800 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d433b9-2841-4253-a05e-fd0772f870cb None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:57.919594 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:57.925489 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ff8862-6878-468b-a819-52237b30b5e6 None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:57.964273 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cc3993-599e-4e15-b7f5-b76a60274819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:57.965262 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cc3993-599e-4e15-b7f5-b76a60274819 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:57.965551 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cc3993-599e-4e15-b7f5-b76a60274819 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:57.965827 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cc3993-599e-4e15-b7f5-b76a60274819 None admin] PATH_INFO: `/v3/users` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:57.966848 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cc3993-599e-4e15-b7f5-b76a60274819 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:41:57.967145 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cc3993-599e-4e15-b7f5-b76a60274819 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:57.970139 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cc3993-599e-4e15-b7f5-b76a60274819 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:57.994556 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 288/569] 10.222.0.27 () {56 vars in 1133 bytes} [Thu Aug 18 21:41:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:57.995473 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cc3993-599e-4e15-b7f5-b76a60274819 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:58.011640 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d433b9-2841-4253-a05e-fd0772f870cb None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:58.051381 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a42ae2-b7fc-4a8c-9ce5-fa2a9c88c99b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:58.051983 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a42ae2-b7fc-4a8c-9ce5-fa2a9c88c99b None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:58.052420 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:58.052723 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a42ae2-b7fc-4a8c-9ce5-fa2a9c88c99b None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:58.053025 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a42ae2-b7fc-4a8c-9ce5-fa2a9c88c99b None admin] PATH_INFO: `/v3/domains` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:58.053653 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a42ae2-b7fc-4a8c-9ce5-fa2a9c88c99b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:41:58.053957 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a42ae2-b7fc-4a8c-9ce5-fa2a9c88c99b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:58.055810 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a42ae2-b7fc-4a8c-9ce5-fa2a9c88c99b None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:58.077042 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 282/570] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 18 21:41:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:58.077042 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a42ae2-b7fc-4a8c-9ce5-fa2a9c88c99b None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:58.102593 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cc3993-599e-4e15-b7f5-b76a60274819 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:58.137515 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6a1c2f-fe17-4972-af8d-ed99d9c903fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:58.138141 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6a1c2f-fe17-4972-af8d-ed99d9c903fa None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:58.138420 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6a1c2f-fe17-4972-af8d-ed99d9c903fa None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:58.138694 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6a1c2f-fe17-4972-af8d-ed99d9c903fa None admin] PATH_INFO: `/v3/users/glance` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:58.147291 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6a1c2f-fe17-4972-af8d-ed99d9c903fa None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:58.148752 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6a1c2f-fe17-4972-af8d-ed99d9c903fa None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:58.161861 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application [None req-0a6a1c2f-fe17-4972-af8d-ed99d9c903fa None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 18 21:41:58.161861 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:41:58.161861 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:41:58.161861 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:41:58.161861 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:41:58.161861 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:41:58.161861 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:41:58.161861 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:41:58.161861 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:41:58.161861 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:41:58.161861 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:41:58.161861 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:41:58.161861 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 21:41:58.161861 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 21:41:58.161861 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 21:41:58.161861 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 21:41:58.162782 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:41:58.162782 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:41:58.162782 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 21:41:58.162782 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 21:41:58.162782 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 21:41:58.162782 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 21:41:58.162782 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:41:58.162782 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:41:58.162782 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:41:58.162782 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:41:58.162782 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:41:58.162782 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application with Lock( Aug 18 21:41:58.162782 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:41:58.162782 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:41:58.162782 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:41:58.162782 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:41:58.162782 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:41:58.162782 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:41:58.163710 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:41:58.163710 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:41:58.163710 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 21:41:58.163710 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 21:41:58.163710 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 21:41:58.163710 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 21:41:58.163710 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 21:41:58.163710 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 21:41:58.163710 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 18 21:41:58.163710 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:41:58.163710 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 289/571] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Aug 18 21:41:57 2022] GET /identity/v3/users/glance => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:41:58.163710 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6a1c2f-fe17-4972-af8d-ed99d9c903fa None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:58.175744 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:58.198123 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a42ae2-b7fc-4a8c-9ce5-fa2a9c88c99b None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:58.232526 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcafca1-b402-43e6-b600-255a9e08a4c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:58.233123 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcafca1-b402-43e6-b600-255a9e08a4c7 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:58.233402 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcafca1-b402-43e6-b600-255a9e08a4c7 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:58.233686 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcafca1-b402-43e6-b600-255a9e08a4c7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:58.244051 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcafca1-b402-43e6-b600-255a9e08a4c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:41:58.249203 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application [None req-4dcafca1-b402-43e6-b600-255a9e08a4c7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 21:41:58.249203 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:41:58.249203 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:41:58.249203 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:41:58.249203 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:41:58.249203 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:41:58.249203 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:41:58.249203 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:41:58.249203 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:41:58.249203 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:41:58.249203 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:41:58.249203 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:41:58.249203 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:41:58.249203 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:41:58.249203 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:41:58.249203 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:41:58.250299 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:41:58.250299 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:41:58.250299 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:41:58.250299 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:41:58.250299 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:41:58.250299 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:41:58.250299 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:41:58.250299 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:41:58.250299 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:41:58.250299 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:41:58.250299 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:41:58.250299 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application with Lock( Aug 18 21:41:58.250299 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:41:58.250299 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:41:58.250299 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:41:58.250299 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:41:58.251261 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:41:58.251261 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:41:58.251261 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:41:58.251261 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:41:58.251261 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:41:58.251261 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:41:58.251261 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:41:58.251261 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:41:58.251261 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:41:58.251261 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:41:58.251261 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 21:41:58.251261 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:41:58.251261 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 283/572] 10.222.0.27 () {56 vars in 1102 bytes} [Thu Aug 18 21:41:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:41:58.251948 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcafca1-b402-43e6-b600-255a9e08a4c7 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:58.269866 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6a1c2f-fe17-4972-af8d-ed99d9c903fa None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:58.283063 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:58.304665 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a1af83-8f11-4460-bdde-b4167ee9a064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:58.305292 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a1af83-8f11-4460-bdde-b4167ee9a064 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:58.305565 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a1af83-8f11-4460-bdde-b4167ee9a064 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:58.305835 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a1af83-8f11-4460-bdde-b4167ee9a064 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:58.316126 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a1af83-8f11-4460-bdde-b4167ee9a064 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:58.317802 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a1af83-8f11-4460-bdde-b4167ee9a064 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:58.332278 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application [None req-34a1af83-8f11-4460-bdde-b4167ee9a064 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:41:58.332278 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:41:58.332278 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:41:58.332278 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:41:58.332278 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:41:58.332278 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:41:58.332278 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:41:58.332278 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:41:58.332278 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:41:58.332278 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:41:58.332278 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:41:58.332278 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:41:58.332278 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 21:41:58.332278 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 21:41:58.332278 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 21:41:58.332278 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 21:41:58.333250 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:41:58.333250 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:41:58.333250 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:41:58.333250 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:41:58.333250 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:41:58.333250 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:41:58.333250 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:41:58.333250 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application with Lock( Aug 18 21:41:58.333250 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:41:58.333250 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:41:58.333250 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:41:58.333250 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:41:58.333250 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:41:58.333250 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:41:58.333250 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:41:58.333250 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:41:58.333250 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 21:41:58.334137 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 21:41:58.334137 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:41:58.334137 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:41:58.334137 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 290/573] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 18 21:41:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:41:58.334137 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a1af83-8f11-4460-bdde-b4167ee9a064 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:58.355756 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcafca1-b402-43e6-b600-255a9e08a4c7 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:58.388977 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bb23d1-cd0e-4b4e-ad2e-b836b4004dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:58.389590 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bb23d1-cd0e-4b4e-ad2e-b836b4004dec None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:58.389869 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bb23d1-cd0e-4b4e-ad2e-b836b4004dec None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:58.390381 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bb23d1-cd0e-4b4e-ad2e-b836b4004dec None admin] PATH_INFO: `/v3/projects/service` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:58.393665 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:58.398024 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bb23d1-cd0e-4b4e-ad2e-b836b4004dec None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:58.399451 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bb23d1-cd0e-4b4e-ad2e-b836b4004dec None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:58.410868 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application [None req-c3bb23d1-cd0e-4b4e-ad2e-b836b4004dec None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 21:41:58.410868 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:41:58.410868 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:41:58.410868 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:41:58.410868 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:41:58.410868 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:41:58.410868 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:41:58.410868 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:41:58.410868 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:41:58.410868 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:41:58.410868 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:41:58.410868 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:41:58.410868 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 21:41:58.410868 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 21:41:58.410868 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 21:41:58.411930 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 21:41:58.411930 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:41:58.411930 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:41:58.411930 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:41:58.411930 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:41:58.411930 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:41:58.411930 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:41:58.411930 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:41:58.411930 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application with Lock( Aug 18 21:41:58.411930 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:41:58.411930 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:41:58.411930 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:41:58.411930 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:41:58.411930 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:41:58.411930 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:41:58.411930 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:41:58.411930 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:41:58.412857 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 21:41:58.412857 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 21:41:58.412857 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 21:41:58.412857 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 21:41:58.412857 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 21:41:58.412857 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 21:41:58.412857 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 21:41:58.412857 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:41:58.412857 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 284/574] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Aug 18 21:41:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:41:58.412857 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bb23d1-cd0e-4b4e-ad2e-b836b4004dec None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:58.440066 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a1af83-8f11-4460-bdde-b4167ee9a064 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:58.473804 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941184fe-2737-40a4-ab07-228a691d0bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:58.474425 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941184fe-2737-40a4-ab07-228a691d0bdb None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:58.474701 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941184fe-2737-40a4-ab07-228a691d0bdb None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:58.474975 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941184fe-2737-40a4-ab07-228a691d0bdb None admin] PATH_INFO: `/v3/roles/service` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:58.487582 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941184fe-2737-40a4-ab07-228a691d0bdb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:41:58.492642 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application [None req-941184fe-2737-40a4-ab07-228a691d0bdb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 21:41:58.492642 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:41:58.492642 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:41:58.492642 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:41:58.492642 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:41:58.492642 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:41:58.492642 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:41:58.492642 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:41:58.492642 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:41:58.492642 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:41:58.492642 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:41:58.492642 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:41:58.492642 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:41:58.492642 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:41:58.492642 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:41:58.492642 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:41:58.493566 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:41:58.493566 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:41:58.493566 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:41:58.493566 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:41:58.493566 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:41:58.493566 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:41:58.493566 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:41:58.493566 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:41:58.493566 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:41:58.493566 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:41:58.493566 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:41:58.493566 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application with Lock( Aug 18 21:41:58.493566 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:41:58.493566 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:41:58.493566 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:41:58.493566 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:41:58.494980 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:41:58.494980 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:41:58.494980 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:41:58.494980 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:41:58.494980 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:41:58.494980 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:41:58.494980 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:41:58.494980 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:41:58.494980 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:41:58.494980 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:41:58.494980 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 21:41:58.494980 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:41:58.494980 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 291/575] 10.222.0.27 () {56 vars in 1102 bytes} [Thu Aug 18 21:41:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:41:58.494980 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941184fe-2737-40a4-ab07-228a691d0bdb None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:58.514671 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bb23d1-cd0e-4b4e-ad2e-b836b4004dec None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:58.519449 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:58.551948 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b1cab5-3e1a-4778-b0ab-52d2d388d87a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:58.552547 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b1cab5-3e1a-4778-b0ab-52d2d388d87a None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:58.552849 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b1cab5-3e1a-4778-b0ab-52d2d388d87a None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:58.553118 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b1cab5-3e1a-4778-b0ab-52d2d388d87a None admin] PATH_INFO: `/v3/users` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:58.553839 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b1cab5-3e1a-4778-b0ab-52d2d388d87a None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:41:58.554137 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b1cab5-3e1a-4778-b0ab-52d2d388d87a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:58.555572 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b1cab5-3e1a-4778-b0ab-52d2d388d87a None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:58.573114 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 285/576] 10.222.0.27 () {56 vars in 1137 bytes} [Thu Aug 18 21:41:58 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:58.573925 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b1cab5-3e1a-4778-b0ab-52d2d388d87a None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:58.602325 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941184fe-2737-40a4-ab07-228a691d0bdb None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:58.628868 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:58.637030 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e8af41-3953-43d8-ab1b-18e3b27e0288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:58.637657 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e8af41-3953-43d8-ab1b-18e3b27e0288 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:58.637932 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e8af41-3953-43d8-ab1b-18e3b27e0288 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:58.638196 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e8af41-3953-43d8-ab1b-18e3b27e0288 None admin] PATH_INFO: `/v3/roles` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:58.638843 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e8af41-3953-43d8-ab1b-18e3b27e0288 None admin] RBAC: Adding query filter params (name=service) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:41:58.639138 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e8af41-3953-43d8-ab1b-18e3b27e0288 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:58.641555 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e8af41-3953-43d8-ab1b-18e3b27e0288 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:58.649697 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 292/577] 10.222.0.27 () {56 vars in 1103 bytes} [Thu Aug 18 21:41:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:58.650486 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e8af41-3953-43d8-ab1b-18e3b27e0288 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:58.676524 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b1cab5-3e1a-4778-b0ab-52d2d388d87a None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:58.710592 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af72636-0c9f-42b7-991d-0f5037c6f95e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:58.711195 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af72636-0c9f-42b7-991d-0f5037c6f95e None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:58.711475 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af72636-0c9f-42b7-991d-0f5037c6f95e None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:58.711750 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af72636-0c9f-42b7-991d-0f5037c6f95e None admin] PATH_INFO: `/v3/domains` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:58.712394 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af72636-0c9f-42b7-991d-0f5037c6f95e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:41:58.712729 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af72636-0c9f-42b7-991d-0f5037c6f95e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:58.714106 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af72636-0c9f-42b7-991d-0f5037c6f95e None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:58.725106 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 286/578] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 18 21:41:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:58.725918 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af72636-0c9f-42b7-991d-0f5037c6f95e None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:58.740918 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:58.760226 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e8af41-3953-43d8-ab1b-18e3b27e0288 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:58.795396 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93677521-2677-4dcf-8e3c-d0d744f863d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:58.796000 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93677521-2677-4dcf-8e3c-d0d744f863d7 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:58.796280 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93677521-2677-4dcf-8e3c-d0d744f863d7 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:58.796552 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93677521-2677-4dcf-8e3c-d0d744f863d7 None admin] PATH_INFO: `/v3/projects` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:58.797636 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93677521-2677-4dcf-8e3c-d0d744f863d7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:41:58.797945 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93677521-2677-4dcf-8e3c-d0d744f863d7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:58.799353 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93677521-2677-4dcf-8e3c-d0d744f863d7 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:58.811275 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 293/579] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Aug 18 21:41:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:58.812122 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93677521-2677-4dcf-8e3c-d0d744f863d7 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:58.826848 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af72636-0c9f-42b7-991d-0f5037c6f95e None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:58.840939 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:58.861043 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3585bd-d916-4dcb-9268-e8af61fc4abe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:58.861664 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3585bd-d916-4dcb-9268-e8af61fc4abe None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:58.862147 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3585bd-d916-4dcb-9268-e8af61fc4abe None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:58.862417 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3585bd-d916-4dcb-9268-e8af61fc4abe None admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:58.863078 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3585bd-d916-4dcb-9268-e8af61fc4abe None admin] RBAC: Adding query filter params (name=service) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:41:58.863380 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3585bd-d916-4dcb-9268-e8af61fc4abe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:58.864803 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3585bd-d916-4dcb-9268-e8af61fc4abe None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:58.872765 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 287/580] 10.222.0.27 () {56 vars in 1103 bytes} [Thu Aug 18 21:41:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:58.873569 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3585bd-d916-4dcb-9268-e8af61fc4abe None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:58.940809 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93677521-2677-4dcf-8e3c-d0d744f863d7 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:58.976353 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3585bd-d916-4dcb-9268-e8af61fc4abe None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:58.984250 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad30699-85f1-40f8-97ea-7463c56a166e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:58.984935 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad30699-85f1-40f8-97ea-7463c56a166e None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:58.985215 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad30699-85f1-40f8-97ea-7463c56a166e None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:58.985489 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad30699-85f1-40f8-97ea-7463c56a166e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:58.996095 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad30699-85f1-40f8-97ea-7463c56a166e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:58.997496 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad30699-85f1-40f8-97ea-7463c56a166e None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:59.005238 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:59.013055 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d2ad8f-ae9c-4693-852b-a5c6f0ccb896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:59.013055 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d2ad8f-ae9c-4693-852b-a5c6f0ccb896 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:59.013055 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d2ad8f-ae9c-4693-852b-a5c6f0ccb896 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:59.013055 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d2ad8f-ae9c-4693-852b-a5c6f0ccb896 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:59.013505 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application [None req-1ad30699-85f1-40f8-97ea-7463c56a166e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:41:59.013505 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:41:59.013505 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:41:59.013505 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:41:59.013505 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:41:59.013505 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:41:59.013505 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:41:59.013505 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:41:59.013505 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:41:59.013505 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:41:59.013505 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:41:59.013505 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:41:59.013505 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 21:41:59.013505 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 21:41:59.013505 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 21:41:59.013505 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 21:41:59.014336 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:41:59.014336 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:41:59.014336 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:41:59.014336 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:41:59.014336 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:41:59.014336 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:41:59.014336 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:41:59.014336 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application with Lock( Aug 18 21:41:59.014336 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:41:59.014336 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:41:59.014336 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:41:59.014336 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:41:59.014336 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:41:59.014336 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:41:59.014336 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:41:59.014336 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:41:59.014336 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 21:41:59.016375 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 21:41:59.016375 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:41:59.016375 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:41:59.016375 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 294/581] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 18 21:41:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:41:59.016375 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad30699-85f1-40f8-97ea-7463c56a166e None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:59.027877 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d2ad8f-ae9c-4693-852b-a5c6f0ccb896 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:59.029421 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d2ad8f-ae9c-4693-852b-a5c6f0ccb896 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:59.046267 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application [None req-38d2ad8f-ae9c-4693-852b-a5c6f0ccb896 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:41:59.046267 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:41:59.046267 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:41:59.046267 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:41:59.046267 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:41:59.046267 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:41:59.046267 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:41:59.046267 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:41:59.046267 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:41:59.046267 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:41:59.046267 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:41:59.046267 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:41:59.046267 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 21:41:59.046267 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 21:41:59.046267 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 21:41:59.046267 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 21:41:59.048800 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:41:59.048800 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:41:59.048800 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:41:59.048800 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:41:59.048800 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:41:59.048800 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:41:59.048800 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:41:59.048800 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application with Lock( Aug 18 21:41:59.048800 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:41:59.048800 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:41:59.048800 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:41:59.048800 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:41:59.048800 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:41:59.048800 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:41:59.048800 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:41:59.048800 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:41:59.048800 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 21:41:59.049932 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 21:41:59.049932 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:41:59.049932 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:41:59.049932 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 288/582] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 18 21:41:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:41:59.049932 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d2ad8f-ae9c-4693-852b-a5c6f0ccb896 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:59.077992 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:59.133908 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad30699-85f1-40f8-97ea-7463c56a166e None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:59.161887 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d2ad8f-ae9c-4693-852b-a5c6f0ccb896 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:59.170859 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29b487a-844f-4d96-aced-40f8f38c709d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:59.171496 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29b487a-844f-4d96-aced-40f8f38c709d None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:59.171771 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29b487a-844f-4d96-aced-40f8f38c709d None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:59.172720 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29b487a-844f-4d96-aced-40f8f38c709d None admin] PATH_INFO: `/v3/projects/service` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:59.179704 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29b487a-844f-4d96-aced-40f8f38c709d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:59.181197 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29b487a-844f-4d96-aced-40f8f38c709d None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:59.193530 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application [None req-e29b487a-844f-4d96-aced-40f8f38c709d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 21:41:59.193530 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:41:59.193530 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:41:59.193530 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:41:59.193530 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:41:59.193530 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:41:59.193530 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:41:59.193530 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:41:59.193530 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:41:59.193530 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:41:59.193530 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:41:59.193530 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:41:59.193530 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 21:41:59.193530 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 21:41:59.193530 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 21:41:59.194684 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 21:41:59.194684 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:41:59.194684 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:41:59.194684 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:41:59.194684 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:41:59.194684 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:41:59.194684 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:41:59.194684 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:41:59.194684 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application with Lock( Aug 18 21:41:59.194684 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:41:59.194684 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:41:59.194684 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:41:59.194684 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:41:59.194684 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:41:59.194684 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:41:59.194684 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:41:59.194684 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:41:59.196081 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 21:41:59.196081 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 21:41:59.196081 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 21:41:59.196081 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 21:41:59.196081 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 21:41:59.196081 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 21:41:59.196081 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 21:41:59.196081 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:41:59.196081 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 295/583] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Aug 18 21:41:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:41:59.196081 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29b487a-844f-4d96-aced-40f8f38c709d None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:59.209497 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6128451c-45d2-440b-ae9d-276190bde40e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:59.210144 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6128451c-45d2-440b-ae9d-276190bde40e None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:59.210394 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6128451c-45d2-440b-ae9d-276190bde40e None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:59.210671 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6128451c-45d2-440b-ae9d-276190bde40e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:59.211407 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6128451c-45d2-440b-ae9d-276190bde40e None admin] RBAC: Adding query filter params (role.id=30d8ac11e30e4b1d83940485e98d147c, scope.project.id=4b54801b90484d689034f838f85fc0a4, user.id=9ae59e6dca304c949942ae769acedc74) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:41:59.211979 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6128451c-45d2-440b-ae9d-276190bde40e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:59.213275 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6128451c-45d2-440b-ae9d-276190bde40e None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:59.222244 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 289/584] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Aug 18 21:41:59 2022] GET /identity/v3/role_assignments?user.id=9ae59e6dca304c949942ae769acedc74&scope.project.id=4b54801b90484d689034f838f85fc0a4&role.id=30d8ac11e30e4b1d83940485e98d147c => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:59.222868 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6128451c-45d2-440b-ae9d-276190bde40e None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:59.271267 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:59.326552 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29b487a-844f-4d96-aced-40f8f38c709d None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:59.355674 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:59.367691 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6128451c-45d2-440b-ae9d-276190bde40e None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:59.371581 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3515b72e-2678-4991-872a-8a28b3d141d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:59.372229 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3515b72e-2678-4991-872a-8a28b3d141d4 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:59.372511 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3515b72e-2678-4991-872a-8a28b3d141d4 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:59.372824 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3515b72e-2678-4991-872a-8a28b3d141d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:59.386922 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3515b72e-2678-4991-872a-8a28b3d141d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:59.389978 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3515b72e-2678-4991-872a-8a28b3d141d4 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:59.407971 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application [None req-3515b72e-2678-4991-872a-8a28b3d141d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:41:59.407971 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:41:59.407971 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:41:59.407971 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:41:59.407971 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:41:59.407971 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:41:59.407971 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:41:59.407971 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:41:59.407971 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:41:59.407971 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:41:59.407971 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:41:59.407971 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:41:59.407971 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 21:41:59.407971 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 21:41:59.407971 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 21:41:59.407971 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 21:41:59.409625 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:41:59.409625 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:41:59.409625 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:41:59.409625 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:41:59.409625 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:41:59.409625 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:41:59.409625 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:41:59.409625 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application with Lock( Aug 18 21:41:59.409625 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:41:59.409625 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:41:59.409625 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:41:59.409625 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:41:59.409625 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:41:59.409625 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:41:59.409625 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:41:59.409625 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:41:59.409625 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 21:41:59.410694 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 21:41:59.410694 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:41:59.410694 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:41:59.413975 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 296/585] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 18 21:41:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:41:59.416400 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb85314-7716-43f0-9d47-eae12aec3f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:59.416536 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3515b72e-2678-4991-872a-8a28b3d141d4 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:59.417155 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb85314-7716-43f0-9d47-eae12aec3f81 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:59.417619 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb85314-7716-43f0-9d47-eae12aec3f81 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:59.418124 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb85314-7716-43f0-9d47-eae12aec3f81 None admin] PATH_INFO: `/v3/domains` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:59.418861 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb85314-7716-43f0-9d47-eae12aec3f81 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:41:59.419265 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb85314-7716-43f0-9d47-eae12aec3f81 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:59.424640 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb85314-7716-43f0-9d47-eae12aec3f81 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:59.437150 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 290/586] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 18 21:41:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:59.438892 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb85314-7716-43f0-9d47-eae12aec3f81 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:59.528133 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3515b72e-2678-4991-872a-8a28b3d141d4 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:59.542428 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:59.557821 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb85314-7716-43f0-9d47-eae12aec3f81 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:59.567942 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf6198a-d9d4-4961-ac00-b2f656ca01b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:59.568561 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf6198a-d9d4-4961-ac00-b2f656ca01b5 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:59.568875 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf6198a-d9d4-4961-ac00-b2f656ca01b5 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:59.569139 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf6198a-d9d4-4961-ac00-b2f656ca01b5 None admin] PATH_INFO: `/v3/domains` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:59.569790 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf6198a-d9d4-4961-ac00-b2f656ca01b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:41:59.570300 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf6198a-d9d4-4961-ac00-b2f656ca01b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:59.571679 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf6198a-d9d4-4961-ac00-b2f656ca01b5 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:59.588528 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 297/587] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 18 21:41:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:59.588528 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf6198a-d9d4-4961-ac00-b2f656ca01b5 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:59.603858 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74337e9d-786b-4649-82ee-0bddf5aef813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:59.604557 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74337e9d-786b-4649-82ee-0bddf5aef813 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:59.604932 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74337e9d-786b-4649-82ee-0bddf5aef813 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:59.605233 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74337e9d-786b-4649-82ee-0bddf5aef813 None admin] PATH_INFO: `/v3/projects` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:59.605904 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74337e9d-786b-4649-82ee-0bddf5aef813 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:41:59.606209 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74337e9d-786b-4649-82ee-0bddf5aef813 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:59.607654 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74337e9d-786b-4649-82ee-0bddf5aef813 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:59.626439 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 291/588] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Aug 18 21:41:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:59.626439 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74337e9d-786b-4649-82ee-0bddf5aef813 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:59.643230 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:59.711556 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf6198a-d9d4-4961-ac00-b2f656ca01b5 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:59.739363 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74337e9d-786b-4649-82ee-0bddf5aef813 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:59.748908 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc508d7-999c-4b94-9ad3-58e778f3a0fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:59.749409 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc508d7-999c-4b94-9ad3-58e778f3a0fb None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:59.751850 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc508d7-999c-4b94-9ad3-58e778f3a0fb None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:59.751850 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc508d7-999c-4b94-9ad3-58e778f3a0fb None admin] PATH_INFO: `/v3/domains` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:59.751850 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc508d7-999c-4b94-9ad3-58e778f3a0fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:41:59.751850 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc508d7-999c-4b94-9ad3-58e778f3a0fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:59.752960 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc508d7-999c-4b94-9ad3-58e778f3a0fb None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:59.766115 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 298/589] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 18 21:41:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:41:59.766972 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc508d7-999c-4b94-9ad3-58e778f3a0fb None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:59.781240 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f8ef44-563c-43e3-bee5-77e027a9c570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:59.781917 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f8ef44-563c-43e3-bee5-77e027a9c570 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:59.782274 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f8ef44-563c-43e3-bee5-77e027a9c570 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:59.782628 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f8ef44-563c-43e3-bee5-77e027a9c570 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:59.789692 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f8ef44-563c-43e3-bee5-77e027a9c570 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:59.791159 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f8ef44-563c-43e3-bee5-77e027a9c570 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:59.803216 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application [None req-c4f8ef44-563c-43e3-bee5-77e027a9c570 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 21:41:59.803216 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:41:59.803216 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:41:59.803216 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:41:59.803216 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:41:59.803216 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:41:59.803216 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:41:59.803216 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:41:59.803216 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:41:59.803216 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:41:59.803216 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:41:59.803216 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:41:59.803216 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 21:41:59.803216 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 21:41:59.803216 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 21:41:59.804291 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 21:41:59.804291 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:41:59.804291 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:41:59.804291 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:41:59.804291 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:41:59.804291 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:41:59.804291 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:41:59.804291 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:41:59.804291 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application with Lock( Aug 18 21:41:59.804291 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:41:59.804291 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:41:59.804291 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:41:59.804291 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:41:59.804291 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:41:59.804291 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:41:59.804291 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:41:59.804291 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:41:59.805231 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 21:41:59.805231 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 21:41:59.805231 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 21:41:59.805231 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 21:41:59.805231 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 21:41:59.805231 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 21:41:59.805231 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 21:41:59.805231 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:41:59.805231 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 292/590] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Aug 18 21:41:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:41:59.805231 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f8ef44-563c-43e3-bee5-77e027a9c570 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:59.807622 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:59.879126 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc508d7-999c-4b94-9ad3-58e778f3a0fb None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:59.883219 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:41:59.912973 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acfb22b-9afc-4128-a9d6-1b5f842c4d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:59.913739 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acfb22b-9afc-4128-a9d6-1b5f842c4d22 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:59.914130 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acfb22b-9afc-4128-a9d6-1b5f842c4d22 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:59.914224 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f8ef44-563c-43e3-bee5-77e027a9c570 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:41:59.914564 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acfb22b-9afc-4128-a9d6-1b5f842c4d22 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:59.923550 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acfb22b-9afc-4128-a9d6-1b5f842c4d22 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:59.925153 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acfb22b-9afc-4128-a9d6-1b5f842c4d22 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:41:59.936196 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application [None req-5acfb22b-9afc-4128-a9d6-1b5f842c4d22 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 18 21:41:59.936196 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:41:59.936196 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:41:59.936196 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:41:59.936196 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:41:59.936196 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:41:59.936196 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:41:59.936196 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:41:59.936196 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:41:59.936196 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:41:59.936196 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:41:59.936196 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:41:59.936196 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 21:41:59.936196 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 21:41:59.936196 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 21:41:59.936196 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 21:41:59.937394 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:41:59.937394 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:41:59.937394 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 21:41:59.937394 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 21:41:59.937394 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 21:41:59.937394 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 21:41:59.937394 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:41:59.937394 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:41:59.937394 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:41:59.937394 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:41:59.937394 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:41:59.937394 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application with Lock( Aug 18 21:41:59.937394 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:41:59.937394 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:41:59.937394 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:41:59.937394 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:41:59.937394 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:41:59.937394 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:41:59.938939 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:41:59.938939 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:41:59.938939 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 21:41:59.938939 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 21:41:59.938939 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 21:41:59.938939 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 21:41:59.938939 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 21:41:59.938939 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 21:41:59.938939 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 18 21:41:59.938939 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:41:59.938939 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 299/591] 10.222.0.27 () {56 vars in 1102 bytes} [Thu Aug 18 21:41:59 2022] GET /identity/v3/users/neutron => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:41:59.938939 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acfb22b-9afc-4128-a9d6-1b5f842c4d22 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:41:59.954996 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cc2950-3e53-4a3b-9002-0f4cea754fe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:41:59.955652 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cc2950-3e53-4a3b-9002-0f4cea754fe4 None admin] REQUEST_METHOD: `PUT` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:41:59.955926 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cc2950-3e53-4a3b-9002-0f4cea754fe4 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:41:59.956196 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cc2950-3e53-4a3b-9002-0f4cea754fe4 None admin] PATH_INFO: `/v3/projects/4b54801b90484d689034f838f85fc0a4/users/a39cd50340184779ac589bbcb7cac9aa/roles/30d8ac11e30e4b1d83940485e98d147c` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:41:59.970622 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cc2950-3e53-4a3b-9002-0f4cea754fe4 None admin] RBAC: Authorizing `identity:create_grant(project_id=4b54801b90484d689034f838f85fc0a4, user_id=a39cd50340184779ac589bbcb7cac9aa, role_id=30d8ac11e30e4b1d83940485e98d147c)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:41:59.972059 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cc2950-3e53-4a3b-9002-0f4cea754fe4 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:00.033951 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:00.043250 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acfb22b-9afc-4128-a9d6-1b5f842c4d22 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:00.072567 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 293/592] 10.222.0.27 () {58 vars in 1439 bytes} [Thu Aug 18 21:41:59 2022] PUT /identity/v3/projects/4b54801b90484d689034f838f85fc0a4/users/a39cd50340184779ac589bbcb7cac9aa/roles/30d8ac11e30e4b1d83940485e98d147c => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:42:00.073899 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cc2950-3e53-4a3b-9002-0f4cea754fe4 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:00.090764 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1d0f69-f28b-455f-b2f1-d14ac0898004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:00.091426 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1d0f69-f28b-455f-b2f1-d14ac0898004 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:00.091774 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1d0f69-f28b-455f-b2f1-d14ac0898004 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:00.091943 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1d0f69-f28b-455f-b2f1-d14ac0898004 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:00.101880 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1d0f69-f28b-455f-b2f1-d14ac0898004 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:00.103358 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1d0f69-f28b-455f-b2f1-d14ac0898004 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:00.117276 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application [None req-7e1d0f69-f28b-455f-b2f1-d14ac0898004 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 18 21:42:00.117276 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:00.117276 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:42:00.117276 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:42:00.117276 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:42:00.117276 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:42:00.117276 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:42:00.117276 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:42:00.117276 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:42:00.117276 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:42:00.117276 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:42:00.117276 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:42:00.117276 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 21:42:00.117276 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 21:42:00.117276 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 21:42:00.117276 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 21:42:00.118493 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:42:00.118493 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:42:00.118493 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 21:42:00.118493 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 21:42:00.118493 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 21:42:00.118493 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 21:42:00.118493 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:42:00.118493 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:42:00.118493 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:42:00.118493 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:42:00.118493 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:42:00.118493 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application with Lock( Aug 18 21:42:00.118493 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:42:00.118493 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:42:00.118493 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:42:00.118493 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:42:00.118493 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:42:00.118493 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:42:00.119704 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:42:00.119704 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:42:00.119704 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 21:42:00.119704 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 21:42:00.119704 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 21:42:00.119704 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 21:42:00.119704 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 21:42:00.119704 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 21:42:00.119704 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 18 21:42:00.119704 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:42:00.123294 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 300/593] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Aug 18 21:41:59 2022] GET /identity/v3/users/cinder => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:42:00.124207 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1d0f69-f28b-455f-b2f1-d14ac0898004 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:00.253782 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1d0f69-f28b-455f-b2f1-d14ac0898004 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:00.257313 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cc2950-3e53-4a3b-9002-0f4cea754fe4 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:00.285799 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:00.302817 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5afcc6b-1bc1-4796-9969-b5d43016b975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:00.302817 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5afcc6b-1bc1-4796-9969-b5d43016b975 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:00.302817 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5afcc6b-1bc1-4796-9969-b5d43016b975 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:00.302817 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5afcc6b-1bc1-4796-9969-b5d43016b975 None admin] PATH_INFO: `/v3/users` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:00.303491 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5afcc6b-1bc1-4796-9969-b5d43016b975 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:00.303491 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5afcc6b-1bc1-4796-9969-b5d43016b975 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:00.303491 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5afcc6b-1bc1-4796-9969-b5d43016b975 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:00.304565 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32eaa499-29d0-40dc-95e5-1e624aa41a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:00.305450 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eaa499-29d0-40dc-95e5-1e624aa41a4e None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:00.305864 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eaa499-29d0-40dc-95e5-1e624aa41a4e None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:00.306308 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eaa499-29d0-40dc-95e5-1e624aa41a4e None admin] PATH_INFO: `/v3/projects` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:00.307136 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32eaa499-29d0-40dc-95e5-1e624aa41a4e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:00.307638 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32eaa499-29d0-40dc-95e5-1e624aa41a4e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:00.309249 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32eaa499-29d0-40dc-95e5-1e624aa41a4e None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:00.321600 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 301/594] 10.222.0.27 () {56 vars in 1139 bytes} [Thu Aug 18 21:42:00 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:42:00.322451 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5afcc6b-1bc1-4796-9969-b5d43016b975 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:00.323428 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 294/595] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Aug 18 21:42:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:42:00.329597 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32eaa499-29d0-40dc-95e5-1e624aa41a4e None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:00.333739 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:00.428887 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5afcc6b-1bc1-4796-9969-b5d43016b975 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:00.442920 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32eaa499-29d0-40dc-95e5-1e624aa41a4e None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:00.466349 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42bf664-cfc4-4f58-9fcb-145b005a51a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:00.467163 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42bf664-cfc4-4f58-9fcb-145b005a51a0 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:00.467542 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42bf664-cfc4-4f58-9fcb-145b005a51a0 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:00.467951 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42bf664-cfc4-4f58-9fcb-145b005a51a0 None admin] PATH_INFO: `/v3/users` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:00.469698 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42bf664-cfc4-4f58-9fcb-145b005a51a0 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:00.469819 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42bf664-cfc4-4f58-9fcb-145b005a51a0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:00.471322 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42bf664-cfc4-4f58-9fcb-145b005a51a0 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:00.480940 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c3e3bf-c149-4c25-8c6f-6df5761e82a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:00.481764 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c3e3bf-c149-4c25-8c6f-6df5761e82a5 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:00.482204 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c3e3bf-c149-4c25-8c6f-6df5761e82a5 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:00.482601 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c3e3bf-c149-4c25-8c6f-6df5761e82a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:00.493891 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 302/596] 10.222.0.27 () {56 vars in 1137 bytes} [Thu Aug 18 21:42:00 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:42:00.493891 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42bf664-cfc4-4f58-9fcb-145b005a51a0 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:00.499179 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c3e3bf-c149-4c25-8c6f-6df5761e82a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:00.501204 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c3e3bf-c149-4c25-8c6f-6df5761e82a5 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:00.517440 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application [None req-12c3e3bf-c149-4c25-8c6f-6df5761e82a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:42:00.517440 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:00.517440 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:42:00.517440 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:42:00.517440 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:42:00.517440 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:42:00.517440 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:42:00.517440 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:42:00.517440 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:42:00.517440 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:42:00.517440 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:42:00.517440 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:42:00.517440 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 21:42:00.517440 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 21:42:00.517440 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 21:42:00.517440 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 21:42:00.518552 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:42:00.518552 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:42:00.518552 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:42:00.518552 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:42:00.518552 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:42:00.518552 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:42:00.518552 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:42:00.518552 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application with Lock( Aug 18 21:42:00.518552 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:42:00.518552 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:42:00.518552 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:42:00.518552 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:42:00.518552 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:42:00.518552 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:42:00.518552 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:42:00.518552 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:42:00.518552 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 21:42:00.519644 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 21:42:00.519644 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:42:00.519644 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:42:00.521542 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 295/597] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 18 21:42:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:42:00.522462 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c3e3bf-c149-4c25-8c6f-6df5761e82a5 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:00.561069 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:00.561551 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:00.608170 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42bf664-cfc4-4f58-9fcb-145b005a51a0 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:00.634037 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c3e3bf-c149-4c25-8c6f-6df5761e82a5 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:00.655505 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465b28e4-1811-472a-a89b-7dae5c67f04f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:00.656739 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465b28e4-1811-472a-a89b-7dae5c67f04f None admin] REQUEST_METHOD: `PUT` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:00.657026 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465b28e4-1811-472a-a89b-7dae5c67f04f None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:00.657305 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465b28e4-1811-472a-a89b-7dae5c67f04f None admin] PATH_INFO: `/v3/projects/4b54801b90484d689034f838f85fc0a4/users/85dfef6a910547da9706d294e7d40fd0/roles/30d8ac11e30e4b1d83940485e98d147c` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:00.673052 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad4cfb7-de83-452e-91de-40c8fc6571c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:00.673907 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad4cfb7-de83-452e-91de-40c8fc6571c6 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:00.674353 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad4cfb7-de83-452e-91de-40c8fc6571c6 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:00.674764 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad4cfb7-de83-452e-91de-40c8fc6571c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:00.675671 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465b28e4-1811-472a-a89b-7dae5c67f04f None admin] RBAC: Authorizing `identity:create_grant(project_id=4b54801b90484d689034f838f85fc0a4, user_id=85dfef6a910547da9706d294e7d40fd0, role_id=30d8ac11e30e4b1d83940485e98d147c)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:00.677530 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465b28e4-1811-472a-a89b-7dae5c67f04f None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:00.687207 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad4cfb7-de83-452e-91de-40c8fc6571c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:00.689804 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad4cfb7-de83-452e-91de-40c8fc6571c6 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:00.704929 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application [None req-7ad4cfb7-de83-452e-91de-40c8fc6571c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:42:00.704929 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:00.704929 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:42:00.704929 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:42:00.704929 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:42:00.704929 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:42:00.704929 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:42:00.704929 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:42:00.704929 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:42:00.704929 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:42:00.704929 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:42:00.704929 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:42:00.704929 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 21:42:00.704929 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 21:42:00.704929 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 21:42:00.704929 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 21:42:00.706082 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:42:00.706082 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:42:00.706082 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:42:00.706082 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:42:00.706082 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:42:00.706082 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:42:00.706082 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:42:00.706082 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application with Lock( Aug 18 21:42:00.706082 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:42:00.706082 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:42:00.706082 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:42:00.706082 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:42:00.706082 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:42:00.706082 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:42:00.706082 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:42:00.706082 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:42:00.706082 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 21:42:00.707195 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 21:42:00.707195 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:42:00.707195 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:42:00.712021 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 296/598] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 18 21:42:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:42:00.712021 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad4cfb7-de83-452e-91de-40c8fc6571c6 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:00.769449 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 303/599] 10.222.0.27 () {58 vars in 1439 bytes} [Thu Aug 18 21:42:00 2022] PUT /identity/v3/projects/4b54801b90484d689034f838f85fc0a4/users/85dfef6a910547da9706d294e7d40fd0/roles/30d8ac11e30e4b1d83940485e98d147c => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:42:00.770696 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465b28e4-1811-472a-a89b-7dae5c67f04f None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:00.812132 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:00.832498 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad4cfb7-de83-452e-91de-40c8fc6571c6 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:00.884076 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecd4b8b-7f59-4dff-9ab7-9dbfec348115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:00.884879 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecd4b8b-7f59-4dff-9ab7-9dbfec348115 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:00.885320 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecd4b8b-7f59-4dff-9ab7-9dbfec348115 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:00.885692 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecd4b8b-7f59-4dff-9ab7-9dbfec348115 None admin] PATH_INFO: `/v3/domains` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:00.886580 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecd4b8b-7f59-4dff-9ab7-9dbfec348115 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:00.886990 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecd4b8b-7f59-4dff-9ab7-9dbfec348115 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:00.888579 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecd4b8b-7f59-4dff-9ab7-9dbfec348115 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:00.902354 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 297/600] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 18 21:42:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:42:00.908665 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecd4b8b-7f59-4dff-9ab7-9dbfec348115 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:00.998916 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465b28e4-1811-472a-a89b-7dae5c67f04f None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:01.032538 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:01.060343 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7b44cb-44fc-42bc-b18a-571431a60def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:01.077783 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7b44cb-44fc-42bc-b18a-571431a60def None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:01.077783 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7b44cb-44fc-42bc-b18a-571431a60def None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:01.078020 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecd4b8b-7f59-4dff-9ab7-9dbfec348115 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:01.078188 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7b44cb-44fc-42bc-b18a-571431a60def None admin] PATH_INFO: `/v3/domains` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:01.078188 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7b44cb-44fc-42bc-b18a-571431a60def None admin] RBAC: Adding query filter params (name=Default) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:01.078188 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7b44cb-44fc-42bc-b18a-571431a60def None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:01.078188 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7b44cb-44fc-42bc-b18a-571431a60def None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:01.084048 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 304/601] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 18 21:42:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:42:01.089947 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7b44cb-44fc-42bc-b18a-571431a60def None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:01.137322 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56539838-31d5-44d9-8a8c-7fbf582a6819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:01.137969 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56539838-31d5-44d9-8a8c-7fbf582a6819 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:01.138249 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56539838-31d5-44d9-8a8c-7fbf582a6819 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:01.138521 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56539838-31d5-44d9-8a8c-7fbf582a6819 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:01.154071 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56539838-31d5-44d9-8a8c-7fbf582a6819 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:01.155201 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56539838-31d5-44d9-8a8c-7fbf582a6819 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:01.176007 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application [None req-56539838-31d5-44d9-8a8c-7fbf582a6819 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 21:42:01.176007 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:01.176007 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:42:01.176007 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:42:01.176007 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:42:01.176007 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:42:01.176007 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:42:01.176007 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:42:01.176007 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:42:01.176007 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:42:01.176007 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:42:01.176007 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:42:01.176007 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 21:42:01.176007 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 21:42:01.176007 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 21:42:01.177275 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 21:42:01.177275 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:42:01.177275 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:42:01.177275 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:42:01.177275 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:42:01.177275 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:42:01.177275 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:42:01.177275 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:42:01.177275 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application with Lock( Aug 18 21:42:01.177275 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:42:01.177275 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:42:01.177275 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:42:01.177275 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:42:01.177275 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:42:01.177275 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:42:01.177275 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:42:01.177275 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:42:01.178490 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 21:42:01.178490 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 21:42:01.178490 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 21:42:01.178490 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 21:42:01.178490 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 21:42:01.178490 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 21:42:01.178490 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 21:42:01.178490 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:42:01.188627 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 298/602] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Aug 18 21:42:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:42:01.209652 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56539838-31d5-44d9-8a8c-7fbf582a6819 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:01.217789 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7b44cb-44fc-42bc-b18a-571431a60def None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:01.224266 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:01.259557 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5921dbc5-b114-4819-9e1b-24289ceeed40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:01.260201 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5921dbc5-b114-4819-9e1b-24289ceeed40 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:01.260478 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5921dbc5-b114-4819-9e1b-24289ceeed40 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:01.260776 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5921dbc5-b114-4819-9e1b-24289ceeed40 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:01.269639 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5921dbc5-b114-4819-9e1b-24289ceeed40 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:01.271388 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5921dbc5-b114-4819-9e1b-24289ceeed40 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:01.284976 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application [None req-5921dbc5-b114-4819-9e1b-24289ceeed40 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 21:42:01.284976 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:01.284976 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:42:01.284976 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:42:01.284976 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:42:01.284976 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:42:01.284976 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:42:01.284976 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:42:01.284976 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:42:01.284976 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:42:01.284976 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:42:01.284976 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:42:01.284976 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 21:42:01.284976 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 21:42:01.284976 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 21:42:01.285921 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 21:42:01.285921 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:42:01.285921 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:42:01.285921 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:42:01.285921 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:42:01.285921 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:42:01.285921 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:42:01.285921 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:42:01.285921 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application with Lock( Aug 18 21:42:01.285921 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:42:01.285921 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:42:01.285921 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:42:01.285921 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:42:01.285921 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:42:01.285921 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:42:01.285921 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:42:01.285921 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:42:01.286852 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 21:42:01.286852 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 21:42:01.286852 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 21:42:01.286852 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 21:42:01.286852 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 21:42:01.286852 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 21:42:01.286852 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 21:42:01.286852 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:42:01.286852 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 305/603] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Aug 18 21:42:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:42:01.293857 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5921dbc5-b114-4819-9e1b-24289ceeed40 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:01.363336 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:01.402089 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56539838-31d5-44d9-8a8c-7fbf582a6819 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:01.442058 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01305080-019c-4e64-bf7a-c9ab129ab2ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:01.443087 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01305080-019c-4e64-bf7a-c9ab129ab2ab None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:01.443574 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01305080-019c-4e64-bf7a-c9ab129ab2ab None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:01.444069 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01305080-019c-4e64-bf7a-c9ab129ab2ab None admin] PATH_INFO: `/v3/projects` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:01.445009 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01305080-019c-4e64-bf7a-c9ab129ab2ab None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:01.445209 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5921dbc5-b114-4819-9e1b-24289ceeed40 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:01.445701 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01305080-019c-4e64-bf7a-c9ab129ab2ab None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:01.447593 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01305080-019c-4e64-bf7a-c9ab129ab2ab None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:01.461006 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 299/604] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Aug 18 21:42:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:42:01.462697 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea4d6b6-24a3-47fb-b8af-fe4626ebf1db None None] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:01.463203 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea4d6b6-24a3-47fb-b8af-fe4626ebf1db None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:01.463683 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea4d6b6-24a3-47fb-b8af-fe4626ebf1db None None] PATH_INFO: `/` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:01.470163 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 300/605] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:42:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:42:01.471348 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea4d6b6-24a3-47fb-b8af-fe4626ebf1db None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:01.487401 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c48f3cc-7825-49b7-97ad-b93bdb389f8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:01.488016 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c48f3cc-7825-49b7-97ad-b93bdb389f8b None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:01.488300 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c48f3cc-7825-49b7-97ad-b93bdb389f8b None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:01.488577 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c48f3cc-7825-49b7-97ad-b93bdb389f8b None admin] PATH_INFO: `/v3/projects` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:01.489563 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c48f3cc-7825-49b7-97ad-b93bdb389f8b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:01.489876 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c48f3cc-7825-49b7-97ad-b93bdb389f8b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:01.491981 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c48f3cc-7825-49b7-97ad-b93bdb389f8b None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:01.512662 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 306/606] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Aug 18 21:42:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:42:01.514323 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67d1ccc-e648-4fe6-ac8f-7f8dcf7474ad None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:01.514872 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67d1ccc-e648-4fe6-ac8f-7f8dcf7474ad None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:01.516637 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67d1ccc-e648-4fe6-ac8f-7f8dcf7474ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:01.545364 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-b67d1ccc-e648-4fe6-ac8f-7f8dcf7474ad None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:42:01.548025 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-b67d1ccc-e648-4fe6-ac8f-7f8dcf7474ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:42:01.560065 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:01.611094 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea4d6b6-24a3-47fb-b8af-fe4626ebf1db None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:01.630193 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 307/607] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:42:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 21:42:01.631285 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67d1ccc-e648-4fe6-ac8f-7f8dcf7474ad None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:01.664020 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:01.667435 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f68f969-c68b-4716-a3f3-e16d90779d54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:01.668326 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f68f969-c68b-4716-a3f3-e16d90779d54 None admin] REQUEST_METHOD: `PUT` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:01.675179 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f68f969-c68b-4716-a3f3-e16d90779d54 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:01.675179 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f68f969-c68b-4716-a3f3-e16d90779d54 None admin] PATH_INFO: `/v3/projects/4b54801b90484d689034f838f85fc0a4/users/6a937971ad1a4b0c8697c764f214d446/roles/30d8ac11e30e4b1d83940485e98d147c` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:01.697458 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f68f969-c68b-4716-a3f3-e16d90779d54 None admin] RBAC: Authorizing `identity:create_grant(project_id=4b54801b90484d689034f838f85fc0a4, user_id=6a937971ad1a4b0c8697c764f214d446, role_id=30d8ac11e30e4b1d83940485e98d147c)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:01.699059 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f68f969-c68b-4716-a3f3-e16d90779d54 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:01.753564 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67d1ccc-e648-4fe6-ac8f-7f8dcf7474ad None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:01.790208 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd061c99-0ef7-4108-a923-1e8743ff7b89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:01.791164 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd061c99-0ef7-4108-a923-1e8743ff7b89 None admin] REQUEST_METHOD: `PUT` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:01.791596 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd061c99-0ef7-4108-a923-1e8743ff7b89 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:01.792030 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd061c99-0ef7-4108-a923-1e8743ff7b89 None admin] PATH_INFO: `/v3/projects/4b54801b90484d689034f838f85fc0a4/users/22b6a7c36f8a4795a75271b8079821c7/roles/30d8ac11e30e4b1d83940485e98d147c` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:01.807871 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd061c99-0ef7-4108-a923-1e8743ff7b89 None admin] RBAC: Authorizing `identity:create_grant(project_id=4b54801b90484d689034f838f85fc0a4, user_id=22b6a7c36f8a4795a75271b8079821c7, role_id=30d8ac11e30e4b1d83940485e98d147c)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:01.809678 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd061c99-0ef7-4108-a923-1e8743ff7b89 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:01.811467 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 301/608] 10.222.0.27 () {58 vars in 1439 bytes} [Thu Aug 18 21:42:01 2022] PUT /identity/v3/projects/4b54801b90484d689034f838f85fc0a4/users/6a937971ad1a4b0c8697c764f214d446/roles/30d8ac11e30e4b1d83940485e98d147c => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:42:01.900187 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 308/609] 10.222.0.27 () {58 vars in 1439 bytes} [Thu Aug 18 21:42:01 2022] PUT /identity/v3/projects/4b54801b90484d689034f838f85fc0a4/users/22b6a7c36f8a4795a75271b8079821c7/roles/30d8ac11e30e4b1d83940485e98d147c => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:42:01.972980 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f68f969-c68b-4716-a3f3-e16d90779d54 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:02.090649 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f68f969-c68b-4716-a3f3-e16d90779d54 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:02.110183 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:02.132002 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109a2642-1e26-464f-b7ba-f559c429052f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:02.132654 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109a2642-1e26-464f-b7ba-f559c429052f None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:02.132937 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109a2642-1e26-464f-b7ba-f559c429052f None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:02.133212 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109a2642-1e26-464f-b7ba-f559c429052f None admin] PATH_INFO: `/v3/roles/service` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:02.136825 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81472205-3092-4c93-8061-681eb5ef31ea None None] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:02.137256 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81472205-3092-4c93-8061-681eb5ef31ea None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:02.137710 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81472205-3092-4c93-8061-681eb5ef31ea None None] PATH_INFO: `/` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:02.145062 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 309/610] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:42:02 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:42:02.148637 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa6f926-7dcf-41f9-a109-816af152d94f None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:02.148922 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa6f926-7dcf-41f9-a109-816af152d94f None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:02.149185 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa6f926-7dcf-41f9-a109-816af152d94f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:02.165280 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109a2642-1e26-464f-b7ba-f559c429052f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:42:02.170297 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application [None req-109a2642-1e26-464f-b7ba-f559c429052f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 21:42:02.170297 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:02.170297 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:42:02.170297 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:42:02.170297 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:42:02.170297 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:42:02.170297 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:42:02.170297 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:42:02.170297 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:42:02.170297 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:42:02.170297 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:42:02.170297 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:42:02.170297 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:42:02.170297 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:42:02.170297 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:42:02.170297 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:42:02.171294 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:42:02.171294 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:42:02.171294 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:42:02.171294 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:42:02.171294 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:42:02.171294 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:42:02.171294 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:42:02.171294 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:42:02.171294 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:42:02.171294 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:42:02.171294 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:42:02.171294 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application with Lock( Aug 18 21:42:02.171294 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:42:02.171294 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:42:02.171294 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:42:02.171294 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:42:02.172361 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:42:02.172361 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:42:02.172361 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:42:02.172361 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:42:02.172361 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:42:02.172361 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:42:02.172361 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:42:02.172361 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:42:02.172361 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:42:02.172361 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:42:02.172361 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 21:42:02.172361 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:42:02.172361 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 302/611] 10.222.0.27 () {56 vars in 1102 bytes} [Thu Aug 18 21:42:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:42:02.177937 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109a2642-1e26-464f-b7ba-f559c429052f None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:02.178405 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-3fa6f926-7dcf-41f9-a109-816af152d94f None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:42:02.181118 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-3fa6f926-7dcf-41f9-a109-816af152d94f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:42:02.337446 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 310/612] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:42:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 21:42:02.352374 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109a2642-1e26-464f-b7ba-f559c429052f None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:02.406401 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a72509-72df-4cf6-9691-292402b1fa16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:02.407146 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a72509-72df-4cf6-9691-292402b1fa16 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:02.407428 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a72509-72df-4cf6-9691-292402b1fa16 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:02.407703 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a72509-72df-4cf6-9691-292402b1fa16 None admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:02.408372 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a72509-72df-4cf6-9691-292402b1fa16 None admin] RBAC: Adding query filter params (name=service) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:02.408751 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a72509-72df-4cf6-9691-292402b1fa16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:02.410137 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a72509-72df-4cf6-9691-292402b1fa16 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:02.422999 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 303/613] 10.222.0.27 () {56 vars in 1103 bytes} [Thu Aug 18 21:42:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 21:42:02.428280 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa6f926-7dcf-41f9-a109-816af152d94f None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:02.442125 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:02.567083 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa6f926-7dcf-41f9-a109-816af152d94f None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:02.608757 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd19a595-46f2-4e29-8a93-e69a53ff4fa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:02.609395 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd19a595-46f2-4e29-8a93-e69a53ff4fa1 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:02.610384 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd19a595-46f2-4e29-8a93-e69a53ff4fa1 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:02.610648 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd19a595-46f2-4e29-8a93-e69a53ff4fa1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:02.629157 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd19a595-46f2-4e29-8a93-e69a53ff4fa1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:02.629846 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a72509-72df-4cf6-9691-292402b1fa16 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:02.630630 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd19a595-46f2-4e29-8a93-e69a53ff4fa1 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:02.647401 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application [None req-fd19a595-46f2-4e29-8a93-e69a53ff4fa1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:42:02.647401 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:02.647401 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:42:02.647401 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:42:02.647401 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:42:02.647401 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:42:02.647401 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:42:02.647401 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:42:02.647401 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:42:02.647401 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:42:02.647401 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:42:02.647401 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:42:02.647401 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 21:42:02.647401 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 21:42:02.647401 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 21:42:02.647401 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 21:42:02.648414 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:42:02.648414 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:42:02.648414 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:42:02.648414 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:42:02.648414 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:42:02.648414 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:42:02.648414 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:42:02.648414 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application with Lock( Aug 18 21:42:02.648414 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:42:02.648414 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:42:02.648414 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:42:02.648414 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:42:02.648414 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:42:02.648414 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:42:02.648414 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:42:02.648414 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:42:02.648414 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 21:42:02.649326 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 21:42:02.649326 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:42:02.649326 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:42:02.649326 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 311/614] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 18 21:42:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:42:02.658311 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd19a595-46f2-4e29-8a93-e69a53ff4fa1 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:02.723242 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:02.725670 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:02.772785 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd19a595-46f2-4e29-8a93-e69a53ff4fa1 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:02.812621 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab617cef-55c1-4925-b451-e381df93226f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:02.812621 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab617cef-55c1-4925-b451-e381df93226f None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:02.812621 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab617cef-55c1-4925-b451-e381df93226f None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:02.812621 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab617cef-55c1-4925-b451-e381df93226f None admin] PATH_INFO: `/v3/domains` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:02.813062 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab617cef-55c1-4925-b451-e381df93226f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:02.813366 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab617cef-55c1-4925-b451-e381df93226f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:02.820620 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab617cef-55c1-4925-b451-e381df93226f None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:02.830161 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 312/615] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 18 21:42:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:42:02.836196 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab617cef-55c1-4925-b451-e381df93226f None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:02.874555 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a72509-72df-4cf6-9691-292402b1fa16 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:02.941970 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f14ba35-2e85-4ef5-addc-98ef6e27bc61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:02.942739 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f14ba35-2e85-4ef5-addc-98ef6e27bc61 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:02.943029 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f14ba35-2e85-4ef5-addc-98ef6e27bc61 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:02.943305 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f14ba35-2e85-4ef5-addc-98ef6e27bc61 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:02.956027 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f14ba35-2e85-4ef5-addc-98ef6e27bc61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:42:02.961681 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application [None req-9f14ba35-2e85-4ef5-addc-98ef6e27bc61 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 21:42:02.961681 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:02.961681 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:42:02.961681 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:42:02.961681 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:42:02.961681 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:42:02.961681 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:42:02.961681 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:42:02.961681 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:42:02.961681 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:42:02.961681 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:42:02.961681 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:42:02.961681 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:42:02.961681 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:42:02.961681 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:42:02.961681 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:42:02.962577 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:42:02.962577 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:42:02.962577 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:42:02.962577 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:42:02.962577 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:42:02.962577 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:42:02.962577 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:42:02.962577 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:42:02.962577 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:42:02.962577 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:42:02.962577 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:42:02.962577 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application with Lock( Aug 18 21:42:02.962577 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:42:02.962577 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:42:02.962577 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:42:02.962577 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:42:02.963410 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:42:02.963410 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:42:02.963410 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:42:02.963410 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:42:02.963410 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:42:02.963410 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:42:02.963410 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:42:02.963410 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:42:02.963410 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:42:02.963410 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:42:02.963410 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 21:42:02.963410 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:42:02.963410 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 304/616] 10.222.0.27 () {56 vars in 1102 bytes} [Thu Aug 18 21:42:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:42:02.973687 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f14ba35-2e85-4ef5-addc-98ef6e27bc61 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:02.986054 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab617cef-55c1-4925-b451-e381df93226f None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:03.024954 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:03.054288 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799eecc5-671c-4aae-a2cb-b7de7e10fb6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:03.054932 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799eecc5-671c-4aae-a2cb-b7de7e10fb6d None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:03.055211 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799eecc5-671c-4aae-a2cb-b7de7e10fb6d None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:03.055484 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799eecc5-671c-4aae-a2cb-b7de7e10fb6d None admin] PATH_INFO: `/v3/users/swift` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:03.081231 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799eecc5-671c-4aae-a2cb-b7de7e10fb6d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:03.081989 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:03.082752 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799eecc5-671c-4aae-a2cb-b7de7e10fb6d None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:03.087069 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f14ba35-2e85-4ef5-addc-98ef6e27bc61 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:03.117499 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application [None req-799eecc5-671c-4aae-a2cb-b7de7e10fb6d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 18 21:42:03.117499 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:03.117499 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:42:03.117499 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:42:03.117499 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:42:03.117499 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:42:03.117499 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:42:03.117499 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:42:03.117499 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:42:03.117499 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:42:03.117499 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:42:03.117499 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:42:03.117499 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 21:42:03.117499 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 21:42:03.117499 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 21:42:03.117499 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 21:42:03.118761 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:42:03.118761 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:42:03.118761 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 21:42:03.118761 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 21:42:03.118761 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 21:42:03.118761 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 21:42:03.118761 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:42:03.118761 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:42:03.118761 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:42:03.118761 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:42:03.118761 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:42:03.118761 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application with Lock( Aug 18 21:42:03.118761 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:42:03.118761 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:42:03.118761 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:42:03.118761 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:42:03.118761 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:42:03.118761 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:42:03.119946 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:42:03.119946 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:42:03.119946 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 21:42:03.119946 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 21:42:03.119946 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 21:42:03.119946 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 21:42:03.119946 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 21:42:03.119946 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 21:42:03.119946 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 18 21:42:03.119946 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:42:03.119946 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 313/617] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Aug 18 21:42:02 2022] GET /identity/v3/users/swift => generated 83 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 21:42:03.129435 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7576b3-f6cf-4dc2-9713-da0c5dcf8f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:03.129609 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799eecc5-671c-4aae-a2cb-b7de7e10fb6d None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:03.130108 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7576b3-f6cf-4dc2-9713-da0c5dcf8f17 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:03.130489 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7576b3-f6cf-4dc2-9713-da0c5dcf8f17 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:03.130811 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7576b3-f6cf-4dc2-9713-da0c5dcf8f17 None admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:03.131488 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7576b3-f6cf-4dc2-9713-da0c5dcf8f17 None admin] RBAC: Adding query filter params (name=service) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:03.131905 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7576b3-f6cf-4dc2-9713-da0c5dcf8f17 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:03.133329 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7576b3-f6cf-4dc2-9713-da0c5dcf8f17 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:03.143437 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 305/618] 10.222.0.27 () {56 vars in 1103 bytes} [Thu Aug 18 21:42:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:42:03.153838 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7576b3-f6cf-4dc2-9713-da0c5dcf8f17 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:03.268536 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7576b3-f6cf-4dc2-9713-da0c5dcf8f17 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:03.310362 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e59845-a4f0-4b51-a3ff-e8a79950daf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:03.311017 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e59845-a4f0-4b51-a3ff-e8a79950daf9 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:03.311274 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e59845-a4f0-4b51-a3ff-e8a79950daf9 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:03.311549 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e59845-a4f0-4b51-a3ff-e8a79950daf9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:03.315547 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799eecc5-671c-4aae-a2cb-b7de7e10fb6d None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:03.324219 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e59845-a4f0-4b51-a3ff-e8a79950daf9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:03.326068 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e59845-a4f0-4b51-a3ff-e8a79950daf9 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:03.342511 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application [None req-89e59845-a4f0-4b51-a3ff-e8a79950daf9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:42:03.342511 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:03.342511 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:42:03.342511 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:42:03.342511 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:42:03.342511 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:42:03.342511 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:42:03.342511 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:42:03.342511 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:42:03.342511 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:42:03.342511 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:42:03.342511 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:42:03.342511 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 21:42:03.342511 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 21:42:03.342511 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 21:42:03.342511 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 21:42:03.343491 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:42:03.343491 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:42:03.343491 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:42:03.343491 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:42:03.343491 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:42:03.343491 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:42:03.343491 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:42:03.343491 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application with Lock( Aug 18 21:42:03.343491 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:42:03.343491 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:42:03.343491 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:42:03.343491 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:42:03.343491 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:42:03.343491 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:42:03.343491 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:42:03.343491 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:42:03.343491 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 21:42:03.344500 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 21:42:03.344500 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:42:03.344500 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:42:03.344500 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 306/619] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 18 21:42:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:42:03.350189 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623d30ba-856a-4178-9e5c-e6fce93d475e None None] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:03.350475 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623d30ba-856a-4178-9e5c-e6fce93d475e None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:03.350754 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623d30ba-856a-4178-9e5c-e6fce93d475e None None] PATH_INFO: `/` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:03.356059 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 307/620] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:42:03 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:42:03.356059 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623d30ba-856a-4178-9e5c-e6fce93d475e None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:03.362955 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573e2e3e-077b-410e-a257-90fba0e8828f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:03.363862 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573e2e3e-077b-410e-a257-90fba0e8828f None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:03.364346 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573e2e3e-077b-410e-a257-90fba0e8828f None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:03.364857 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573e2e3e-077b-410e-a257-90fba0e8828f None admin] PATH_INFO: `/v3/users` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:03.366331 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573e2e3e-077b-410e-a257-90fba0e8828f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:03.366862 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573e2e3e-077b-410e-a257-90fba0e8828f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:03.369481 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573e2e3e-077b-410e-a257-90fba0e8828f None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:03.371966 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:03.399369 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 314/621] 10.222.0.27 () {56 vars in 1135 bytes} [Thu Aug 18 21:42:03 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:42:03.399369 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f44db2-0aee-4e08-ad24-e99f127d335a None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:03.399369 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f44db2-0aee-4e08-ad24-e99f127d335a None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:03.399369 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f44db2-0aee-4e08-ad24-e99f127d335a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:03.427154 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-29f44db2-0aee-4e08-ad24-e99f127d335a None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:42:03.429305 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-29f44db2-0aee-4e08-ad24-e99f127d335a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:42:03.468578 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:03.473980 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623d30ba-856a-4178-9e5c-e6fce93d475e None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:03.512890 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26059dc3-f1ee-4180-80fd-a0e13f880502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:03.513672 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26059dc3-f1ee-4180-80fd-a0e13f880502 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:03.514054 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26059dc3-f1ee-4180-80fd-a0e13f880502 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:03.514438 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26059dc3-f1ee-4180-80fd-a0e13f880502 None admin] PATH_INFO: `/v3/domains` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:03.515172 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26059dc3-f1ee-4180-80fd-a0e13f880502 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:03.516456 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26059dc3-f1ee-4180-80fd-a0e13f880502 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:03.518147 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26059dc3-f1ee-4180-80fd-a0e13f880502 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:03.523825 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 315/622] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:42:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 21:42:03.524879 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f44db2-0aee-4e08-ad24-e99f127d335a None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:03.551037 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 308/623] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 18 21:42:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:42:03.556343 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26059dc3-f1ee-4180-80fd-a0e13f880502 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:03.672942 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:03.702858 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f44db2-0aee-4e08-ad24-e99f127d335a None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:03.708328 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26059dc3-f1ee-4180-80fd-a0e13f880502 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:03.772364 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc5ebc3-acf1-4975-9b3a-ddeb8d70e432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:03.773544 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc5ebc3-acf1-4975-9b3a-ddeb8d70e432 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:03.773885 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc5ebc3-acf1-4975-9b3a-ddeb8d70e432 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:03.774106 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc5ebc3-acf1-4975-9b3a-ddeb8d70e432 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:03.779055 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3951c3f4-acad-40bc-b25a-93d9d46e9097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:03.779692 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3951c3f4-acad-40bc-b25a-93d9d46e9097 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:03.779972 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3951c3f4-acad-40bc-b25a-93d9d46e9097 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:03.780240 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3951c3f4-acad-40bc-b25a-93d9d46e9097 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:03.792199 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc5ebc3-acf1-4975-9b3a-ddeb8d70e432 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:03.793764 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc5ebc3-acf1-4975-9b3a-ddeb8d70e432 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:03.803869 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3951c3f4-acad-40bc-b25a-93d9d46e9097 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:03.805413 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3951c3f4-acad-40bc-b25a-93d9d46e9097 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:03.814921 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application [None req-8bc5ebc3-acf1-4975-9b3a-ddeb8d70e432 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 18 21:42:03.814921 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:03.814921 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:42:03.814921 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:42:03.814921 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:42:03.814921 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:42:03.814921 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:42:03.814921 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:42:03.814921 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:42:03.814921 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:42:03.814921 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:42:03.814921 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:42:03.814921 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 21:42:03.814921 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 21:42:03.814921 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 21:42:03.814921 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 21:42:03.815904 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:42:03.815904 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:42:03.815904 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 21:42:03.815904 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 21:42:03.815904 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 21:42:03.815904 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 21:42:03.815904 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:42:03.815904 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:42:03.815904 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:42:03.815904 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:42:03.815904 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:42:03.815904 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application with Lock( Aug 18 21:42:03.815904 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:42:03.815904 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:42:03.815904 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:42:03.815904 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:42:03.815904 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:42:03.815904 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:42:03.816916 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:42:03.816916 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:42:03.816916 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 21:42:03.816916 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 21:42:03.816916 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 21:42:03.816916 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 21:42:03.816916 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 21:42:03.816916 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 21:42:03.816916 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 18 21:42:03.816916 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:42:03.816916 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 309/624] 10.222.0.27 () {56 vars in 1093 bytes} [Thu Aug 18 21:42:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 21:42:03.830107 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc5ebc3-acf1-4975-9b3a-ddeb8d70e432 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:03.838978 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application [None req-3951c3f4-acad-40bc-b25a-93d9d46e9097 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:42:03.838978 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:03.838978 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:42:03.838978 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:42:03.838978 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:42:03.838978 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:42:03.838978 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:42:03.838978 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:42:03.838978 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:42:03.838978 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:42:03.838978 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:42:03.838978 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:42:03.838978 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 21:42:03.838978 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 21:42:03.838978 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 21:42:03.838978 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 21:42:03.839938 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:42:03.839938 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:42:03.839938 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:42:03.839938 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:42:03.839938 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:42:03.839938 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:42:03.839938 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:42:03.839938 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application with Lock( Aug 18 21:42:03.839938 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:42:03.839938 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:42:03.839938 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:42:03.839938 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:42:03.839938 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:42:03.839938 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:42:03.839938 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:42:03.839938 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:42:03.839938 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 21:42:03.840910 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 21:42:03.840910 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:42:03.840910 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:42:03.845213 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 316/625] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 18 21:42:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:42:03.847811 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3951c3f4-acad-40bc-b25a-93d9d46e9097 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:03.884384 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:03.961922 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc5ebc3-acf1-4975-9b3a-ddeb8d70e432 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:03.993290 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3951c3f4-acad-40bc-b25a-93d9d46e9097 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:03.997450 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:04.005395 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6c7043-6bf9-4a78-ade0-e13802467cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:04.006058 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6c7043-6bf9-4a78-ade0-e13802467cd7 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:04.006344 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6c7043-6bf9-4a78-ade0-e13802467cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:04.006618 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6c7043-6bf9-4a78-ade0-e13802467cd7 None admin] PATH_INFO: `/v3/users` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:04.010439 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6c7043-6bf9-4a78-ade0-e13802467cd7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:04.010439 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6c7043-6bf9-4a78-ade0-e13802467cd7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:04.010439 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6c7043-6bf9-4a78-ade0-e13802467cd7 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:04.032707 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 310/626] 10.222.0.27 () {56 vars in 1133 bytes} [Thu Aug 18 21:42:03 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:42:04.032707 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6c7043-6bf9-4a78-ade0-e13802467cd7 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:04.049289 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfea933-323a-43e2-a12c-b37ab458de64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:04.050689 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfea933-323a-43e2-a12c-b37ab458de64 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:04.051372 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfea933-323a-43e2-a12c-b37ab458de64 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:04.051801 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfea933-323a-43e2-a12c-b37ab458de64 None admin] PATH_INFO: `/v3/domains` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:04.052895 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfea933-323a-43e2-a12c-b37ab458de64 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:04.053406 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfea933-323a-43e2-a12c-b37ab458de64 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:04.055308 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfea933-323a-43e2-a12c-b37ab458de64 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:04.073770 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 317/627] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 18 21:42:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:42:04.074837 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfea933-323a-43e2-a12c-b37ab458de64 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:04.164838 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6c7043-6bf9-4a78-ade0-e13802467cd7 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:04.165788 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:04.190820 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfea933-323a-43e2-a12c-b37ab458de64 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:04.201484 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9a1ab3-c0c9-4fd1-8fbf-7f082212079f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:04.202430 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9a1ab3-c0c9-4fd1-8fbf-7f082212079f None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:04.202721 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9a1ab3-c0c9-4fd1-8fbf-7f082212079f None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:04.203748 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9a1ab3-c0c9-4fd1-8fbf-7f082212079f None admin] PATH_INFO: `/v3/roles/service` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:04.214391 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9a1ab3-c0c9-4fd1-8fbf-7f082212079f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:42:04.219979 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application [None req-0a9a1ab3-c0c9-4fd1-8fbf-7f082212079f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 21:42:04.219979 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:04.219979 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:42:04.219979 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:42:04.219979 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:42:04.219979 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:42:04.219979 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:42:04.219979 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:42:04.219979 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:42:04.219979 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:42:04.219979 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:42:04.219979 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:42:04.219979 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:42:04.219979 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:42:04.219979 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:42:04.219979 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:42:04.221250 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:42:04.221250 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:42:04.221250 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:42:04.221250 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:42:04.221250 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:42:04.221250 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:42:04.221250 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:42:04.221250 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:42:04.221250 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:42:04.221250 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:42:04.221250 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:42:04.221250 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application with Lock( Aug 18 21:42:04.221250 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:42:04.221250 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:42:04.221250 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:42:04.221250 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:42:04.222082 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:42:04.222082 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:42:04.222082 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:42:04.222082 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:42:04.222082 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:42:04.222082 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:42:04.222082 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:42:04.222082 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:42:04.222082 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:42:04.222082 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:42:04.222082 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 21:42:04.222082 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:42:04.222082 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 311/628] 10.222.0.27 () {56 vars in 1102 bytes} [Thu Aug 18 21:42:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:42:04.222783 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9a1ab3-c0c9-4fd1-8fbf-7f082212079f None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:04.231968 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadb144b-99f3-4464-a1e6-36971ed513cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:04.232841 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadb144b-99f3-4464-a1e6-36971ed513cc None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:04.233326 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadb144b-99f3-4464-a1e6-36971ed513cc None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:04.233759 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadb144b-99f3-4464-a1e6-36971ed513cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:04.274392 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:04.309119 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadb144b-99f3-4464-a1e6-36971ed513cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:04.310566 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadb144b-99f3-4464-a1e6-36971ed513cc None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:04.327717 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9a1ab3-c0c9-4fd1-8fbf-7f082212079f None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:04.362036 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f3d0b0-c3cd-4b71-b3c9-38c0d7c7f505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:04.362660 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f3d0b0-c3cd-4b71-b3c9-38c0d7c7f505 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:04.362937 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f3d0b0-c3cd-4b71-b3c9-38c0d7c7f505 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:04.363208 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f3d0b0-c3cd-4b71-b3c9-38c0d7c7f505 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:04.369655 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f3d0b0-c3cd-4b71-b3c9-38c0d7c7f505 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:04.371107 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f3d0b0-c3cd-4b71-b3c9-38c0d7c7f505 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:04.382721 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application [None req-33f3d0b0-c3cd-4b71-b3c9-38c0d7c7f505 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 21:42:04.382721 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:04.382721 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:42:04.382721 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:42:04.382721 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:42:04.382721 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:42:04.382721 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:42:04.382721 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:42:04.382721 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:42:04.382721 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:42:04.382721 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:42:04.382721 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:42:04.382721 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 21:42:04.382721 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 21:42:04.382721 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 21:42:04.383623 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 21:42:04.383623 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:42:04.383623 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:42:04.383623 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:42:04.383623 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:42:04.383623 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:42:04.383623 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:42:04.383623 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:42:04.383623 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application with Lock( Aug 18 21:42:04.383623 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:42:04.383623 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:42:04.383623 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:42:04.383623 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:42:04.383623 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:42:04.383623 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:42:04.383623 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:42:04.383623 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:42:04.384520 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 21:42:04.384520 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 21:42:04.384520 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 21:42:04.384520 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 21:42:04.384520 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 21:42:04.384520 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 21:42:04.384520 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 21:42:04.384520 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:42:04.384520 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 312/629] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Aug 18 21:42:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:42:04.385064 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee05aa9f-9bb6-43b0-a7f3-c5876f8cd810 None None] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:04.385281 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee05aa9f-9bb6-43b0-a7f3-c5876f8cd810 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:04.385767 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee05aa9f-9bb6-43b0-a7f3-c5876f8cd810 None None] PATH_INFO: `/` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:04.388635 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 313/630] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:42:04 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:42:04.388635 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee05aa9f-9bb6-43b0-a7f3-c5876f8cd810 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:04.393236 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:04.417247 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 318/631] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Aug 18 21:42:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 21:42:04.418915 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12987688-f0d4-4684-a055-e0a7d5f57cfb None None] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:04.419251 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12987688-f0d4-4684-a055-e0a7d5f57cfb None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:04.419579 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12987688-f0d4-4684-a055-e0a7d5f57cfb None None] PATH_INFO: `/` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:04.420929 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 319/632] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:42:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:42:04.421909 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12987688-f0d4-4684-a055-e0a7d5f57cfb None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:04.495477 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee05aa9f-9bb6-43b0-a7f3-c5876f8cd810 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:04.506107 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:04.527282 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12987688-f0d4-4684-a055-e0a7d5f57cfb None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:04.529495 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec6468e-e1cd-4145-b708-93dc34b0c6d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:04.530094 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec6468e-e1cd-4145-b708-93dc34b0c6d9 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:04.530372 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec6468e-e1cd-4145-b708-93dc34b0c6d9 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:04.530644 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec6468e-e1cd-4145-b708-93dc34b0c6d9 None admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:04.531316 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec6468e-e1cd-4145-b708-93dc34b0c6d9 None admin] RBAC: Adding query filter params (name=service) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:04.532173 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec6468e-e1cd-4145-b708-93dc34b0c6d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:04.533861 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec6468e-e1cd-4145-b708-93dc34b0c6d9 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:04.541731 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 314/633] 10.222.0.27 () {56 vars in 1103 bytes} [Thu Aug 18 21:42:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:42:04.542842 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc30b005-ec0e-4c9a-94c2-f50ad7ea2593 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:04.543130 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc30b005-ec0e-4c9a-94c2-f50ad7ea2593 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:04.543402 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc30b005-ec0e-4c9a-94c2-f50ad7ea2593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:04.562312 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-dc30b005-ec0e-4c9a-94c2-f50ad7ea2593 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:42:04.563554 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a6525a-dc33-47db-a96e-71319afe8552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:04.564277 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a6525a-dc33-47db-a96e-71319afe8552 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:04.564382 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-dc30b005-ec0e-4c9a-94c2-f50ad7ea2593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:42:04.564558 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a6525a-dc33-47db-a96e-71319afe8552 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:04.564858 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a6525a-dc33-47db-a96e-71319afe8552 None admin] PATH_INFO: `/v3/projects` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:04.565543 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a6525a-dc33-47db-a96e-71319afe8552 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:04.565848 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a6525a-dc33-47db-a96e-71319afe8552 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:04.567275 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a6525a-dc33-47db-a96e-71319afe8552 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:04.579432 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 320/634] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Aug 18 21:42:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:42:04.580427 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a6525a-dc33-47db-a96e-71319afe8552 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:04.624136 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:04.632780 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 315/635] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:42:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 21:42:04.634034 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa518a85-4b1b-47c6-8b03-2d4ce151dd49 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:04.639870 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa518a85-4b1b-47c6-8b03-2d4ce151dd49 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:04.639870 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa518a85-4b1b-47c6-8b03-2d4ce151dd49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:04.652424 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-aa518a85-4b1b-47c6-8b03-2d4ce151dd49 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:42:04.653644 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-aa518a85-4b1b-47c6-8b03-2d4ce151dd49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:42:04.689874 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a6525a-dc33-47db-a96e-71319afe8552 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:04.725305 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c438a6ab-3307-40e7-af2f-177771d7f974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:04.725940 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c438a6ab-3307-40e7-af2f-177771d7f974 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:04.726210 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c438a6ab-3307-40e7-af2f-177771d7f974 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:04.726481 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c438a6ab-3307-40e7-af2f-177771d7f974 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:04.728727 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 316/636] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:42:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 21:42:04.729590 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa518a85-4b1b-47c6-8b03-2d4ce151dd49 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:04.749193 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c438a6ab-3307-40e7-af2f-177771d7f974 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:04.751460 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c438a6ab-3307-40e7-af2f-177771d7f974 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:04.766979 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:04.770439 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application [None req-c438a6ab-3307-40e7-af2f-177771d7f974 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:42:04.770439 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:04.770439 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:42:04.770439 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:42:04.770439 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:42:04.770439 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:42:04.770439 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:42:04.770439 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:42:04.770439 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:42:04.770439 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:42:04.770439 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:42:04.770439 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:42:04.770439 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 21:42:04.770439 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 21:42:04.770439 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 21:42:04.770439 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 21:42:04.771376 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:42:04.771376 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:42:04.771376 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:42:04.771376 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:42:04.771376 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:42:04.771376 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:42:04.771376 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:42:04.771376 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application with Lock( Aug 18 21:42:04.771376 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:42:04.771376 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:42:04.771376 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:42:04.771376 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:42:04.771376 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:42:04.771376 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:42:04.771376 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:42:04.771376 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:42:04.771376 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 21:42:04.772254 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 21:42:04.772254 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:42:04.772254 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:42:04.779874 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 321/637] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 18 21:42:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:42:04.781007 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c438a6ab-3307-40e7-af2f-177771d7f974 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:04.843229 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa518a85-4b1b-47c6-8b03-2d4ce151dd49 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:04.882106 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaa9bf3-9565-44a1-a111-69ab4dc4a2de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:04.883058 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaa9bf3-9565-44a1-a111-69ab4dc4a2de None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:04.883528 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaa9bf3-9565-44a1-a111-69ab4dc4a2de None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:04.884301 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaa9bf3-9565-44a1-a111-69ab4dc4a2de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:04.897317 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaa9bf3-9565-44a1-a111-69ab4dc4a2de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:04.899028 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:04.899443 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaa9bf3-9565-44a1-a111-69ab4dc4a2de None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:04.910680 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c438a6ab-3307-40e7-af2f-177771d7f974 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:04.916860 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application [None req-8aaa9bf3-9565-44a1-a111-69ab4dc4a2de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:42:04.916860 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:04.916860 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:42:04.916860 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:42:04.916860 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:42:04.916860 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:42:04.916860 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:42:04.916860 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:42:04.916860 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:42:04.916860 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:42:04.916860 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:42:04.916860 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:42:04.916860 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 21:42:04.916860 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 21:42:04.916860 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 21:42:04.916860 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 21:42:04.918005 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:42:04.918005 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:42:04.918005 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:42:04.918005 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:42:04.918005 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:42:04.918005 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:42:04.918005 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:42:04.918005 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application with Lock( Aug 18 21:42:04.918005 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:42:04.918005 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:42:04.918005 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:42:04.918005 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:42:04.918005 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:42:04.918005 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:42:04.918005 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:42:04.918005 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:42:04.918005 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 21:42:04.919186 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 21:42:04.919186 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:42:04.919186 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:42:04.919186 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 317/638] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 18 21:42:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:42:04.919186 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaa9bf3-9565-44a1-a111-69ab4dc4a2de None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:04.951218 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2170fdf0-dcd6-41fb-9a4a-ef561856e32a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:04.951994 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2170fdf0-dcd6-41fb-9a4a-ef561856e32a None admin] REQUEST_METHOD: `PUT` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:04.952334 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2170fdf0-dcd6-41fb-9a4a-ef561856e32a None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:04.952700 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2170fdf0-dcd6-41fb-9a4a-ef561856e32a None admin] PATH_INFO: `/v3/projects/4b54801b90484d689034f838f85fc0a4/users/9ae59e6dca304c949942ae769acedc74/roles/30d8ac11e30e4b1d83940485e98d147c` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:04.970504 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2170fdf0-dcd6-41fb-9a4a-ef561856e32a None admin] RBAC: Authorizing `identity:create_grant(project_id=4b54801b90484d689034f838f85fc0a4, user_id=9ae59e6dca304c949942ae769acedc74, role_id=30d8ac11e30e4b1d83940485e98d147c)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:04.971932 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2170fdf0-dcd6-41fb-9a4a-ef561856e32a None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:05.009243 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:05.025637 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaa9bf3-9565-44a1-a111-69ab4dc4a2de None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:05.059246 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80267031-e0fb-4e75-9a5f-ec9facbf8b48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:05.059838 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80267031-e0fb-4e75-9a5f-ec9facbf8b48 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:05.060117 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80267031-e0fb-4e75-9a5f-ec9facbf8b48 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:05.060391 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80267031-e0fb-4e75-9a5f-ec9facbf8b48 None admin] PATH_INFO: `/v3/domains` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:05.061057 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80267031-e0fb-4e75-9a5f-ec9facbf8b48 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:05.061360 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80267031-e0fb-4e75-9a5f-ec9facbf8b48 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:05.063389 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80267031-e0fb-4e75-9a5f-ec9facbf8b48 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:05.072169 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 322/639] 10.222.0.27 () {58 vars in 1439 bytes} [Thu Aug 18 21:42:04 2022] PUT /identity/v3/projects/4b54801b90484d689034f838f85fc0a4/users/9ae59e6dca304c949942ae769acedc74/roles/30d8ac11e30e4b1d83940485e98d147c => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:42:05.073043 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2170fdf0-dcd6-41fb-9a4a-ef561856e32a None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:05.077096 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 318/640] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 18 21:42:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:42:05.078327 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80267031-e0fb-4e75-9a5f-ec9facbf8b48 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:05.193366 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80267031-e0fb-4e75-9a5f-ec9facbf8b48 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:05.196724 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2170fdf0-dcd6-41fb-9a4a-ef561856e32a None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:05.236440 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3773ecc3-6d2f-44c8-876c-9dfc264fc84a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:05.237170 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3773ecc3-6d2f-44c8-876c-9dfc264fc84a None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:05.237481 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3773ecc3-6d2f-44c8-876c-9dfc264fc84a None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:05.237754 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3773ecc3-6d2f-44c8-876c-9dfc264fc84a None admin] PATH_INFO: `/v3/roles/service` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:05.238510 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487d04c8-5898-45f7-8812-b33f5b61f6f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:05.239358 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487d04c8-5898-45f7-8812-b33f5b61f6f8 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:05.239817 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487d04c8-5898-45f7-8812-b33f5b61f6f8 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:05.240273 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487d04c8-5898-45f7-8812-b33f5b61f6f8 None admin] PATH_INFO: `/v3/domains` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:05.241226 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487d04c8-5898-45f7-8812-b33f5b61f6f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:05.241708 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487d04c8-5898-45f7-8812-b33f5b61f6f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:05.243295 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487d04c8-5898-45f7-8812-b33f5b61f6f8 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:05.246164 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:05.249159 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3773ecc3-6d2f-44c8-876c-9dfc264fc84a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:42:05.255002 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application [None req-3773ecc3-6d2f-44c8-876c-9dfc264fc84a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 21:42:05.255002 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:05.255002 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:42:05.255002 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:42:05.255002 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:42:05.255002 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:42:05.255002 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:42:05.255002 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:42:05.255002 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:42:05.255002 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:42:05.255002 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:42:05.255002 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:42:05.255002 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:42:05.255002 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:42:05.255002 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:42:05.255002 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:42:05.258476 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:42:05.258476 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:42:05.258476 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:42:05.258476 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:42:05.258476 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:42:05.258476 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:42:05.258476 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:42:05.258476 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:42:05.258476 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:42:05.258476 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:42:05.258476 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:42:05.258476 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application with Lock( Aug 18 21:42:05.258476 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:42:05.258476 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:42:05.258476 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:42:05.258476 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:42:05.259321 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:42:05.259321 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:42:05.259321 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:42:05.259321 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:42:05.259321 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:42:05.259321 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:42:05.259321 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:42:05.259321 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:42:05.259321 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:42:05.259321 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:42:05.259321 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 21:42:05.259321 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:42:05.259321 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 323/641] 10.222.0.27 () {56 vars in 1102 bytes} [Thu Aug 18 21:42:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:42:05.259321 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3773ecc3-6d2f-44c8-876c-9dfc264fc84a None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:05.260066 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 319/642] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 18 21:42:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:42:05.260915 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487d04c8-5898-45f7-8812-b33f5b61f6f8 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:05.274756 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:05.369884 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487d04c8-5898-45f7-8812-b33f5b61f6f8 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:05.370781 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3773ecc3-6d2f-44c8-876c-9dfc264fc84a None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:05.407628 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af09ae28-a914-4dc5-9607-66df08f81b8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:05.408313 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af09ae28-a914-4dc5-9607-66df08f81b8b None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:05.408610 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af09ae28-a914-4dc5-9607-66df08f81b8b None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:05.408904 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af09ae28-a914-4dc5-9607-66df08f81b8b None admin] PATH_INFO: `/v3/projects/service` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:05.410191 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85ba89f-f979-4a25-aab9-9a8d43733ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:05.410819 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85ba89f-f979-4a25-aab9-9a8d43733ed1 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:05.411096 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85ba89f-f979-4a25-aab9-9a8d43733ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:05.411366 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85ba89f-f979-4a25-aab9-9a8d43733ed1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:05.416300 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af09ae28-a914-4dc5-9607-66df08f81b8b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:05.417822 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af09ae28-a914-4dc5-9607-66df08f81b8b None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:05.422683 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85ba89f-f979-4a25-aab9-9a8d43733ed1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:42:05.427408 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application [None req-a85ba89f-f979-4a25-aab9-9a8d43733ed1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 21:42:05.427408 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:05.427408 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:42:05.427408 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:42:05.427408 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:42:05.427408 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:42:05.427408 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:42:05.427408 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:42:05.427408 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:42:05.427408 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:42:05.427408 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:42:05.427408 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:42:05.427408 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:42:05.427408 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:42:05.427408 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:42:05.427408 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:42:05.428424 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:42:05.428424 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:42:05.428424 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:42:05.428424 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:42:05.428424 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:42:05.428424 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:42:05.428424 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:42:05.428424 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:42:05.428424 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:42:05.428424 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:42:05.428424 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:42:05.428424 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application with Lock( Aug 18 21:42:05.428424 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:42:05.428424 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:42:05.428424 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:42:05.428424 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:42:05.429324 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:42:05.429324 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:42:05.429324 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:42:05.429324 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:42:05.429324 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:42:05.429324 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:42:05.429324 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:42:05.429324 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:42:05.429324 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:42:05.429324 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:42:05.429324 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 21:42:05.429324 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:42:05.429964 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application [None req-af09ae28-a914-4dc5-9607-66df08f81b8b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 21:42:05.429964 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:05.429964 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:42:05.429964 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:42:05.429964 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:42:05.429964 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:42:05.429964 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:42:05.429964 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:42:05.429964 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:42:05.429964 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:42:05.429964 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:42:05.429964 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:42:05.429964 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 21:42:05.429964 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 21:42:05.429964 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 21:42:05.430751 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 21:42:05.430751 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:42:05.430751 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:42:05.430751 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:42:05.430751 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:42:05.430751 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:42:05.430751 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:42:05.430751 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:42:05.430751 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application with Lock( Aug 18 21:42:05.430751 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:42:05.430751 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:42:05.430751 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:42:05.430751 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:42:05.430751 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:42:05.430751 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:42:05.430751 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:42:05.430751 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:42:05.431800 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 21:42:05.431800 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 21:42:05.431800 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 21:42:05.431800 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 21:42:05.431800 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 21:42:05.431800 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 21:42:05.431800 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 21:42:05.431800 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:42:05.433246 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 324/643] 10.222.0.27 () {56 vars in 1102 bytes} [Thu Aug 18 21:42:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:42:05.434311 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85ba89f-f979-4a25-aab9-9a8d43733ed1 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:05.435416 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 320/644] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Aug 18 21:42:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:42:05.436236 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af09ae28-a914-4dc5-9607-66df08f81b8b None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:05.503491 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:05.509427 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:05.545939 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85ba89f-f979-4a25-aab9-9a8d43733ed1 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:05.554511 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af09ae28-a914-4dc5-9607-66df08f81b8b None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:05.585123 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ec6c05-910b-43c3-af9b-8eea59edbebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:05.585752 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ec6c05-910b-43c3-af9b-8eea59edbebc None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:05.586029 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ec6c05-910b-43c3-af9b-8eea59edbebc None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:05.586298 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ec6c05-910b-43c3-af9b-8eea59edbebc None admin] PATH_INFO: `/v3/users/glance` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:05.589391 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee76524-ad5e-440f-b023-0d113d83e79f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:05.589982 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee76524-ad5e-440f-b023-0d113d83e79f None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:05.590261 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee76524-ad5e-440f-b023-0d113d83e79f None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:05.590532 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee76524-ad5e-440f-b023-0d113d83e79f None admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:05.591189 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee76524-ad5e-440f-b023-0d113d83e79f None admin] RBAC: Adding query filter params (name=service) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:05.591487 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee76524-ad5e-440f-b023-0d113d83e79f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:05.592882 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee76524-ad5e-440f-b023-0d113d83e79f None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:05.593738 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ec6c05-910b-43c3-af9b-8eea59edbebc None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:05.596045 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ec6c05-910b-43c3-af9b-8eea59edbebc None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:05.606780 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 321/645] 10.222.0.27 () {56 vars in 1103 bytes} [Thu Aug 18 21:42:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:42:05.606780 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee76524-ad5e-440f-b023-0d113d83e79f None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:05.613261 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application [None req-b9ec6c05-910b-43c3-af9b-8eea59edbebc None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 18 21:42:05.613261 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:05.613261 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:42:05.613261 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:42:05.613261 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:42:05.613261 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:42:05.613261 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:42:05.613261 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:42:05.613261 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:42:05.613261 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:42:05.613261 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:42:05.613261 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:42:05.613261 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 21:42:05.613261 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 21:42:05.613261 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 21:42:05.613261 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 21:42:05.614212 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:42:05.614212 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:42:05.614212 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 21:42:05.614212 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 21:42:05.614212 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 21:42:05.614212 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 21:42:05.614212 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:42:05.614212 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:42:05.614212 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:42:05.614212 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:42:05.614212 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:42:05.614212 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application with Lock( Aug 18 21:42:05.614212 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:42:05.614212 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:42:05.614212 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:42:05.614212 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:42:05.614212 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:42:05.614212 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:42:05.615199 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:42:05.615199 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:42:05.615199 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 21:42:05.615199 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 21:42:05.615199 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 21:42:05.615199 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 21:42:05.615199 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 21:42:05.615199 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 21:42:05.615199 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 18 21:42:05.615199 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:42:05.615199 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 325/646] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Aug 18 21:42:05 2022] GET /identity/v3/users/glance => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:42:05.615841 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ec6c05-910b-43c3-af9b-8eea59edbebc None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:05.715705 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee76524-ad5e-440f-b023-0d113d83e79f None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:05.733286 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ec6c05-910b-43c3-af9b-8eea59edbebc None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:05.743254 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:05.752734 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc28932-18ff-4374-8bfa-88c019c49bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:05.753349 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc28932-18ff-4374-8bfa-88c019c49bd0 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:05.753683 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc28932-18ff-4374-8bfa-88c019c49bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:05.753906 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc28932-18ff-4374-8bfa-88c019c49bd0 None admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:05.754571 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc28932-18ff-4374-8bfa-88c019c49bd0 None admin] RBAC: Adding query filter params (name=service) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:05.754873 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc28932-18ff-4374-8bfa-88c019c49bd0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:05.756250 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc28932-18ff-4374-8bfa-88c019c49bd0 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:05.756943 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:05.770686 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 322/647] 10.222.0.27 () {56 vars in 1103 bytes} [Thu Aug 18 21:42:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:42:05.770686 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc28932-18ff-4374-8bfa-88c019c49bd0 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:05.778877 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e6674f-1263-4c79-bccc-0689eaff2a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:05.779492 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e6674f-1263-4c79-bccc-0689eaff2a0a None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:05.779774 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e6674f-1263-4c79-bccc-0689eaff2a0a None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:05.780050 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e6674f-1263-4c79-bccc-0689eaff2a0a None admin] PATH_INFO: `/v3/projects` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:05.781094 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e6674f-1263-4c79-bccc-0689eaff2a0a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:05.782014 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e6674f-1263-4c79-bccc-0689eaff2a0a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:05.783967 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e6674f-1263-4c79-bccc-0689eaff2a0a None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:05.802903 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 326/648] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Aug 18 21:42:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:42:05.803752 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e6674f-1263-4c79-bccc-0689eaff2a0a None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:05.871878 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc28932-18ff-4374-8bfa-88c019c49bd0 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:05.910150 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e6674f-1263-4c79-bccc-0689eaff2a0a None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:05.910617 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c492693e-29f4-4c2a-8591-b486d4c1a769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:05.911247 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c492693e-29f4-4c2a-8591-b486d4c1a769 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:05.911529 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c492693e-29f4-4c2a-8591-b486d4c1a769 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:05.911804 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c492693e-29f4-4c2a-8591-b486d4c1a769 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:05.923461 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c492693e-29f4-4c2a-8591-b486d4c1a769 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:05.924977 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c492693e-29f4-4c2a-8591-b486d4c1a769 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:05.942494 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application [None req-c492693e-29f4-4c2a-8591-b486d4c1a769 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:42:05.942494 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:05.942494 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:42:05.942494 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:42:05.942494 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:42:05.942494 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:42:05.942494 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:42:05.942494 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:42:05.942494 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:42:05.942494 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:42:05.942494 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:42:05.942494 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:42:05.942494 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 21:42:05.942494 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 21:42:05.942494 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 21:42:05.942494 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 21:42:05.943463 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:42:05.943463 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:42:05.943463 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:42:05.943463 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:42:05.943463 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:42:05.943463 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:42:05.943463 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:42:05.943463 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application with Lock( Aug 18 21:42:05.943463 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:42:05.943463 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:42:05.943463 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:42:05.943463 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:42:05.943463 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:42:05.943463 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:42:05.943463 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:42:05.943463 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:42:05.943463 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 21:42:05.944344 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 21:42:05.944344 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:42:05.944344 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:42:05.944344 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 323/649] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 18 21:42:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:42:05.945067 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c492693e-29f4-4c2a-8591-b486d4c1a769 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:05.956668 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8732ef5f-c6cd-4e80-b853-1b31975cc254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:05.957281 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8732ef5f-c6cd-4e80-b853-1b31975cc254 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:05.957557 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8732ef5f-c6cd-4e80-b853-1b31975cc254 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:05.958088 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8732ef5f-c6cd-4e80-b853-1b31975cc254 None admin] PATH_INFO: `/v3/users` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:05.958555 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8732ef5f-c6cd-4e80-b853-1b31975cc254 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:05.958865 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8732ef5f-c6cd-4e80-b853-1b31975cc254 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:05.960561 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8732ef5f-c6cd-4e80-b853-1b31975cc254 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:05.982990 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 327/650] 10.222.0.27 () {56 vars in 1137 bytes} [Thu Aug 18 21:42:05 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:42:05.982990 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8732ef5f-c6cd-4e80-b853-1b31975cc254 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:05.995557 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:06.028713 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:06.058552 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c492693e-29f4-4c2a-8591-b486d4c1a769 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:06.094431 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8732ef5f-c6cd-4e80-b853-1b31975cc254 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:06.099083 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9948117c-746f-4d4f-b012-dc61aafc219c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:06.099709 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9948117c-746f-4d4f-b012-dc61aafc219c None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:06.100096 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9948117c-746f-4d4f-b012-dc61aafc219c None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:06.100369 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9948117c-746f-4d4f-b012-dc61aafc219c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:06.112653 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9948117c-746f-4d4f-b012-dc61aafc219c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:06.114316 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9948117c-746f-4d4f-b012-dc61aafc219c None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:06.129030 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application [None req-9948117c-746f-4d4f-b012-dc61aafc219c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:42:06.129030 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:06.129030 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:42:06.129030 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:42:06.129030 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:42:06.129030 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:42:06.129030 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:42:06.129030 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:42:06.129030 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:42:06.129030 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:42:06.129030 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:42:06.129030 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:42:06.129030 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 21:42:06.129030 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 21:42:06.129030 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 21:42:06.129030 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 21:42:06.130035 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:42:06.130035 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:42:06.130035 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:42:06.130035 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:42:06.130035 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:42:06.130035 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:42:06.130035 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:42:06.130035 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application with Lock( Aug 18 21:42:06.130035 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:42:06.130035 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:42:06.130035 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:42:06.130035 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:42:06.130035 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:42:06.130035 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:42:06.130035 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:42:06.130035 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:42:06.130035 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 21:42:06.130942 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 21:42:06.130942 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:42:06.130942 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:42:06.131114 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c231c1c-a520-43f2-96d0-01945ea26708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:06.131114 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c231c1c-a520-43f2-96d0-01945ea26708 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:06.131114 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c231c1c-a520-43f2-96d0-01945ea26708 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:06.131341 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 324/651] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 18 21:42:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:42:06.131341 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9948117c-746f-4d4f-b012-dc61aafc219c None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:06.136170 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c231c1c-a520-43f2-96d0-01945ea26708 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:06.136978 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c231c1c-a520-43f2-96d0-01945ea26708 None admin] RBAC: Adding query filter params (role.id=30d8ac11e30e4b1d83940485e98d147c, scope.project.id=4b54801b90484d689034f838f85fc0a4, user.id=a39cd50340184779ac589bbcb7cac9aa) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:06.137294 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c231c1c-a520-43f2-96d0-01945ea26708 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:06.138789 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c231c1c-a520-43f2-96d0-01945ea26708 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:06.152639 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 328/652] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Aug 18 21:42:05 2022] GET /identity/v3/role_assignments?user.id=a39cd50340184779ac589bbcb7cac9aa&scope.project.id=4b54801b90484d689034f838f85fc0a4&role.id=30d8ac11e30e4b1d83940485e98d147c => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:42:06.152639 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c231c1c-a520-43f2-96d0-01945ea26708 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:06.264303 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:06.278054 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9948117c-746f-4d4f-b012-dc61aafc219c None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:06.290343 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c231c1c-a520-43f2-96d0-01945ea26708 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:06.293008 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:06.320485 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f816876a-8240-43ba-8903-e957e34834cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:06.321290 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f816876a-8240-43ba-8903-e957e34834cf None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:06.321670 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f816876a-8240-43ba-8903-e957e34834cf None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:06.322628 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f816876a-8240-43ba-8903-e957e34834cf None admin] PATH_INFO: `/v3/domains` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:06.323625 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f816876a-8240-43ba-8903-e957e34834cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:06.324069 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f816876a-8240-43ba-8903-e957e34834cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:06.325770 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f816876a-8240-43ba-8903-e957e34834cf None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:06.336819 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990c6526-f7ed-43d9-a8a4-966574f6628d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:06.337518 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990c6526-f7ed-43d9-a8a4-966574f6628d None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:06.337880 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990c6526-f7ed-43d9-a8a4-966574f6628d None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:06.338232 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990c6526-f7ed-43d9-a8a4-966574f6628d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:06.340149 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 325/653] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 18 21:42:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:42:06.341321 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f816876a-8240-43ba-8903-e957e34834cf None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:06.440926 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990c6526-f7ed-43d9-a8a4-966574f6628d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:06.442750 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990c6526-f7ed-43d9-a8a4-966574f6628d None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:06.481436 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f816876a-8240-43ba-8903-e957e34834cf None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:06.527690 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2527402-6c69-42e9-b633-b87f5718c528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:06.528369 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2527402-6c69-42e9-b633-b87f5718c528 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:06.528735 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2527402-6c69-42e9-b633-b87f5718c528 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:06.528904 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2527402-6c69-42e9-b633-b87f5718c528 None admin] PATH_INFO: `/v3/domains` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:06.529514 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2527402-6c69-42e9-b633-b87f5718c528 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:06.529820 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2527402-6c69-42e9-b633-b87f5718c528 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:06.531206 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2527402-6c69-42e9-b633-b87f5718c528 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:06.550892 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 326/654] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 18 21:42:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:42:06.550892 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2527402-6c69-42e9-b633-b87f5718c528 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:06.570088 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 329/655] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Aug 18 21:42:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 21:42:06.571734 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990c6526-f7ed-43d9-a8a4-966574f6628d None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:06.574432 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:06.589666 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:06.683357 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2527402-6c69-42e9-b633-b87f5718c528 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:06.686395 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990c6526-f7ed-43d9-a8a4-966574f6628d None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:06.721275 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb463a24-fe8b-4ae6-a969-fe389c320607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:06.721913 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb463a24-fe8b-4ae6-a969-fe389c320607 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:06.722452 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb463a24-fe8b-4ae6-a969-fe389c320607 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:06.722452 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb463a24-fe8b-4ae6-a969-fe389c320607 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:06.727419 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7512cd5-6e50-4ca0-9ab3-18baee8595ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:06.728306 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7512cd5-6e50-4ca0-9ab3-18baee8595ad None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:06.728819 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7512cd5-6e50-4ca0-9ab3-18baee8595ad None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:06.729290 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7512cd5-6e50-4ca0-9ab3-18baee8595ad None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:06.730387 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb463a24-fe8b-4ae6-a969-fe389c320607 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:06.731856 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb463a24-fe8b-4ae6-a969-fe389c320607 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:06.737835 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7512cd5-6e50-4ca0-9ab3-18baee8595ad None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:06.739537 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7512cd5-6e50-4ca0-9ab3-18baee8595ad None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:06.743703 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application [None req-cb463a24-fe8b-4ae6-a969-fe389c320607 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 18 21:42:06.743703 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:06.743703 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:42:06.743703 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:42:06.743703 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:42:06.743703 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:42:06.743703 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:42:06.743703 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:42:06.743703 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:42:06.743703 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:42:06.743703 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:42:06.743703 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:42:06.743703 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 21:42:06.743703 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 21:42:06.743703 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 21:42:06.743703 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 21:42:06.744661 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:42:06.744661 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:42:06.744661 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 21:42:06.744661 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 21:42:06.744661 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 21:42:06.744661 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 21:42:06.744661 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:42:06.744661 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:42:06.744661 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:42:06.744661 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:42:06.744661 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:42:06.744661 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application with Lock( Aug 18 21:42:06.744661 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:42:06.744661 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:42:06.744661 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:42:06.744661 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:42:06.744661 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:42:06.744661 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:42:06.746247 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:42:06.746247 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:42:06.746247 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 21:42:06.746247 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 21:42:06.746247 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 21:42:06.746247 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 21:42:06.746247 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 21:42:06.746247 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 21:42:06.746247 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 18 21:42:06.746247 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:42:06.746247 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 327/656] 10.222.0.27 () {56 vars in 1102 bytes} [Thu Aug 18 21:42:06 2022] GET /identity/v3/users/neutron => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:42:06.746247 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb463a24-fe8b-4ae6-a969-fe389c320607 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:06.755839 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application [None req-a7512cd5-6e50-4ca0-9ab3-18baee8595ad None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 18 21:42:06.755839 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:06.755839 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:42:06.755839 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:42:06.755839 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:42:06.755839 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:42:06.755839 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:42:06.755839 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:42:06.755839 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:42:06.755839 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:42:06.755839 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:42:06.755839 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:42:06.755839 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 21:42:06.755839 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 21:42:06.755839 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 21:42:06.755839 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 21:42:06.756835 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:42:06.756835 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:42:06.756835 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 21:42:06.756835 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 21:42:06.756835 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 21:42:06.756835 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 21:42:06.756835 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:42:06.756835 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:42:06.756835 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:42:06.756835 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:42:06.756835 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:42:06.756835 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application with Lock( Aug 18 21:42:06.756835 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:42:06.756835 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:42:06.756835 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:42:06.756835 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:42:06.756835 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:42:06.756835 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:42:06.758386 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:42:06.758386 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:42:06.758386 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 21:42:06.758386 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 21:42:06.758386 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 21:42:06.758386 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 21:42:06.758386 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 21:42:06.758386 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 21:42:06.758386 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 18 21:42:06.758386 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:42:06.762040 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 330/657] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Aug 18 21:42:06 2022] GET /identity/v3/users/cinder => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:42:06.762877 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7512cd5-6e50-4ca0-9ab3-18baee8595ad None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:06.838543 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:06.851261 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:06.872144 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb463a24-fe8b-4ae6-a969-fe389c320607 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:06.895612 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7512cd5-6e50-4ca0-9ab3-18baee8595ad None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:06.917822 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41176ff8-2a8c-4d51-8182-67f3357d089c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:06.918446 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41176ff8-2a8c-4d51-8182-67f3357d089c None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:06.918771 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41176ff8-2a8c-4d51-8182-67f3357d089c None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:06.919042 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41176ff8-2a8c-4d51-8182-67f3357d089c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:06.932083 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41176ff8-2a8c-4d51-8182-67f3357d089c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:06.933695 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41176ff8-2a8c-4d51-8182-67f3357d089c None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:06.943231 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9264ee2-bdb7-4d24-9c39-0257f9b1d1ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:06.944411 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9264ee2-bdb7-4d24-9c39-0257f9b1d1ce None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:06.944919 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9264ee2-bdb7-4d24-9c39-0257f9b1d1ce None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:06.945416 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9264ee2-bdb7-4d24-9c39-0257f9b1d1ce None admin] PATH_INFO: `/v3/users` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:06.946343 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9264ee2-bdb7-4d24-9c39-0257f9b1d1ce None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:06.946847 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9264ee2-bdb7-4d24-9c39-0257f9b1d1ce None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:06.948565 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9264ee2-bdb7-4d24-9c39-0257f9b1d1ce None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:06.948871 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application [None req-41176ff8-2a8c-4d51-8182-67f3357d089c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:42:06.948871 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:06.948871 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:42:06.948871 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:42:06.948871 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:42:06.948871 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:42:06.948871 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:42:06.948871 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:42:06.948871 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:42:06.948871 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:42:06.948871 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:42:06.948871 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:42:06.948871 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 21:42:06.948871 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 21:42:06.948871 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 21:42:06.948871 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 21:42:06.949803 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:42:06.949803 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:42:06.949803 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:42:06.949803 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:42:06.949803 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:42:06.949803 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:42:06.949803 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:42:06.949803 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application with Lock( Aug 18 21:42:06.949803 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:42:06.949803 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:42:06.949803 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:42:06.949803 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:42:06.949803 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:42:06.949803 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:42:06.949803 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:42:06.949803 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:42:06.949803 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 21:42:06.950698 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 21:42:06.950698 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:42:06.950698 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:42:06.955149 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 328/658] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 18 21:42:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:42:06.956207 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41176ff8-2a8c-4d51-8182-67f3357d089c None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:06.973424 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 331/659] 10.222.0.27 () {56 vars in 1139 bytes} [Thu Aug 18 21:42:06 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:42:06.975017 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9264ee2-bdb7-4d24-9c39-0257f9b1d1ce None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:07.072767 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41176ff8-2a8c-4d51-8182-67f3357d089c None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:07.080760 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9264ee2-bdb7-4d24-9c39-0257f9b1d1ce None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:07.095750 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:07.103025 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:07.107320 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844b318e-19ed-42cc-a1cd-a81f313cac3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:07.110395 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844b318e-19ed-42cc-a1cd-a81f313cac3a None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:07.110395 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844b318e-19ed-42cc-a1cd-a81f313cac3a None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:07.110395 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844b318e-19ed-42cc-a1cd-a81f313cac3a None admin] PATH_INFO: `/v3/users` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:07.110395 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844b318e-19ed-42cc-a1cd-a81f313cac3a None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:07.110395 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844b318e-19ed-42cc-a1cd-a81f313cac3a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:07.111504 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844b318e-19ed-42cc-a1cd-a81f313cac3a None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:07.117612 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51539e7-bade-40ea-883f-0f0871c87721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:07.118214 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51539e7-bade-40ea-883f-0f0871c87721 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:07.118495 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51539e7-bade-40ea-883f-0f0871c87721 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:07.118768 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51539e7-bade-40ea-883f-0f0871c87721 None admin] PATH_INFO: `/v3/domains` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:07.119404 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51539e7-bade-40ea-883f-0f0871c87721 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:07.119712 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51539e7-bade-40ea-883f-0f0871c87721 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:07.121126 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51539e7-bade-40ea-883f-0f0871c87721 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:07.135129 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 329/660] 10.222.0.27 () {56 vars in 1137 bytes} [Thu Aug 18 21:42:06 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:42:07.135129 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844b318e-19ed-42cc-a1cd-a81f313cac3a None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:07.138156 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 332/661] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 18 21:42:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:42:07.141376 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eba3dc2-34e3-4d34-b223-380148635de7 None None] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:07.141376 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eba3dc2-34e3-4d34-b223-380148635de7 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:07.141376 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eba3dc2-34e3-4d34-b223-380148635de7 None None] PATH_INFO: `/` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:07.144880 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 333/662] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:42:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:42:07.145838 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eba3dc2-34e3-4d34-b223-380148635de7 None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:07.237264 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844b318e-19ed-42cc-a1cd-a81f313cac3a None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:07.255469 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eba3dc2-34e3-4d34-b223-380148635de7 None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:07.277880 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7270869d-e4c1-40e9-aed2-89373ce1a030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:07.278824 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7270869d-e4c1-40e9-aed2-89373ce1a030 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:07.279356 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7270869d-e4c1-40e9-aed2-89373ce1a030 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:07.279785 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7270869d-e4c1-40e9-aed2-89373ce1a030 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:07.298460 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8181ac1-dc93-4ee0-ac92-4ec8b7ede5bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:07.299061 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8181ac1-dc93-4ee0-ac92-4ec8b7ede5bc None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:07.299338 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8181ac1-dc93-4ee0-ac92-4ec8b7ede5bc None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:07.299605 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8181ac1-dc93-4ee0-ac92-4ec8b7ede5bc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:07.333753 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:07.352536 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7270869d-e4c1-40e9-aed2-89373ce1a030 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:07.352738 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:07.354230 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7270869d-e4c1-40e9-aed2-89373ce1a030 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:07.373080 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8181ac1-dc93-4ee0-ac92-4ec8b7ede5bc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:07.374549 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8181ac1-dc93-4ee0-ac92-4ec8b7ede5bc None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:07.463639 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 330/663] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Aug 18 21:42:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 21:42:07.464473 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7270869d-e4c1-40e9-aed2-89373ce1a030 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:07.490248 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 334/664] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Aug 18 21:42:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 21:42:07.491825 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9118ec21-dd20-4027-b4b3-271a5694276d None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:07.492318 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9118ec21-dd20-4027-b4b3-271a5694276d None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:07.492818 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9118ec21-dd20-4027-b4b3-271a5694276d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:07.510613 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-9118ec21-dd20-4027-b4b3-271a5694276d None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:42:07.511817 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-9118ec21-dd20-4027-b4b3-271a5694276d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:42:07.555184 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:07.577151 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7270869d-e4c1-40e9-aed2-89373ce1a030 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:07.580524 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 335/665] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:42:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 21:42:07.581444 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9118ec21-dd20-4027-b4b3-271a5694276d None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:07.597351 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:07.621773 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74b7001-4e99-445f-b788-fb7f3854212b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:07.622406 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74b7001-4e99-445f-b788-fb7f3854212b None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:07.623453 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74b7001-4e99-445f-b788-fb7f3854212b None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:07.623453 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74b7001-4e99-445f-b788-fb7f3854212b None admin] PATH_INFO: `/v3/projects/service` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:07.631244 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74b7001-4e99-445f-b788-fb7f3854212b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:07.632819 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74b7001-4e99-445f-b788-fb7f3854212b None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:07.645611 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application [None req-a74b7001-4e99-445f-b788-fb7f3854212b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 21:42:07.645611 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:07.645611 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:42:07.645611 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:42:07.645611 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:42:07.645611 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:42:07.645611 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:42:07.645611 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:42:07.645611 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:42:07.645611 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:42:07.645611 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:42:07.645611 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:42:07.645611 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 21:42:07.645611 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 21:42:07.645611 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 21:42:07.646535 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 21:42:07.646535 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:42:07.646535 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:42:07.646535 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:42:07.646535 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:42:07.646535 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:42:07.646535 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:42:07.646535 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:42:07.646535 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application with Lock( Aug 18 21:42:07.646535 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:42:07.646535 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:42:07.646535 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:42:07.646535 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:42:07.646535 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:42:07.646535 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:42:07.646535 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:42:07.646535 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:42:07.647422 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 21:42:07.647422 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 21:42:07.647422 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 21:42:07.647422 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 21:42:07.647422 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 21:42:07.647422 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 21:42:07.647422 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 21:42:07.647422 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:42:07.647422 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 331/666] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Aug 18 21:42:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:42:07.647896 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74b7001-4e99-445f-b788-fb7f3854212b None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:07.696934 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9118ec21-dd20-4027-b4b3-271a5694276d None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:07.735369 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1694b7c-aa54-439e-bf61-31f72ec9c302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:07.736355 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1694b7c-aa54-439e-bf61-31f72ec9c302 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:07.736871 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1694b7c-aa54-439e-bf61-31f72ec9c302 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:07.737300 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1694b7c-aa54-439e-bf61-31f72ec9c302 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:07.748510 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1694b7c-aa54-439e-bf61-31f72ec9c302 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:07.750197 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1694b7c-aa54-439e-bf61-31f72ec9c302 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:07.758028 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74b7001-4e99-445f-b788-fb7f3854212b None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:07.767183 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application [None req-d1694b7c-aa54-439e-bf61-31f72ec9c302 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:42:07.767183 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:07.767183 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:42:07.767183 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:42:07.767183 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:42:07.767183 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:42:07.767183 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:42:07.767183 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:42:07.767183 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:42:07.767183 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:42:07.767183 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:42:07.767183 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:42:07.767183 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 21:42:07.767183 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 21:42:07.767183 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 21:42:07.767183 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 21:42:07.768367 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:42:07.768367 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:42:07.768367 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:42:07.768367 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:42:07.768367 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:42:07.768367 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:42:07.768367 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:42:07.768367 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application with Lock( Aug 18 21:42:07.768367 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:42:07.768367 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:42:07.768367 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:42:07.768367 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:42:07.768367 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:42:07.768367 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:42:07.768367 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:42:07.768367 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:42:07.768367 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 21:42:07.769499 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 21:42:07.769499 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:42:07.769499 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:42:07.771307 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 336/667] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 18 21:42:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:42:07.772353 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1694b7c-aa54-439e-bf61-31f72ec9c302 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:07.797998 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e13ce54-0d0b-4d1d-aca5-38fc39104e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:07.798847 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e13ce54-0d0b-4d1d-aca5-38fc39104e20 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:07.799228 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e13ce54-0d0b-4d1d-aca5-38fc39104e20 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:07.799601 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e13ce54-0d0b-4d1d-aca5-38fc39104e20 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:07.810310 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e13ce54-0d0b-4d1d-aca5-38fc39104e20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:07.811899 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e13ce54-0d0b-4d1d-aca5-38fc39104e20 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:07.814378 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:07.829060 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application [None req-9e13ce54-0d0b-4d1d-aca5-38fc39104e20 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:42:07.829060 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:07.829060 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:42:07.829060 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:42:07.829060 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:42:07.829060 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:42:07.829060 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:42:07.829060 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:42:07.829060 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:42:07.829060 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:42:07.829060 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:42:07.829060 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:42:07.829060 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 21:42:07.829060 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 21:42:07.829060 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 21:42:07.829060 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 21:42:07.830361 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:42:07.830361 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:42:07.830361 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:42:07.830361 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:42:07.830361 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:42:07.830361 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:42:07.830361 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:42:07.830361 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application with Lock( Aug 18 21:42:07.830361 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:42:07.830361 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:42:07.830361 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:42:07.830361 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:42:07.830361 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:42:07.830361 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:42:07.830361 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:42:07.830361 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:42:07.830361 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 21:42:07.831496 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 21:42:07.831496 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:42:07.831496 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:42:07.837078 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 332/668] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 18 21:42:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:42:07.837078 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e13ce54-0d0b-4d1d-aca5-38fc39104e20 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:07.866956 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:07.894290 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1694b7c-aa54-439e-bf61-31f72ec9c302 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:07.934556 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ffbd11-d1ff-4602-bdc4-a50068b50bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:07.935277 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ffbd11-d1ff-4602-bdc4-a50068b50bb6 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:07.935562 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ffbd11-d1ff-4602-bdc4-a50068b50bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:07.935970 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ffbd11-d1ff-4602-bdc4-a50068b50bb6 None admin] PATH_INFO: `/v3/projects` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:07.936651 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ffbd11-d1ff-4602-bdc4-a50068b50bb6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:07.936961 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ffbd11-d1ff-4602-bdc4-a50068b50bb6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:07.938859 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e13ce54-0d0b-4d1d-aca5-38fc39104e20 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:07.938985 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ffbd11-d1ff-4602-bdc4-a50068b50bb6 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:07.956838 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 337/669] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Aug 18 21:42:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:42:07.958213 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ffbd11-d1ff-4602-bdc4-a50068b50bb6 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:07.973881 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0752ffb4-ca1c-4982-859e-bd2373045de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:07.974487 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0752ffb4-ca1c-4982-859e-bd2373045de3 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:07.974763 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0752ffb4-ca1c-4982-859e-bd2373045de3 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:07.975031 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0752ffb4-ca1c-4982-859e-bd2373045de3 None admin] PATH_INFO: `/v3/domains` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:07.975665 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0752ffb4-ca1c-4982-859e-bd2373045de3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:07.975962 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0752ffb4-ca1c-4982-859e-bd2373045de3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:07.977374 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0752ffb4-ca1c-4982-859e-bd2373045de3 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:07.989207 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 333/670] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 18 21:42:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:42:07.990013 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0752ffb4-ca1c-4982-859e-bd2373045de3 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:08.050142 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:08.075162 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ffbd11-d1ff-4602-bdc4-a50068b50bb6 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:08.096729 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0752ffb4-ca1c-4982-859e-bd2373045de3 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:08.102733 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:08.115643 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4e441a-982a-4ff9-ae04-053b272293be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:08.116835 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4e441a-982a-4ff9-ae04-053b272293be None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:08.117342 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4e441a-982a-4ff9-ae04-053b272293be None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:08.118091 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4e441a-982a-4ff9-ae04-053b272293be None admin] PATH_INFO: `/v3/domains` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:08.119302 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4e441a-982a-4ff9-ae04-053b272293be None admin] RBAC: Adding query filter params (name=Default) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:08.119883 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4e441a-982a-4ff9-ae04-053b272293be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:08.122114 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4e441a-982a-4ff9-ae04-053b272293be None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:08.136533 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca72f092-1b2a-495a-9165-e5f9e079563e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:08.137183 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca72f092-1b2a-495a-9165-e5f9e079563e None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:08.137562 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 338/671] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 18 21:42:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:42:08.138388 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4e441a-982a-4ff9-ae04-053b272293be None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:08.142696 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca72f092-1b2a-495a-9165-e5f9e079563e None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:08.142993 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca72f092-1b2a-495a-9165-e5f9e079563e None admin] PATH_INFO: `/v3/roles/service` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:08.155206 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca72f092-1b2a-495a-9165-e5f9e079563e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:42:08.160326 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application [None req-ca72f092-1b2a-495a-9165-e5f9e079563e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 21:42:08.160326 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:08.160326 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:42:08.160326 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:42:08.160326 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:42:08.160326 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:42:08.160326 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:42:08.160326 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:42:08.160326 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:42:08.160326 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:42:08.160326 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:42:08.160326 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:42:08.160326 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:42:08.160326 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:42:08.160326 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:42:08.160326 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:42:08.161412 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:42:08.161412 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:42:08.161412 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:42:08.161412 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:42:08.161412 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:42:08.161412 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:42:08.161412 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:42:08.161412 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:42:08.161412 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:42:08.161412 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:42:08.161412 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:42:08.161412 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application with Lock( Aug 18 21:42:08.161412 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:42:08.161412 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:42:08.161412 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:42:08.161412 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:42:08.162324 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:42:08.162324 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:42:08.162324 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:42:08.162324 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:42:08.162324 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:42:08.162324 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:42:08.162324 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:42:08.162324 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:42:08.162324 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:42:08.162324 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:42:08.162324 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 21:42:08.162324 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:42:08.162324 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 334/672] 10.222.0.27 () {56 vars in 1102 bytes} [Thu Aug 18 21:42:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:42:08.162324 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca72f092-1b2a-495a-9165-e5f9e079563e None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:08.250567 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4e441a-982a-4ff9-ae04-053b272293be None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:08.269694 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca72f092-1b2a-495a-9165-e5f9e079563e None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:08.283488 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:08.285045 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001f31fe-79dc-4267-9043-a62bc5de4ec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:08.285652 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001f31fe-79dc-4267-9043-a62bc5de4ec5 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:08.285935 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001f31fe-79dc-4267-9043-a62bc5de4ec5 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:08.286211 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001f31fe-79dc-4267-9043-a62bc5de4ec5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:08.286935 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001f31fe-79dc-4267-9043-a62bc5de4ec5 None admin] RBAC: Adding query filter params (role.id=30d8ac11e30e4b1d83940485e98d147c, scope.project.id=4b54801b90484d689034f838f85fc0a4, user.id=85dfef6a910547da9706d294e7d40fd0) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:08.287244 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001f31fe-79dc-4267-9043-a62bc5de4ec5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:08.288709 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001f31fe-79dc-4267-9043-a62bc5de4ec5 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:08.294742 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 339/673] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Aug 18 21:42:08 2022] GET /identity/v3/role_assignments?user.id=85dfef6a910547da9706d294e7d40fd0&scope.project.id=4b54801b90484d689034f838f85fc0a4&role.id=30d8ac11e30e4b1d83940485e98d147c => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:42:08.298910 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001f31fe-79dc-4267-9043-a62bc5de4ec5 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:08.307907 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e0c2ea-f1a3-4885-8ebc-e7964156f858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:08.308558 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e0c2ea-f1a3-4885-8ebc-e7964156f858 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:08.308865 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e0c2ea-f1a3-4885-8ebc-e7964156f858 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:08.309136 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e0c2ea-f1a3-4885-8ebc-e7964156f858 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:08.317290 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e0c2ea-f1a3-4885-8ebc-e7964156f858 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:08.318772 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e0c2ea-f1a3-4885-8ebc-e7964156f858 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:08.332171 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application [None req-26e0c2ea-f1a3-4885-8ebc-e7964156f858 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 21:42:08.332171 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:08.332171 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:42:08.332171 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:42:08.332171 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:42:08.332171 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:42:08.332171 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:42:08.332171 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:42:08.332171 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:42:08.332171 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:42:08.332171 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:42:08.332171 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:42:08.332171 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 21:42:08.332171 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 21:42:08.332171 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 21:42:08.333369 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 21:42:08.333369 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:42:08.333369 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:42:08.333369 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:42:08.333369 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:42:08.333369 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:42:08.333369 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:42:08.333369 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:42:08.333369 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application with Lock( Aug 18 21:42:08.333369 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:42:08.333369 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:42:08.333369 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:42:08.333369 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:42:08.333369 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:42:08.333369 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:42:08.333369 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:42:08.333369 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:42:08.334465 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 21:42:08.334465 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 21:42:08.334465 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 21:42:08.334465 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 21:42:08.334465 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 21:42:08.334465 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 21:42:08.334465 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 21:42:08.334465 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:42:08.336498 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 335/674] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Aug 18 21:42:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:42:08.337453 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e0c2ea-f1a3-4885-8ebc-e7964156f858 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:08.366287 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:08.430531 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001f31fe-79dc-4267-9043-a62bc5de4ec5 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:08.456989 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e0c2ea-f1a3-4885-8ebc-e7964156f858 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:08.476216 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6fe6e6-8963-4b1d-af31-1725aa8602bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:08.477138 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6fe6e6-8963-4b1d-af31-1725aa8602bc None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:08.477421 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6fe6e6-8963-4b1d-af31-1725aa8602bc None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:08.477695 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6fe6e6-8963-4b1d-af31-1725aa8602bc None admin] PATH_INFO: `/v3/projects/service` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:08.486070 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6fe6e6-8963-4b1d-af31-1725aa8602bc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:08.487526 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6fe6e6-8963-4b1d-af31-1725aa8602bc None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:08.497143 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f661e28-befd-4bcc-b89f-24b2ddfd5229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:08.497746 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f661e28-befd-4bcc-b89f-24b2ddfd5229 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:08.498025 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f661e28-befd-4bcc-b89f-24b2ddfd5229 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:08.498294 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f661e28-befd-4bcc-b89f-24b2ddfd5229 None admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:08.498955 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f661e28-befd-4bcc-b89f-24b2ddfd5229 None admin] RBAC: Adding query filter params (name=service) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:08.499181 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application [None req-0a6fe6e6-8963-4b1d-af31-1725aa8602bc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 21:42:08.499181 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:08.499181 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:42:08.499181 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:42:08.499181 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:42:08.499181 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:42:08.499181 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:42:08.499181 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:42:08.499181 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:42:08.499181 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:42:08.499181 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:42:08.499181 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:42:08.499181 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 21:42:08.499181 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 21:42:08.499181 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 21:42:08.500011 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 21:42:08.500011 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:42:08.500011 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:42:08.500011 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:42:08.500011 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:42:08.500011 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:42:08.500011 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:42:08.500011 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:42:08.500011 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application with Lock( Aug 18 21:42:08.500011 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:42:08.500011 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:42:08.500011 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:42:08.500011 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:42:08.500011 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:42:08.500011 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:42:08.500011 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:42:08.500011 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:42:08.501784 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 21:42:08.501784 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 21:42:08.501784 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 21:42:08.501784 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 21:42:08.501784 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 21:42:08.501784 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 21:42:08.501784 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 21:42:08.501784 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:42:08.502810 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f661e28-befd-4bcc-b89f-24b2ddfd5229 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:08.502810 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f661e28-befd-4bcc-b89f-24b2ddfd5229 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:08.505733 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 340/675] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Aug 18 21:42:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:42:08.507603 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a2d2af-9c3f-4cab-a765-ede8a19df73a None None] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:08.507603 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a2d2af-9c3f-4cab-a765-ede8a19df73a None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:08.507940 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a2d2af-9c3f-4cab-a765-ede8a19df73a None None] PATH_INFO: `/` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:08.511839 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 336/676] 10.222.0.27 () {56 vars in 1103 bytes} [Thu Aug 18 21:42:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:42:08.513117 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f661e28-befd-4bcc-b89f-24b2ddfd5229 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:08.513340 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 341/677] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:42:08 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:42:08.514070 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a2d2af-9c3f-4cab-a765-ede8a19df73a None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:08.552103 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:08.626672 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a2d2af-9c3f-4cab-a765-ede8a19df73a None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:08.629066 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f661e28-befd-4bcc-b89f-24b2ddfd5229 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:08.635785 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:08.666597 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa259e0-f5c5-47b0-b169-97ca14abded6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:08.667204 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa259e0-f5c5-47b0-b169-97ca14abded6 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:08.667479 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa259e0-f5c5-47b0-b169-97ca14abded6 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:08.667644 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee436f17-5948-42ca-a8f1-13031a5e7897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:08.667754 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa259e0-f5c5-47b0-b169-97ca14abded6 None admin] PATH_INFO: `/v3/projects` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:08.668232 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee436f17-5948-42ca-a8f1-13031a5e7897 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:08.668425 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa259e0-f5c5-47b0-b169-97ca14abded6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:08.668521 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee436f17-5948-42ca-a8f1-13031a5e7897 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:08.668753 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa259e0-f5c5-47b0-b169-97ca14abded6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:08.668848 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee436f17-5948-42ca-a8f1-13031a5e7897 None admin] PATH_INFO: `/v3/projects` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:08.669490 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee436f17-5948-42ca-a8f1-13031a5e7897 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:08.670177 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa259e0-f5c5-47b0-b169-97ca14abded6 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:08.670285 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee436f17-5948-42ca-a8f1-13031a5e7897 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:08.671794 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee436f17-5948-42ca-a8f1-13031a5e7897 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:08.683191 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 337/678] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Aug 18 21:42:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:42:08.684312 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b913ec-6796-4efc-b757-043241d8ea04 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:08.684615 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b913ec-6796-4efc-b757-043241d8ea04 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:08.684894 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b913ec-6796-4efc-b757-043241d8ea04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:08.690898 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 342/679] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Aug 18 21:42:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:42:08.691958 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee436f17-5948-42ca-a8f1-13031a5e7897 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:08.707374 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-45b913ec-6796-4efc-b757-043241d8ea04 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:42:08.708555 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-45b913ec-6796-4efc-b757-043241d8ea04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:42:08.792744 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 338/680] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:42:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 21:42:08.793637 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b913ec-6796-4efc-b757-043241d8ea04 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:08.800351 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee436f17-5948-42ca-a8f1-13031a5e7897 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:08.829452 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:08.847786 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c32a7d-565c-428f-83af-abcdd6362fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:08.848813 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c32a7d-565c-428f-83af-abcdd6362fb8 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:08.849645 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c32a7d-565c-428f-83af-abcdd6362fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:08.850128 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c32a7d-565c-428f-83af-abcdd6362fb8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:08.865479 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c32a7d-565c-428f-83af-abcdd6362fb8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:08.868102 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c32a7d-565c-428f-83af-abcdd6362fb8 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:08.888881 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application [None req-72c32a7d-565c-428f-83af-abcdd6362fb8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:42:08.888881 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:08.888881 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:42:08.888881 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:42:08.888881 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:42:08.888881 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:42:08.888881 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:42:08.888881 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:42:08.888881 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:42:08.888881 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:42:08.888881 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:42:08.888881 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:42:08.888881 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 21:42:08.888881 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 21:42:08.888881 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 21:42:08.888881 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 21:42:08.889860 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:42:08.889860 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:42:08.889860 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:42:08.889860 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:42:08.889860 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:42:08.889860 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:42:08.889860 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:42:08.889860 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application with Lock( Aug 18 21:42:08.889860 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:42:08.889860 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:42:08.889860 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:42:08.889860 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:42:08.889860 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:42:08.889860 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:42:08.889860 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:42:08.889860 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:42:08.889860 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 21:42:08.891717 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 21:42:08.891717 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:42:08.891717 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:42:08.891717 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 343/681] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 18 21:42:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:42:08.892671 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c32a7d-565c-428f-83af-abcdd6362fb8 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:08.913122 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:08.925610 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b913ec-6796-4efc-b757-043241d8ea04 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:08.962513 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058d0425-3c01-4d2f-afd0-e1cd0926cc0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:08.963517 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058d0425-3c01-4d2f-afd0-e1cd0926cc0b None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:08.963996 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058d0425-3c01-4d2f-afd0-e1cd0926cc0b None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:08.964483 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058d0425-3c01-4d2f-afd0-e1cd0926cc0b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:08.965473 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058d0425-3c01-4d2f-afd0-e1cd0926cc0b None admin] RBAC: Adding query filter params (role.id=30d8ac11e30e4b1d83940485e98d147c, scope.project.id=4b54801b90484d689034f838f85fc0a4, user.id=6a937971ad1a4b0c8697c764f214d446) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:08.965979 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058d0425-3c01-4d2f-afd0-e1cd0926cc0b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:08.967664 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058d0425-3c01-4d2f-afd0-e1cd0926cc0b None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:08.981023 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 339/682] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Aug 18 21:42:08 2022] GET /identity/v3/role_assignments?user.id=6a937971ad1a4b0c8697c764f214d446&scope.project.id=4b54801b90484d689034f838f85fc0a4&role.id=30d8ac11e30e4b1d83940485e98d147c => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:42:08.982414 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058d0425-3c01-4d2f-afd0-e1cd0926cc0b None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:09.002470 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c32a7d-565c-428f-83af-abcdd6362fb8 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:09.066410 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc997b0-413f-4bfb-96f3-278fa9739bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:09.067023 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc997b0-413f-4bfb-96f3-278fa9739bb9 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:09.067366 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc997b0-413f-4bfb-96f3-278fa9739bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:09.067638 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc997b0-413f-4bfb-96f3-278fa9739bb9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:09.068426 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc997b0-413f-4bfb-96f3-278fa9739bb9 None admin] RBAC: Adding query filter params (role.id=30d8ac11e30e4b1d83940485e98d147c, scope.project.id=4b54801b90484d689034f838f85fc0a4, user.id=22b6a7c36f8a4795a75271b8079821c7) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:09.068772 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc997b0-413f-4bfb-96f3-278fa9739bb9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:09.070228 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc997b0-413f-4bfb-96f3-278fa9739bb9 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:09.076928 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 344/683] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Aug 18 21:42:08 2022] GET /identity/v3/role_assignments?user.id=22b6a7c36f8a4795a75271b8079821c7&scope.project.id=4b54801b90484d689034f838f85fc0a4&role.id=30d8ac11e30e4b1d83940485e98d147c => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:42:09.077855 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc997b0-413f-4bfb-96f3-278fa9739bb9 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:09.127642 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:09.138095 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058d0425-3c01-4d2f-afd0-e1cd0926cc0b None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:09.180101 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:09.196417 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6182b0d-92d0-4907-9728-82bfe048324f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:09.199099 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6182b0d-92d0-4907-9728-82bfe048324f None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:09.199367 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6182b0d-92d0-4907-9728-82bfe048324f None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:09.199646 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6182b0d-92d0-4907-9728-82bfe048324f None admin] PATH_INFO: `/v3/domains` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:09.200349 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6182b0d-92d0-4907-9728-82bfe048324f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:09.200676 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6182b0d-92d0-4907-9728-82bfe048324f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:09.206256 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6182b0d-92d0-4907-9728-82bfe048324f None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:09.221030 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc997b0-413f-4bfb-96f3-278fa9739bb9 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:09.239004 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 340/684] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 18 21:42:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:42:09.244390 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6182b0d-92d0-4907-9728-82bfe048324f None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:09.301960 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc96676e-4de0-4edd-b859-8ab06024a50a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:09.302654 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc96676e-4de0-4edd-b859-8ab06024a50a None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:09.302940 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc96676e-4de0-4edd-b859-8ab06024a50a None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:09.303277 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc96676e-4de0-4edd-b859-8ab06024a50a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:09.316240 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc96676e-4de0-4edd-b859-8ab06024a50a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:42:09.321607 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application [None req-fc96676e-4de0-4edd-b859-8ab06024a50a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 21:42:09.321607 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:09.321607 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:42:09.321607 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:42:09.321607 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:42:09.321607 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:42:09.321607 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:42:09.321607 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:42:09.321607 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:42:09.321607 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:42:09.321607 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:42:09.321607 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:42:09.321607 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:42:09.321607 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:42:09.321607 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:42:09.321607 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:42:09.322704 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:42:09.322704 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:42:09.322704 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:42:09.322704 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:42:09.322704 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:42:09.322704 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:42:09.322704 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:42:09.322704 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:42:09.322704 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:42:09.322704 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:42:09.322704 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:42:09.322704 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application with Lock( Aug 18 21:42:09.322704 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:42:09.322704 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:42:09.322704 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:42:09.322704 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:42:09.323544 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:42:09.323544 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:42:09.323544 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:42:09.323544 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:42:09.323544 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:42:09.323544 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:42:09.323544 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:42:09.323544 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:42:09.323544 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:42:09.323544 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:42:09.323544 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 21:42:09.323544 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:42:09.323544 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 345/685] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Aug 18 21:42:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:42:09.330729 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc96676e-4de0-4edd-b859-8ab06024a50a None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:09.395329 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6182b0d-92d0-4907-9728-82bfe048324f None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:09.432085 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffc4ae3-b23c-4741-bbe4-935627ddca17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:09.433147 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffc4ae3-b23c-4741-bbe4-935627ddca17 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:09.433640 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffc4ae3-b23c-4741-bbe4-935627ddca17 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:09.434104 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffc4ae3-b23c-4741-bbe4-935627ddca17 None admin] PATH_INFO: `/v3/users/swift` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:09.442228 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffc4ae3-b23c-4741-bbe4-935627ddca17 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:09.443969 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffc4ae3-b23c-4741-bbe4-935627ddca17 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:09.456553 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application [None req-0ffc4ae3-b23c-4741-bbe4-935627ddca17 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 18 21:42:09.456553 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:09.456553 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:42:09.456553 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:42:09.456553 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:42:09.456553 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:42:09.456553 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:42:09.456553 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:42:09.456553 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:42:09.456553 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:42:09.456553 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:42:09.456553 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:42:09.456553 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 21:42:09.456553 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 21:42:09.456553 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 21:42:09.456553 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 21:42:09.457537 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:42:09.457537 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:42:09.457537 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 21:42:09.457537 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 21:42:09.457537 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 21:42:09.457537 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 21:42:09.457537 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:42:09.457537 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:42:09.457537 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:42:09.457537 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:42:09.457537 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:42:09.457537 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application with Lock( Aug 18 21:42:09.457537 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:42:09.457537 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:42:09.457537 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:42:09.457537 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:42:09.457537 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:42:09.457537 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:42:09.458470 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:42:09.458470 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:42:09.458470 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 21:42:09.458470 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 21:42:09.458470 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 21:42:09.458470 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 21:42:09.458470 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 21:42:09.458470 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 21:42:09.458470 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 18 21:42:09.458470 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:42:09.460975 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 341/686] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Aug 18 21:42:09 2022] GET /identity/v3/users/swift => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 21:42:09.462770 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc96676e-4de0-4edd-b859-8ab06024a50a None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:09.477740 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffc4ae3-b23c-4741-bbe4-935627ddca17 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:09.509104 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:09.523517 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267150a8-b9be-453f-99ed-9751f9efae8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:09.524140 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267150a8-b9be-453f-99ed-9751f9efae8b None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:09.524420 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267150a8-b9be-453f-99ed-9751f9efae8b None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:09.526725 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267150a8-b9be-453f-99ed-9751f9efae8b None admin] PATH_INFO: `/v3/roles` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:09.526725 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267150a8-b9be-453f-99ed-9751f9efae8b None admin] RBAC: Adding query filter params (name=admin) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:09.526725 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267150a8-b9be-453f-99ed-9751f9efae8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:09.527560 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267150a8-b9be-453f-99ed-9751f9efae8b None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:09.539712 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 346/687] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Aug 18 21:42:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:42:09.549593 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267150a8-b9be-453f-99ed-9751f9efae8b None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:09.568967 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:09.620824 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffc4ae3-b23c-4741-bbe4-935627ddca17 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:09.658232 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a8c5a7-f430-43b7-8e89-ea2ede63e5e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:09.658860 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a8c5a7-f430-43b7-8e89-ea2ede63e5e7 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:09.659100 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a8c5a7-f430-43b7-8e89-ea2ede63e5e7 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:09.659374 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a8c5a7-f430-43b7-8e89-ea2ede63e5e7 None admin] PATH_INFO: `/v3/users` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:09.664615 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a8c5a7-f430-43b7-8e89-ea2ede63e5e7 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:09.664615 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a8c5a7-f430-43b7-8e89-ea2ede63e5e7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:09.664615 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a8c5a7-f430-43b7-8e89-ea2ede63e5e7 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:09.683784 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 342/688] 10.222.0.27 () {56 vars in 1135 bytes} [Thu Aug 18 21:42:09 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:42:09.696463 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a8c5a7-f430-43b7-8e89-ea2ede63e5e7 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:09.785057 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:09.812620 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a8c5a7-f430-43b7-8e89-ea2ede63e5e7 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:09.870604 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267150a8-b9be-453f-99ed-9751f9efae8b None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:09.884619 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dc3d0e-27b7-43cc-9956-3131782df300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:09.884619 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dc3d0e-27b7-43cc-9956-3131782df300 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:09.884619 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dc3d0e-27b7-43cc-9956-3131782df300 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:09.884619 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dc3d0e-27b7-43cc-9956-3131782df300 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:09.953420 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a115db-0193-4952-8249-256435c36dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:09.954052 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a115db-0193-4952-8249-256435c36dad None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:09.954329 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a115db-0193-4952-8249-256435c36dad None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:09.954597 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a115db-0193-4952-8249-256435c36dad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:09.967673 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a115db-0193-4952-8249-256435c36dad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:09.972298 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a115db-0193-4952-8249-256435c36dad None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:09.999849 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application [None req-29a115db-0193-4952-8249-256435c36dad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:42:09.999849 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:09.999849 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:42:09.999849 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:42:09.999849 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:42:09.999849 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:42:09.999849 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:42:09.999849 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:42:09.999849 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:42:09.999849 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:42:09.999849 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:42:09.999849 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:42:09.999849 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 21:42:09.999849 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 21:42:09.999849 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 21:42:09.999849 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 21:42:10.001084 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:42:10.001084 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:42:10.001084 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:42:10.001084 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:42:10.001084 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:42:10.001084 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:42:10.001084 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:42:10.001084 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application with Lock( Aug 18 21:42:10.001084 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:42:10.001084 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:42:10.001084 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:42:10.001084 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:42:10.001084 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:42:10.001084 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:42:10.001084 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:42:10.001084 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:42:10.001084 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 21:42:10.002014 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 21:42:10.002014 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:42:10.002014 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:42:10.015687 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 347/689] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 18 21:42:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 464 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:42:10.015687 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a115db-0193-4952-8249-256435c36dad None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:10.044693 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dc3d0e-27b7-43cc-9956-3131782df300 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:10.044693 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dc3d0e-27b7-43cc-9956-3131782df300 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:10.141884 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:10.189435 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:10.240997 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a115db-0193-4952-8249-256435c36dad None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:10.269394 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 343/690] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Aug 18 21:42:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 573 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 21:42:10.275231 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dc3d0e-27b7-43cc-9956-3131782df300 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:10.323581 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e61bc9-41d4-404e-880a-ec445418e293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:10.324576 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e61bc9-41d4-404e-880a-ec445418e293 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:10.325079 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e61bc9-41d4-404e-880a-ec445418e293 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:10.325680 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e61bc9-41d4-404e-880a-ec445418e293 None admin] PATH_INFO: `/v3/domains` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:10.326579 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e61bc9-41d4-404e-880a-ec445418e293 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:10.329135 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e61bc9-41d4-404e-880a-ec445418e293 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:10.332342 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e61bc9-41d4-404e-880a-ec445418e293 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:10.367357 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 348/691] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 18 21:42:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:42:10.377906 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e61bc9-41d4-404e-880a-ec445418e293 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:10.495199 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dc3d0e-27b7-43cc-9956-3131782df300 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:10.545073 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e61bc9-41d4-404e-880a-ec445418e293 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:10.564219 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:10.584368 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d6ecc3-1a96-44e9-a255-c88205119638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:10.584368 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d6ecc3-1a96-44e9-a255-c88205119638 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:10.584368 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d6ecc3-1a96-44e9-a255-c88205119638 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:10.584368 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d6ecc3-1a96-44e9-a255-c88205119638 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:10.599792 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d6ecc3-1a96-44e9-a255-c88205119638 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:10.601628 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d6ecc3-1a96-44e9-a255-c88205119638 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:10.608015 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3404ff91-d3f5-42c4-a6e2-022636421ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:10.608681 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3404ff91-d3f5-42c4-a6e2-022636421ffc None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:10.608966 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3404ff91-d3f5-42c4-a6e2-022636421ffc None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:10.609247 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3404ff91-d3f5-42c4-a6e2-022636421ffc None admin] PATH_INFO: `/v3/users/nova` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:10.622218 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3404ff91-d3f5-42c4-a6e2-022636421ffc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:10.623351 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application [None req-34d6ecc3-1a96-44e9-a255-c88205119638 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:42:10.623351 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:10.623351 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:42:10.623351 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:42:10.623351 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:42:10.623351 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:42:10.623351 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:42:10.623351 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:42:10.623351 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:42:10.623351 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:42:10.623351 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:42:10.623351 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:42:10.623351 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 21:42:10.623351 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 21:42:10.623351 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 21:42:10.623351 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 21:42:10.624279 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:42:10.624279 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:42:10.624279 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:42:10.624279 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:42:10.624279 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:42:10.624279 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:42:10.624279 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:42:10.624279 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application with Lock( Aug 18 21:42:10.624279 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:42:10.624279 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:42:10.624279 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:42:10.624279 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:42:10.624279 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:42:10.624279 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:42:10.624279 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:42:10.624279 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:42:10.624279 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 21:42:10.625739 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 21:42:10.625739 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:42:10.625739 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:42:10.625924 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3404ff91-d3f5-42c4-a6e2-022636421ffc None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:10.632945 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 344/692] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 18 21:42:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 354 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:42:10.634603 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f724d15-d829-455d-aae8-956c6b66c7ad None None] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:10.635037 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f724d15-d829-455d-aae8-956c6b66c7ad None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:10.635460 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f724d15-d829-455d-aae8-956c6b66c7ad None None] PATH_INFO: `/` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:10.637158 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 345/693] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:42:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:42:10.637992 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f724d15-d829-455d-aae8-956c6b66c7ad None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:10.643168 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application [None req-3404ff91-d3f5-42c4-a6e2-022636421ffc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 18 21:42:10.643168 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:10.643168 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:42:10.643168 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:42:10.643168 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:42:10.643168 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:42:10.643168 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:42:10.643168 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:42:10.643168 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:42:10.643168 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:42:10.643168 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:42:10.643168 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:42:10.643168 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 21:42:10.643168 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 21:42:10.643168 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 21:42:10.643168 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 21:42:10.644124 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:42:10.644124 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:42:10.644124 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 21:42:10.644124 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 21:42:10.644124 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 21:42:10.644124 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 21:42:10.644124 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:42:10.644124 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:42:10.644124 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:42:10.644124 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:42:10.644124 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:42:10.644124 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application with Lock( Aug 18 21:42:10.644124 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:42:10.644124 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:42:10.644124 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:42:10.644124 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:42:10.644124 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:42:10.644124 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:42:10.645220 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:42:10.645220 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:42:10.645220 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 21:42:10.645220 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 21:42:10.645220 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 21:42:10.645220 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 21:42:10.645220 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 21:42:10.645220 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 21:42:10.645220 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 18 21:42:10.645220 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:42:10.646413 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 349/694] 10.222.0.27 () {56 vars in 1093 bytes} [Thu Aug 18 21:42:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:42:10.647599 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3404ff91-d3f5-42c4-a6e2-022636421ffc None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:10.682922 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:10.771920 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3404ff91-d3f5-42c4-a6e2-022636421ffc None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:10.776087 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f724d15-d829-455d-aae8-956c6b66c7ad None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:10.811261 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426f604f-4d62-46fc-bd6b-84d336c82c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:10.812246 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426f604f-4d62-46fc-bd6b-84d336c82c5f None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:10.812464 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520978de-7c63-4aa6-a35c-2853b7f4f3c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:10.813388 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426f604f-4d62-46fc-bd6b-84d336c82c5f None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:10.813851 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426f604f-4d62-46fc-bd6b-84d336c82c5f None admin] PATH_INFO: `/v3/users` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:10.814369 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520978de-7c63-4aa6-a35c-2853b7f4f3c0 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:10.814721 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520978de-7c63-4aa6-a35c-2853b7f4f3c0 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:10.815064 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520978de-7c63-4aa6-a35c-2853b7f4f3c0 None admin] PATH_INFO: `/v3/domains` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:10.815485 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426f604f-4d62-46fc-bd6b-84d336c82c5f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:10.815834 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520978de-7c63-4aa6-a35c-2853b7f4f3c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:10.816155 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426f604f-4d62-46fc-bd6b-84d336c82c5f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:10.816268 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520978de-7c63-4aa6-a35c-2853b7f4f3c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:10.817698 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520978de-7c63-4aa6-a35c-2853b7f4f3c0 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:10.818144 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426f604f-4d62-46fc-bd6b-84d336c82c5f None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:10.835912 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 346/695] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 18 21:42:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:42:10.837088 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bfe9d3-9f4c-4527-87ce-33bc209a45e9 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:10.837592 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bfe9d3-9f4c-4527-87ce-33bc209a45e9 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:10.837840 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bfe9d3-9f4c-4527-87ce-33bc209a45e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:10.840274 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 350/696] 10.222.0.27 () {56 vars in 1133 bytes} [Thu Aug 18 21:42:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 21:42:10.845901 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426f604f-4d62-46fc-bd6b-84d336c82c5f None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:10.866642 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-05bfe9d3-9f4c-4527-87ce-33bc209a45e9 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:42:10.868337 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-05bfe9d3-9f4c-4527-87ce-33bc209a45e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:42:10.887625 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:10.952838 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 347/697] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:42:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 21:42:10.954692 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bfe9d3-9f4c-4527-87ce-33bc209a45e9 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:10.976505 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:10.978843 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426f604f-4d62-46fc-bd6b-84d336c82c5f None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:11.021823 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92df19f8-05c6-4260-b718-c7631664456d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:11.022463 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92df19f8-05c6-4260-b718-c7631664456d None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:11.022743 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92df19f8-05c6-4260-b718-c7631664456d None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:11.023004 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92df19f8-05c6-4260-b718-c7631664456d None admin] PATH_INFO: `/v3/projects/service` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:11.031243 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92df19f8-05c6-4260-b718-c7631664456d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:11.033454 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92df19f8-05c6-4260-b718-c7631664456d None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:11.046631 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application [None req-92df19f8-05c6-4260-b718-c7631664456d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 21:42:11.046631 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:11.046631 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:42:11.046631 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:42:11.046631 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:42:11.046631 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:42:11.046631 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:42:11.046631 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:42:11.046631 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:42:11.046631 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:42:11.046631 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:42:11.046631 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:42:11.046631 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 21:42:11.046631 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 21:42:11.046631 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 21:42:11.048267 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 21:42:11.048267 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:42:11.048267 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:42:11.048267 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:42:11.048267 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:42:11.048267 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:42:11.048267 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:42:11.048267 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:42:11.048267 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application with Lock( Aug 18 21:42:11.048267 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:42:11.048267 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:42:11.048267 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:42:11.048267 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:42:11.048267 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:42:11.048267 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:42:11.048267 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:42:11.048267 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:42:11.049180 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 21:42:11.049180 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 21:42:11.049180 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 21:42:11.049180 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 21:42:11.049180 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 21:42:11.049180 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 21:42:11.049180 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 21:42:11.049180 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:42:11.056614 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 351/698] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Aug 18 21:42:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:42:11.056614 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92df19f8-05c6-4260-b718-c7631664456d None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:11.168675 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:11.177705 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92df19f8-05c6-4260-b718-c7631664456d None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:11.218007 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd883f39-57c3-417e-9787-5bf6803f7384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:11.218754 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd883f39-57c3-417e-9787-5bf6803f7384 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:11.219087 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd883f39-57c3-417e-9787-5bf6803f7384 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:11.219358 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd883f39-57c3-417e-9787-5bf6803f7384 None admin] PATH_INFO: `/v3/projects` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:11.220053 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd883f39-57c3-417e-9787-5bf6803f7384 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:11.220358 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd883f39-57c3-417e-9787-5bf6803f7384 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:11.222652 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd883f39-57c3-417e-9787-5bf6803f7384 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:11.229229 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bfe9d3-9f4c-4527-87ce-33bc209a45e9 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:11.238761 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 352/699] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Aug 18 21:42:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:42:11.240743 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c14896-cf71-4e51-bef8-e5e9cc9af313 None None] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:11.241031 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c14896-cf71-4e51-bef8-e5e9cc9af313 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:11.241720 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c14896-cf71-4e51-bef8-e5e9cc9af313 None None] PATH_INFO: `/` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:11.243484 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 353/700] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:42:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:42:11.245240 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c14896-cf71-4e51-bef8-e5e9cc9af313 None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:11.275601 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af73f05-3709-43c2-bad6-4dd131b40fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:11.276311 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af73f05-3709-43c2-bad6-4dd131b40fd0 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:11.276694 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af73f05-3709-43c2-bad6-4dd131b40fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:11.277041 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af73f05-3709-43c2-bad6-4dd131b40fd0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:11.355722 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af73f05-3709-43c2-bad6-4dd131b40fd0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:11.357214 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af73f05-3709-43c2-bad6-4dd131b40fd0 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:11.369103 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:11.379410 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c14896-cf71-4e51-bef8-e5e9cc9af313 None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:11.415442 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a26b88-ab92-4a31-8a9b-8d3921f2d2a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:11.416040 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a26b88-ab92-4a31-8a9b-8d3921f2d2a4 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:11.416317 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a26b88-ab92-4a31-8a9b-8d3921f2d2a4 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:11.416612 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a26b88-ab92-4a31-8a9b-8d3921f2d2a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:11.417319 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a26b88-ab92-4a31-8a9b-8d3921f2d2a4 None admin] RBAC: Adding query filter params (role.id=30d8ac11e30e4b1d83940485e98d147c, scope.project.id=4b54801b90484d689034f838f85fc0a4, user.id=9ae59e6dca304c949942ae769acedc74) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:11.417624 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a26b88-ab92-4a31-8a9b-8d3921f2d2a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:11.419083 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a26b88-ab92-4a31-8a9b-8d3921f2d2a4 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:11.424942 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 354/701] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Aug 18 21:42:11 2022] GET /identity/v3/role_assignments?user.id=9ae59e6dca304c949942ae769acedc74&scope.project.id=4b54801b90484d689034f838f85fc0a4&role.id=30d8ac11e30e4b1d83940485e98d147c => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:42:11.434238 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884b7911-fbbc-4d8c-9431-40f1c3828a84 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:11.434827 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884b7911-fbbc-4d8c-9431-40f1c3828a84 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:11.435279 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884b7911-fbbc-4d8c-9431-40f1c3828a84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:11.461030 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-884b7911-fbbc-4d8c-9431-40f1c3828a84 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:42:11.462374 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-884b7911-fbbc-4d8c-9431-40f1c3828a84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:42:11.470838 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 348/702] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Aug 18 21:42:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 21:42:11.472110 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af73f05-3709-43c2-bad6-4dd131b40fd0 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:11.484088 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:11.548636 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 355/703] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:42:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 21:42:11.549021 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884b7911-fbbc-4d8c-9431-40f1c3828a84 None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:11.610030 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af73f05-3709-43c2-bad6-4dd131b40fd0 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:11.623296 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:11.652793 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954cb725-4dd4-4129-af08-6ffdb50fca27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:11.654533 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954cb725-4dd4-4129-af08-6ffdb50fca27 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:11.654807 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954cb725-4dd4-4129-af08-6ffdb50fca27 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:11.655072 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954cb725-4dd4-4129-af08-6ffdb50fca27 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:11.669637 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954cb725-4dd4-4129-af08-6ffdb50fca27 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:11.672619 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954cb725-4dd4-4129-af08-6ffdb50fca27 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:11.679027 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884b7911-fbbc-4d8c-9431-40f1c3828a84 None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:11.694655 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application [None req-954cb725-4dd4-4129-af08-6ffdb50fca27 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:42:11.694655 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:11.694655 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:42:11.694655 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:42:11.694655 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:42:11.694655 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:42:11.694655 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:42:11.694655 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:42:11.694655 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:42:11.694655 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:42:11.694655 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:42:11.694655 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:42:11.694655 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 21:42:11.694655 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 21:42:11.694655 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 21:42:11.694655 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 21:42:11.696271 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:42:11.696271 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:42:11.696271 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:42:11.696271 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:42:11.696271 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:42:11.696271 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:42:11.696271 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:42:11.696271 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application with Lock( Aug 18 21:42:11.696271 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:42:11.696271 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:42:11.696271 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:42:11.696271 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:42:11.696271 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:42:11.696271 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:42:11.696271 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:42:11.696271 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:42:11.696271 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 21:42:11.697250 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 21:42:11.697250 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:42:11.697250 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:42:11.697250 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 349/704] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 18 21:42:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:42:11.697250 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc6af0f-a349-4b4c-ac09-0ed5cc9a3a79 None None] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:11.697535 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc6af0f-a349-4b4c-ac09-0ed5cc9a3a79 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:11.697872 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc6af0f-a349-4b4c-ac09-0ed5cc9a3a79 None None] PATH_INFO: `/` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:11.699110 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 350/705] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:42:11 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:42:11.704908 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc6af0f-a349-4b4c-ac09-0ed5cc9a3a79 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:11.719511 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609de891-07d8-4d28-9f91-4023d1a97543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:11.720143 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609de891-07d8-4d28-9f91-4023d1a97543 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:11.720417 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609de891-07d8-4d28-9f91-4023d1a97543 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:11.720733 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609de891-07d8-4d28-9f91-4023d1a97543 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:11.731617 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609de891-07d8-4d28-9f91-4023d1a97543 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:11.733497 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609de891-07d8-4d28-9f91-4023d1a97543 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:11.748747 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:11.761525 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application [None req-609de891-07d8-4d28-9f91-4023d1a97543 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:42:11.761525 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:11.761525 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:42:11.761525 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:42:11.761525 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:42:11.761525 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:42:11.761525 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:42:11.761525 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:42:11.761525 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:42:11.761525 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:42:11.761525 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:42:11.761525 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:42:11.761525 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 21:42:11.761525 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 21:42:11.761525 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 21:42:11.761525 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 21:42:11.769744 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:42:11.769744 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:42:11.769744 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:42:11.769744 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:42:11.769744 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:42:11.769744 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:42:11.769744 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:42:11.769744 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application with Lock( Aug 18 21:42:11.769744 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:42:11.769744 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:42:11.769744 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:42:11.769744 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:42:11.769744 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:42:11.769744 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:42:11.769744 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:42:11.769744 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:42:11.769744 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 21:42:11.770630 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 21:42:11.770630 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:42:11.770630 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:42:11.770630 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 356/706] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 18 21:42:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:42:11.770630 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7180b786-d19d-4306-8042-c5c8e9ab3e67 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:11.770630 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7180b786-d19d-4306-8042-c5c8e9ab3e67 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:11.770630 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7180b786-d19d-4306-8042-c5c8e9ab3e67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:11.792808 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-7180b786-d19d-4306-8042-c5c8e9ab3e67 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:42:11.794324 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-7180b786-d19d-4306-8042-c5c8e9ab3e67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:42:11.826050 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc6af0f-a349-4b4c-ac09-0ed5cc9a3a79 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:11.869733 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e13d41-ddfb-48b5-8329-e37c67e72489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:11.870330 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e13d41-ddfb-48b5-8329-e37c67e72489 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:11.870603 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e13d41-ddfb-48b5-8329-e37c67e72489 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:11.871034 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e13d41-ddfb-48b5-8329-e37c67e72489 None admin] PATH_INFO: `/v3/domains` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:11.871501 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e13d41-ddfb-48b5-8329-e37c67e72489 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:11.871799 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e13d41-ddfb-48b5-8329-e37c67e72489 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:11.873320 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e13d41-ddfb-48b5-8329-e37c67e72489 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:11.884617 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 357/707] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:42:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 21:42:11.884617 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7180b786-d19d-4306-8042-c5c8e9ab3e67 None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:11.890319 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 351/708] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 18 21:42:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 21:42:11.892469 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e13d41-ddfb-48b5-8329-e37c67e72489 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:11.924327 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:12.009838 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e13d41-ddfb-48b5-8329-e37c67e72489 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:12.020159 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7180b786-d19d-4306-8042-c5c8e9ab3e67 None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:12.048995 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43be3eb-ea41-48b6-8698-8696fcdd19a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:12.049787 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43be3eb-ea41-48b6-8698-8696fcdd19a5 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:12.050170 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43be3eb-ea41-48b6-8698-8696fcdd19a5 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:12.050537 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43be3eb-ea41-48b6-8698-8696fcdd19a5 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:12.051054 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:12.052389 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43be3eb-ea41-48b6-8698-8696fcdd19a5 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:12.054288 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43be3eb-ea41-48b6-8698-8696fcdd19a5 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:12.056862 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dde073-064e-416c-a6ca-aa4cbc34f5d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:12.063788 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dde073-064e-416c-a6ca-aa4cbc34f5d9 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:12.063788 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dde073-064e-416c-a6ca-aa4cbc34f5d9 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:12.063788 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dde073-064e-416c-a6ca-aa4cbc34f5d9 None admin] PATH_INFO: `/v3/domains` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:12.063788 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dde073-064e-416c-a6ca-aa4cbc34f5d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:12.063788 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dde073-064e-416c-a6ca-aa4cbc34f5d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:12.063788 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dde073-064e-416c-a6ca-aa4cbc34f5d9 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:12.066524 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application [None req-f43be3eb-ea41-48b6-8698-8696fcdd19a5 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 18 21:42:12.066524 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:12.066524 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 21:42:12.066524 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 21:42:12.066524 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 21:42:12.066524 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 21:42:12.066524 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 21:42:12.066524 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 21:42:12.066524 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 18 21:42:12.066524 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:42:12.066524 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 21:42:12.066524 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:42:12.066524 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:12.066524 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:42:12.066524 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:42:12.066524 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:42:12.066524 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:42:12.067530 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:42:12.067530 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:42:12.067530 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:42:12.067530 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:42:12.067530 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:42:12.067530 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:42:12.067530 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 21:42:12.067530 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 21:42:12.067530 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 21:42:12.067530 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 21:42:12.067530 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:42:12.067530 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:42:12.067530 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:42:12.067530 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:42:12.067530 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:42:12.067530 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:42:12.068854 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:42:12.068854 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application with Lock( Aug 18 21:42:12.068854 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:42:12.068854 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:42:12.068854 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:42:12.068854 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:42:12.068854 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:42:12.068854 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:42:12.068854 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:42:12.068854 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:42:12.068854 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 21:42:12.068854 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 21:42:12.068854 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 18 21:42:12.068854 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:42:12.068854 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 352/709] 10.222.0.27 () {56 vars in 1129 bytes} [Thu Aug 18 21:42:11 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:42:12.069939 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43be3eb-ea41-48b6-8698-8696fcdd19a5 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:12.082592 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 358/710] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 18 21:42:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:42:12.084382 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dde073-064e-416c-a6ca-aa4cbc34f5d9 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:12.165908 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:12.181737 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43be3eb-ea41-48b6-8698-8696fcdd19a5 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:12.211635 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dde073-064e-416c-a6ca-aa4cbc34f5d9 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:12.217878 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba03f53a-897f-4173-8311-dd2c9073c2df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:12.218483 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba03f53a-897f-4173-8311-dd2c9073c2df None admin] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:12.218765 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba03f53a-897f-4173-8311-dd2c9073c2df None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:12.219089 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba03f53a-897f-4173-8311-dd2c9073c2df None admin] PATH_INFO: `/v3/users` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:12.219730 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba03f53a-897f-4173-8311-dd2c9073c2df None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:12.221205 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba03f53a-897f-4173-8311-dd2c9073c2df None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:12.247207 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554c7ec5-2023-418a-8fc6-2717e9f0c8b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:12.247902 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554c7ec5-2023-418a-8fc6-2717e9f0c8b7 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:12.248249 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554c7ec5-2023-418a-8fc6-2717e9f0c8b7 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:12.248615 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554c7ec5-2023-418a-8fc6-2717e9f0c8b7 None admin] PATH_INFO: `/v3/services` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:12.249316 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554c7ec5-2023-418a-8fc6-2717e9f0c8b7 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:12.249688 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554c7ec5-2023-418a-8fc6-2717e9f0c8b7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:12.251894 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554c7ec5-2023-418a-8fc6-2717e9f0c8b7 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:12.256325 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 359/711] 10.222.0.27 () {56 vars in 1124 bytes} [Thu Aug 18 21:42:12 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:42:12.257192 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554c7ec5-2023-418a-8fc6-2717e9f0c8b7 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:12.315538 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:12.335597 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 353/712] 10.222.0.27 () {60 vars in 1132 bytes} [Thu Aug 18 21:42:12 2022] POST /identity/v3/users => generated 254 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:42:12.337163 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba03f53a-897f-4173-8311-dd2c9073c2df None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:12.364801 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554c7ec5-2023-418a-8fc6-2717e9f0c8b7 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:12.408577 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0498a0-8f40-434c-b3cc-e27764fdef40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:12.409382 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0498a0-8f40-434c-b3cc-e27764fdef40 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:12.409733 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0498a0-8f40-434c-b3cc-e27764fdef40 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:12.410011 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0498a0-8f40-434c-b3cc-e27764fdef40 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:12.419051 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0498a0-8f40-434c-b3cc-e27764fdef40 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:12.421155 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0498a0-8f40-434c-b3cc-e27764fdef40 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:12.438705 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application [None req-5b0498a0-8f40-434c-b3cc-e27764fdef40 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 21:42:12.438705 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:12.438705 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:42:12.438705 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:42:12.438705 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:42:12.438705 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:42:12.438705 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:42:12.438705 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:42:12.438705 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:42:12.438705 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:42:12.438705 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:42:12.438705 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:42:12.438705 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 21:42:12.438705 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 21:42:12.438705 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 21:42:12.439695 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 21:42:12.439695 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:42:12.439695 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:42:12.439695 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:42:12.439695 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:42:12.439695 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:42:12.439695 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:42:12.439695 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:42:12.439695 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application with Lock( Aug 18 21:42:12.439695 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:42:12.439695 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:42:12.439695 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:42:12.439695 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:42:12.439695 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:42:12.439695 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:42:12.439695 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:42:12.439695 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:42:12.441199 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 21:42:12.441199 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 21:42:12.441199 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 21:42:12.441199 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 21:42:12.441199 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 21:42:12.441199 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 21:42:12.441199 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 21:42:12.441199 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:42:12.441199 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 360/713] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Aug 18 21:42:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:42:12.441199 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0498a0-8f40-434c-b3cc-e27764fdef40 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:12.482581 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba03f53a-897f-4173-8311-dd2c9073c2df None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:12.525596 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b651e024-6801-4475-9ac5-9362729b6998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:12.526233 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b651e024-6801-4475-9ac5-9362729b6998 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:12.526512 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b651e024-6801-4475-9ac5-9362729b6998 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:12.526783 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b651e024-6801-4475-9ac5-9362729b6998 None admin] PATH_INFO: `/v3/services/network` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:12.527544 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b651e024-6801-4475-9ac5-9362729b6998 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:12.529042 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b651e024-6801-4475-9ac5-9362729b6998 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:12.538208 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application [None req-b651e024-6801-4475-9ac5-9362729b6998 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 18 21:42:12.538208 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:12.538208 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 21:42:12.538208 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 21:42:12.538208 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 21:42:12.538208 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 21:42:12.538208 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 21:42:12.538208 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 21:42:12.538208 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 18 21:42:12.538208 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:42:12.538208 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 21:42:12.538208 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:42:12.538208 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:12.538208 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:42:12.538208 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:42:12.538208 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:42:12.538208 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:42:12.539316 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:42:12.539316 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:42:12.539316 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:42:12.539316 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:42:12.539316 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:42:12.539316 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:42:12.539316 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 21:42:12.539316 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 21:42:12.539316 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 21:42:12.539316 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 21:42:12.539316 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:42:12.539316 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:42:12.539316 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:42:12.539316 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:42:12.539316 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:42:12.539316 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:42:12.540185 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:42:12.540185 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application with Lock( Aug 18 21:42:12.540185 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:42:12.540185 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:42:12.540185 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:42:12.540185 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:42:12.540185 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:42:12.540185 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:42:12.540185 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:42:12.540185 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:42:12.540185 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 21:42:12.540185 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 21:42:12.540185 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 18 21:42:12.540185 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:42:12.540185 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 354/714] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Aug 18 21:42:12 2022] GET /identity/v3/services/network => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:42:12.541010 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b651e024-6801-4475-9ac5-9362729b6998 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:12.552343 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:12.573605 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0498a0-8f40-434c-b3cc-e27764fdef40 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:12.590420 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:12.617420 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6146e575-296d-462f-9ca6-d0de59dff2ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:12.618032 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6146e575-296d-462f-9ca6-d0de59dff2ab None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:12.618312 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6146e575-296d-462f-9ca6-d0de59dff2ab None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:12.618585 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6146e575-296d-462f-9ca6-d0de59dff2ab None admin] PATH_INFO: `/v3/services` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:12.619213 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6146e575-296d-462f-9ca6-d0de59dff2ab None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:12.619618 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6146e575-296d-462f-9ca6-d0de59dff2ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:12.624647 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6146e575-296d-462f-9ca6-d0de59dff2ab None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:12.637164 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 361/715] 10.222.0.27 () {56 vars in 1124 bytes} [Thu Aug 18 21:42:12 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:42:12.637708 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6146e575-296d-462f-9ca6-d0de59dff2ab None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:12.701463 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b651e024-6801-4475-9ac5-9362729b6998 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:12.796905 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d5c8cf-5815-46c9-a576-773f34dd073f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:12.797551 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d5c8cf-5815-46c9-a576-773f34dd073f None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:12.797829 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d5c8cf-5815-46c9-a576-773f34dd073f None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:12.798198 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d5c8cf-5815-46c9-a576-773f34dd073f None admin] PATH_INFO: `/v3/projects` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:12.800143 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d5c8cf-5815-46c9-a576-773f34dd073f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:12.800143 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d5c8cf-5815-46c9-a576-773f34dd073f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:12.800668 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d5c8cf-5815-46c9-a576-773f34dd073f None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:12.823135 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 355/716] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Aug 18 21:42:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:42:12.830546 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6146e575-296d-462f-9ca6-d0de59dff2ab None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:12.835255 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d5c8cf-5815-46c9-a576-773f34dd073f None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:12.881209 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e1e7a7-1b95-438f-8fd2-1cc8c82978bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:12.882246 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e1e7a7-1b95-438f-8fd2-1cc8c82978bf None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:12.882528 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e1e7a7-1b95-438f-8fd2-1cc8c82978bf None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:12.882799 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e1e7a7-1b95-438f-8fd2-1cc8c82978bf None admin] PATH_INFO: `/v3/services` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:12.883705 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e1e7a7-1b95-438f-8fd2-1cc8c82978bf None admin] RBAC: Adding query filter params (name=network) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:12.884012 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e1e7a7-1b95-438f-8fd2-1cc8c82978bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:12.885501 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e1e7a7-1b95-438f-8fd2-1cc8c82978bf None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:12.896631 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 362/717] 10.222.0.27 () {56 vars in 1112 bytes} [Thu Aug 18 21:42:12 2022] GET /identity/v3/services?name=network => generated 124 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:42:12.898458 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e1e7a7-1b95-438f-8fd2-1cc8c82978bf None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:12.936454 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:12.992054 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:12.999789 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d5c8cf-5815-46c9-a576-773f34dd073f None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:13.074594 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e1e7a7-1b95-438f-8fd2-1cc8c82978bf None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:13.081828 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cb2aec-80b2-48d7-86b1-931804cd4cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:13.082433 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cb2aec-80b2-48d7-86b1-931804cd4cc5 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:13.082714 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cb2aec-80b2-48d7-86b1-931804cd4cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:13.082978 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cb2aec-80b2-48d7-86b1-931804cd4cc5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:13.083819 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cb2aec-80b2-48d7-86b1-931804cd4cc5 None admin] RBAC: Adding query filter params (role.id=0833202e2a3d47d1b6b3af57006641b1, scope.project.id=4b54801b90484d689034f838f85fc0a4, user.id=a39cd50340184779ac589bbcb7cac9aa) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:13.084050 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cb2aec-80b2-48d7-86b1-931804cd4cc5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:13.085471 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cb2aec-80b2-48d7-86b1-931804cd4cc5 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:13.102265 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 356/718] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Aug 18 21:42:12 2022] GET /identity/v3/role_assignments?user.id=a39cd50340184779ac589bbcb7cac9aa&scope.project.id=4b54801b90484d689034f838f85fc0a4&role.id=0833202e2a3d47d1b6b3af57006641b1 => generated 259 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:42:13.126405 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a0a312-e2f0-4df2-85f3-c60df6a368a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:13.127029 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a0a312-e2f0-4df2-85f3-c60df6a368a5 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:13.129601 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a0a312-e2f0-4df2-85f3-c60df6a368a5 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:13.129601 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a0a312-e2f0-4df2-85f3-c60df6a368a5 None admin] PATH_INFO: `/v3/services` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:13.129601 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a0a312-e2f0-4df2-85f3-c60df6a368a5 None admin] RBAC: Adding query filter params (type=network) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:13.129601 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a0a312-e2f0-4df2-85f3-c60df6a368a5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:13.129987 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a0a312-e2f0-4df2-85f3-c60df6a368a5 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:13.142560 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 363/719] 10.222.0.27 () {56 vars in 1112 bytes} [Thu Aug 18 21:42:12 2022] GET /identity/v3/services?type=network => generated 124 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 21:42:13.568115 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076abcc7-b0ed-432a-93e6-b03ad275f243 None None] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:13.568471 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076abcc7-b0ed-432a-93e6-b03ad275f243 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:13.568584 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076abcc7-b0ed-432a-93e6-b03ad275f243 None None] PATH_INFO: `/` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:13.570240 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 357/720] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:42:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:42:13.575422 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f1313c-0328-4645-8d02-23605d5f1b90 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:13.575710 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f1313c-0328-4645-8d02-23605d5f1b90 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:13.575982 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f1313c-0328-4645-8d02-23605d5f1b90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:13.595664 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-47f1313c-0328-4645-8d02-23605d5f1b90 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:42:13.596941 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-47f1313c-0328-4645-8d02-23605d5f1b90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:42:13.676979 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 364/721] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:42:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 21:42:13.952158 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076abcc7-b0ed-432a-93e6-b03ad275f243 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:14.086204 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076abcc7-b0ed-432a-93e6-b03ad275f243 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:14.120476 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:14.132810 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1de30f-671f-46d5-9e7d-ad651dbf3c7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:14.134512 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1de30f-671f-46d5-9e7d-ad651dbf3c7f None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:14.134512 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1de30f-671f-46d5-9e7d-ad651dbf3c7f None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:14.134512 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1de30f-671f-46d5-9e7d-ad651dbf3c7f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:14.151581 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1de30f-671f-46d5-9e7d-ad651dbf3c7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:42:14.156406 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application [None req-7f1de30f-671f-46d5-9e7d-ad651dbf3c7f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 21:42:14.156406 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:14.156406 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:42:14.156406 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:42:14.156406 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:42:14.156406 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:42:14.156406 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:42:14.156406 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:42:14.156406 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:42:14.156406 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:42:14.156406 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:42:14.156406 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:42:14.156406 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:42:14.156406 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:42:14.156406 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:42:14.156406 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:42:14.163390 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:42:14.163390 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:42:14.163390 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:42:14.163390 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:42:14.163390 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:42:14.163390 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:42:14.163390 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:42:14.163390 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:42:14.163390 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:42:14.163390 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:42:14.163390 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:42:14.163390 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application with Lock( Aug 18 21:42:14.163390 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:42:14.163390 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:42:14.163390 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:42:14.163390 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:42:14.165413 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:42:14.165413 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:42:14.165413 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:42:14.165413 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:42:14.165413 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:42:14.165413 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:42:14.165413 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:42:14.165413 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:42:14.165413 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:42:14.165413 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:42:14.165413 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 21:42:14.165413 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:42:14.165413 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 358/722] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Aug 18 21:42:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:42:14.169224 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f1313c-0328-4645-8d02-23605d5f1b90 None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:14.229749 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:14.328333 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f1313c-0328-4645-8d02-23605d5f1b90 None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:14.377407 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240b7d38-16c5-48f0-a3d7-44e06c9bce18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:14.378028 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240b7d38-16c5-48f0-a3d7-44e06c9bce18 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:14.378313 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240b7d38-16c5-48f0-a3d7-44e06c9bce18 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:14.378591 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240b7d38-16c5-48f0-a3d7-44e06c9bce18 None admin] PATH_INFO: `/v3/roles` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:14.379262 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240b7d38-16c5-48f0-a3d7-44e06c9bce18 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:14.379565 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240b7d38-16c5-48f0-a3d7-44e06c9bce18 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:14.381022 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240b7d38-16c5-48f0-a3d7-44e06c9bce18 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:14.392665 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 365/723] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Aug 18 21:42:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:42:14.398214 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1de30f-671f-46d5-9e7d-ad651dbf3c7f None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:14.520150 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1de30f-671f-46d5-9e7d-ad651dbf3c7f None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:14.565027 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be15c955-6cec-4c5d-91f5-c50af1e78a6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:14.565678 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be15c955-6cec-4c5d-91f5-c50af1e78a6e None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:14.565956 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be15c955-6cec-4c5d-91f5-c50af1e78a6e None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:14.566223 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be15c955-6cec-4c5d-91f5-c50af1e78a6e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:14.577860 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be15c955-6cec-4c5d-91f5-c50af1e78a6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:14.580028 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be15c955-6cec-4c5d-91f5-c50af1e78a6e None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:14.594460 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application [None req-be15c955-6cec-4c5d-91f5-c50af1e78a6e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:42:14.594460 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:14.594460 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:42:14.594460 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:42:14.594460 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:42:14.594460 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:42:14.594460 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:42:14.594460 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:42:14.594460 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:42:14.594460 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:42:14.594460 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:42:14.594460 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:42:14.594460 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 21:42:14.594460 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 21:42:14.594460 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 21:42:14.594460 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 21:42:14.595485 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:42:14.595485 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:42:14.595485 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:42:14.595485 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:42:14.595485 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:42:14.595485 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:42:14.595485 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:42:14.595485 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application with Lock( Aug 18 21:42:14.595485 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:42:14.595485 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:42:14.595485 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:42:14.595485 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:42:14.595485 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:42:14.595485 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:42:14.595485 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:42:14.595485 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:42:14.595485 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 21:42:14.596369 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 21:42:14.596369 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:42:14.596369 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:42:14.596369 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 359/724] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 18 21:42:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:42:14.601662 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240b7d38-16c5-48f0-a3d7-44e06c9bce18 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:14.685757 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5ccef3-94ce-4ca3-958d-e51b4d1c2c91 None None] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:14.686139 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5ccef3-94ce-4ca3-958d-e51b4d1c2c91 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:14.686411 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5ccef3-94ce-4ca3-958d-e51b4d1c2c91 None None] PATH_INFO: `/` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:14.689919 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 360/725] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:42:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:42:14.693962 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696e5a15-387e-4d80-a3cf-f1f6d8d5c100 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:14.694251 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696e5a15-387e-4d80-a3cf-f1f6d8d5c100 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:14.694519 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696e5a15-387e-4d80-a3cf-f1f6d8d5c100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:14.724513 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-696e5a15-387e-4d80-a3cf-f1f6d8d5c100 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:42:14.726727 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-696e5a15-387e-4d80-a3cf-f1f6d8d5c100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:42:14.757972 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:14.764135 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240b7d38-16c5-48f0-a3d7-44e06c9bce18 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:14.804014 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:14.845374 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0bf13f-5cfe-4ab4-ac24-f473968e7fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:14.845996 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0bf13f-5cfe-4ab4-ac24-f473968e7fd9 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:14.846275 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0bf13f-5cfe-4ab4-ac24-f473968e7fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:14.846550 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0bf13f-5cfe-4ab4-ac24-f473968e7fd9 None admin] PATH_INFO: `/v3/domains` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:14.847201 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0bf13f-5cfe-4ab4-ac24-f473968e7fd9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:14.847499 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0bf13f-5cfe-4ab4-ac24-f473968e7fd9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:14.848885 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0bf13f-5cfe-4ab4-ac24-f473968e7fd9 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:14.854911 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 361/726] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:42:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 21:42:14.861967 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 366/727] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 18 21:42:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:42:14.867012 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696e5a15-387e-4d80-a3cf-f1f6d8d5c100 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:15.008329 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696e5a15-387e-4d80-a3cf-f1f6d8d5c100 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:15.061556 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38f6eab-19d4-4e3e-aed9-a068b24102c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:15.062547 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38f6eab-19d4-4e3e-aed9-a068b24102c2 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:15.063580 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38f6eab-19d4-4e3e-aed9-a068b24102c2 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:15.064049 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38f6eab-19d4-4e3e-aed9-a068b24102c2 None admin] PATH_INFO: `/v3/users/swift` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:15.075636 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38f6eab-19d4-4e3e-aed9-a068b24102c2 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:15.077387 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38f6eab-19d4-4e3e-aed9-a068b24102c2 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:15.092046 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application [None req-d38f6eab-19d4-4e3e-aed9-a068b24102c2 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 18 21:42:15.092046 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:15.092046 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:42:15.092046 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:42:15.092046 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:42:15.092046 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:42:15.092046 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:42:15.092046 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:42:15.092046 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:42:15.092046 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:42:15.092046 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:42:15.092046 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:42:15.092046 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 21:42:15.092046 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 21:42:15.092046 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 21:42:15.092046 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 21:42:15.093059 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:42:15.093059 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:42:15.093059 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 21:42:15.093059 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 21:42:15.093059 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 21:42:15.093059 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 21:42:15.093059 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:42:15.093059 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:42:15.093059 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:42:15.093059 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:42:15.093059 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:42:15.093059 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application with Lock( Aug 18 21:42:15.093059 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:42:15.093059 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:42:15.093059 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:42:15.093059 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:42:15.093059 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:42:15.093059 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:42:15.094113 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:42:15.094113 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:42:15.094113 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 21:42:15.094113 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 21:42:15.094113 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 21:42:15.094113 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 21:42:15.094113 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 21:42:15.094113 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 21:42:15.094113 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 18 21:42:15.094113 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:42:15.096398 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 362/728] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Aug 18 21:42:14 2022] GET /identity/v3/users/swift => generated 83 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:42:15.102371 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0bf13f-5cfe-4ab4-ac24-f473968e7fd9 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:15.173026 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38f6eab-19d4-4e3e-aed9-a068b24102c2 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:15.235394 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:15.279171 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0bf13f-5cfe-4ab4-ac24-f473968e7fd9 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:15.320910 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d253791a-1ac0-4af7-9a7f-4c8a29429b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:15.321948 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d253791a-1ac0-4af7-9a7f-4c8a29429b78 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:15.322528 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d253791a-1ac0-4af7-9a7f-4c8a29429b78 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:15.322999 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d253791a-1ac0-4af7-9a7f-4c8a29429b78 None admin] PATH_INFO: `/v3/users` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:15.323938 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d253791a-1ac0-4af7-9a7f-4c8a29429b78 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:15.324536 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d253791a-1ac0-4af7-9a7f-4c8a29429b78 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:15.326251 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d253791a-1ac0-4af7-9a7f-4c8a29429b78 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:15.331613 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38f6eab-19d4-4e3e-aed9-a068b24102c2 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:15.346015 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 367/729] 10.222.0.27 () {56 vars in 1135 bytes} [Thu Aug 18 21:42:15 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:42:15.347614 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fe264f-df8b-4fa8-9fce-f34cf289e598 None None] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:15.348058 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fe264f-df8b-4fa8-9fce-f34cf289e598 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:15.348475 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fe264f-df8b-4fa8-9fce-f34cf289e598 None None] PATH_INFO: `/` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:15.354100 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 368/730] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:42:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:42:15.355072 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fe264f-df8b-4fa8-9fce-f34cf289e598 None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:15.369335 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5647c8-33f4-4c35-ad30-1fc679f018e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:15.370068 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5647c8-33f4-4c35-ad30-1fc679f018e4 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:15.370392 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5647c8-33f4-4c35-ad30-1fc679f018e4 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:15.370715 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5647c8-33f4-4c35-ad30-1fc679f018e4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:15.376504 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:15.383726 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5647c8-33f4-4c35-ad30-1fc679f018e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:42:15.388966 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application [None req-fc5647c8-33f4-4c35-ad30-1fc679f018e4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 21:42:15.388966 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:15.388966 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:42:15.388966 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:42:15.388966 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:42:15.388966 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:42:15.388966 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:42:15.388966 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:42:15.388966 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:42:15.388966 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:42:15.388966 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:42:15.388966 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:42:15.388966 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:42:15.388966 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:42:15.388966 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:42:15.388966 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:42:15.389903 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:42:15.389903 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:42:15.389903 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:42:15.389903 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:42:15.389903 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:42:15.389903 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:42:15.389903 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:42:15.389903 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:42:15.389903 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:42:15.389903 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:42:15.389903 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:42:15.389903 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application with Lock( Aug 18 21:42:15.389903 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:42:15.389903 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:42:15.389903 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:42:15.389903 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:42:15.391133 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:42:15.391133 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:42:15.391133 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:42:15.391133 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:42:15.391133 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:42:15.391133 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:42:15.391133 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:42:15.391133 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:42:15.391133 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:42:15.391133 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:42:15.391133 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 21:42:15.391133 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:42:15.395683 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 363/731] 10.222.0.27 () {56 vars in 1102 bytes} [Thu Aug 18 21:42:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:42:15.397218 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9aa22f-37bf-44c7-93de-abf34fea9b6b None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:15.397504 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9aa22f-37bf-44c7-93de-abf34fea9b6b None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:15.397775 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9aa22f-37bf-44c7-93de-abf34fea9b6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:15.417720 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-3f9aa22f-37bf-44c7-93de-abf34fea9b6b None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:42:15.418913 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-3f9aa22f-37bf-44c7-93de-abf34fea9b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:42:15.474640 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fe264f-df8b-4fa8-9fce-f34cf289e598 None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:15.496729 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 364/732] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:42:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 21:42:15.496729 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9aa22f-37bf-44c7-93de-abf34fea9b6b None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:15.517920 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:15.534519 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c75de4-13cf-4dee-b29b-85181d9a5cac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:15.535500 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c75de4-13cf-4dee-b29b-85181d9a5cac None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:15.535997 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c75de4-13cf-4dee-b29b-85181d9a5cac None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:15.540764 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c75de4-13cf-4dee-b29b-85181d9a5cac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:15.599612 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9aa22f-37bf-44c7-93de-abf34fea9b6b None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:15.617016 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c75de4-13cf-4dee-b29b-85181d9a5cac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:15.618575 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c75de4-13cf-4dee-b29b-85181d9a5cac None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:15.637020 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:15.637324 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811017cb-e8f2-4fc9-bef1-29b702519a16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:15.637928 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811017cb-e8f2-4fc9-bef1-29b702519a16 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:15.638207 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811017cb-e8f2-4fc9-bef1-29b702519a16 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:15.638480 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811017cb-e8f2-4fc9-bef1-29b702519a16 None admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:15.639138 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811017cb-e8f2-4fc9-bef1-29b702519a16 None admin] RBAC: Adding query filter params (name=service) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:15.639436 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811017cb-e8f2-4fc9-bef1-29b702519a16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:15.641162 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811017cb-e8f2-4fc9-bef1-29b702519a16 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:15.653344 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 365/733] 10.222.0.27 () {56 vars in 1103 bytes} [Thu Aug 18 21:42:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:42:15.653344 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c9fcfa-ddc6-4066-a247-46a0b76cb69a None None] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:15.653344 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c9fcfa-ddc6-4066-a247-46a0b76cb69a None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:15.653344 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c9fcfa-ddc6-4066-a247-46a0b76cb69a None None] PATH_INFO: `/` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:15.653344 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 366/734] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:42:15 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:42:15.653344 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db4f2d2-3182-4b9a-be9a-8394ac19c3b9 None None] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:15.653795 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db4f2d2-3182-4b9a-be9a-8394ac19c3b9 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:15.653795 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db4f2d2-3182-4b9a-be9a-8394ac19c3b9 None None] PATH_INFO: `/` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:15.655156 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 367/735] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:42:15 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:42:15.655766 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db4f2d2-3182-4b9a-be9a-8394ac19c3b9 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:15.735980 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 369/736] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Aug 18 21:42:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 21:42:15.738177 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8644ca0e-bde8-45ae-92fd-e2391945fddb None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:15.738465 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8644ca0e-bde8-45ae-92fd-e2391945fddb None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:15.738739 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8644ca0e-bde8-45ae-92fd-e2391945fddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:15.747510 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:15.758610 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-8644ca0e-bde8-45ae-92fd-e2391945fddb None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:42:15.760045 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-8644ca0e-bde8-45ae-92fd-e2391945fddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:42:15.765169 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db4f2d2-3182-4b9a-be9a-8394ac19c3b9 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:15.800802 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06669899-892d-4010-839a-007fe12055da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:15.801746 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06669899-892d-4010-839a-007fe12055da None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:15.802204 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06669899-892d-4010-839a-007fe12055da None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:15.802654 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06669899-892d-4010-839a-007fe12055da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:15.814340 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06669899-892d-4010-839a-007fe12055da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:15.815796 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06669899-892d-4010-839a-007fe12055da None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:15.830155 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application [None req-06669899-892d-4010-839a-007fe12055da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:42:15.830155 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:15.830155 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:42:15.830155 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:42:15.830155 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:42:15.830155 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:42:15.830155 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:42:15.830155 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:42:15.830155 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:42:15.830155 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:42:15.830155 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:42:15.830155 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:42:15.830155 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 21:42:15.830155 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 21:42:15.830155 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 21:42:15.830155 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 21:42:15.831764 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:42:15.831764 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:42:15.831764 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:42:15.831764 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:42:15.831764 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:42:15.831764 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:42:15.831764 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:42:15.831764 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application with Lock( Aug 18 21:42:15.831764 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:42:15.831764 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:42:15.831764 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:42:15.831764 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:42:15.831764 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:42:15.831764 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:42:15.831764 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:42:15.831764 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:42:15.831764 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 21:42:15.832869 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 21:42:15.832869 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:42:15.832869 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:42:15.833041 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 370/737] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:42:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 21:42:15.833113 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 368/738] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 18 21:42:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:42:15.833180 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a03402a-96a4-41fe-9292-4990e788d24c None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:15.833261 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06669899-892d-4010-839a-007fe12055da None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:15.833332 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a03402a-96a4-41fe-9292-4990e788d24c None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:15.833332 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a03402a-96a4-41fe-9292-4990e788d24c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:15.851610 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-6a03402a-96a4-41fe-9292-4990e788d24c None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:42:15.852768 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-6a03402a-96a4-41fe-9292-4990e788d24c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:42:15.897366 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:15.923142 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 371/739] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:42:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 21:42:15.924281 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a03402a-96a4-41fe-9292-4990e788d24c None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:15.974607 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06669899-892d-4010-839a-007fe12055da None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:16.015218 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a860c9-ab42-4d73-b1ae-102d7debe38e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:16.017672 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a860c9-ab42-4d73-b1ae-102d7debe38e None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:16.018160 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a860c9-ab42-4d73-b1ae-102d7debe38e None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:16.018632 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a860c9-ab42-4d73-b1ae-102d7debe38e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:16.021907 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:16.031482 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a860c9-ab42-4d73-b1ae-102d7debe38e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:16.033732 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a860c9-ab42-4d73-b1ae-102d7debe38e None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:16.036099 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a03402a-96a4-41fe-9292-4990e788d24c None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:16.049337 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application [None req-a9a860c9-ab42-4d73-b1ae-102d7debe38e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:42:16.049337 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:16.049337 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:42:16.049337 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:42:16.049337 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:42:16.049337 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:42:16.049337 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:42:16.049337 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:42:16.049337 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:42:16.049337 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:42:16.049337 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:42:16.049337 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:42:16.049337 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 21:42:16.049337 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 21:42:16.049337 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 21:42:16.049337 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 21:42:16.050323 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:42:16.050323 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:42:16.050323 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:42:16.050323 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:42:16.050323 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:42:16.050323 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:42:16.050323 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:42:16.050323 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application with Lock( Aug 18 21:42:16.050323 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:42:16.050323 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:42:16.050323 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:42:16.050323 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:42:16.050323 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:42:16.050323 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:42:16.050323 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:42:16.050323 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:42:16.050323 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 21:42:16.051242 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 21:42:16.051242 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:42:16.051242 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:42:16.057736 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 369/740] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 18 21:42:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:42:16.058888 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a860c9-ab42-4d73-b1ae-102d7debe38e None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:16.074391 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5550b582-5dca-4157-bcb0-e786ca5b6a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:16.074974 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5550b582-5dca-4157-bcb0-e786ca5b6a6a None admin] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:16.075254 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5550b582-5dca-4157-bcb0-e786ca5b6a6a None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:16.075526 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5550b582-5dca-4157-bcb0-e786ca5b6a6a None admin] PATH_INFO: `/v3/services` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:16.076242 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5550b582-5dca-4157-bcb0-e786ca5b6a6a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:16.077706 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5550b582-5dca-4157-bcb0-e786ca5b6a6a None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:16.166111 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a860c9-ab42-4d73-b1ae-102d7debe38e None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:16.194630 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 372/741] 10.222.0.27 () {60 vars in 1141 bytes} [Thu Aug 18 21:42:15 2022] POST /identity/v3/services => generated 251 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:42:16.195672 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5550b582-5dca-4157-bcb0-e786ca5b6a6a None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:16.212449 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e73687-ddbf-4a47-860f-d386ea9d37da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:16.213246 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e73687-ddbf-4a47-860f-d386ea9d37da None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:16.213525 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e73687-ddbf-4a47-860f-d386ea9d37da None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:16.214930 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e73687-ddbf-4a47-860f-d386ea9d37da None admin] PATH_INFO: `/v3/domains` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:16.215640 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e73687-ddbf-4a47-860f-d386ea9d37da None admin] RBAC: Adding query filter params (name=Default) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:16.215946 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e73687-ddbf-4a47-860f-d386ea9d37da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:16.217394 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e73687-ddbf-4a47-860f-d386ea9d37da None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:16.231234 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 370/742] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 18 21:42:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:42:16.231939 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e73687-ddbf-4a47-860f-d386ea9d37da None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:16.251077 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:16.294912 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:16.334951 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5550b582-5dca-4157-bcb0-e786ca5b6a6a None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:16.362906 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e73687-ddbf-4a47-860f-d386ea9d37da None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:16.376399 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8ba459-6e4e-45ee-900f-a04e13ef802c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:16.377086 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8ba459-6e4e-45ee-900f-a04e13ef802c None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:16.377366 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8ba459-6e4e-45ee-900f-a04e13ef802c None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:16.377633 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8ba459-6e4e-45ee-900f-a04e13ef802c None admin] PATH_INFO: `/v3/domains` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:16.378274 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8ba459-6e4e-45ee-900f-a04e13ef802c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:16.378573 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8ba459-6e4e-45ee-900f-a04e13ef802c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:16.379934 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8ba459-6e4e-45ee-900f-a04e13ef802c None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:16.398443 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 373/743] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 18 21:42:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:42:16.398443 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8ba459-6e4e-45ee-900f-a04e13ef802c None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:16.404847 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408d56bf-0f7e-4fb5-a419-9c54a5c2bdc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:16.405464 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408d56bf-0f7e-4fb5-a419-9c54a5c2bdc9 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:16.405744 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408d56bf-0f7e-4fb5-a419-9c54a5c2bdc9 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:16.406021 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408d56bf-0f7e-4fb5-a419-9c54a5c2bdc9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:16.417550 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408d56bf-0f7e-4fb5-a419-9c54a5c2bdc9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:42:16.422863 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application [None req-408d56bf-0f7e-4fb5-a419-9c54a5c2bdc9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 21:42:16.422863 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:16.422863 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:42:16.422863 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:42:16.422863 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:42:16.422863 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:42:16.422863 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:42:16.422863 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:42:16.422863 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:42:16.422863 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:42:16.422863 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:42:16.422863 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:42:16.422863 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:42:16.422863 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:42:16.422863 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:42:16.422863 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:42:16.424082 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:42:16.424082 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:42:16.424082 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:42:16.424082 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:42:16.424082 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:42:16.424082 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:42:16.424082 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:42:16.424082 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:42:16.424082 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:42:16.424082 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:42:16.424082 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:42:16.424082 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application with Lock( Aug 18 21:42:16.424082 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:42:16.424082 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:42:16.424082 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:42:16.424082 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:42:16.425294 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:42:16.425294 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:42:16.425294 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:42:16.425294 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:42:16.425294 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:42:16.425294 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:42:16.425294 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:42:16.425294 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:42:16.425294 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:42:16.425294 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:42:16.425294 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 21:42:16.425294 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:42:16.425294 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 371/744] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Aug 18 21:42:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:42:16.425294 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408d56bf-0f7e-4fb5-a419-9c54a5c2bdc9 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:16.508353 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:16.514602 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8ba459-6e4e-45ee-900f-a04e13ef802c None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:16.538771 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408d56bf-0f7e-4fb5-a419-9c54a5c2bdc9 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:16.542264 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:16.553481 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdbe719-e854-4b21-9091-b0f088ce0a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:16.554084 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdbe719-e854-4b21-9091-b0f088ce0a0a None admin] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:16.554365 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdbe719-e854-4b21-9091-b0f088ce0a0a None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:16.554638 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdbe719-e854-4b21-9091-b0f088ce0a0a None admin] PATH_INFO: `/v3/services` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:16.555282 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdbe719-e854-4b21-9091-b0f088ce0a0a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:16.556667 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdbe719-e854-4b21-9091-b0f088ce0a0a None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:16.576492 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c37b24-c02b-49db-9240-c1116dd8f13c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:16.577155 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c37b24-c02b-49db-9240-c1116dd8f13c None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:16.577435 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c37b24-c02b-49db-9240-c1116dd8f13c None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:16.577708 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c37b24-c02b-49db-9240-c1116dd8f13c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:16.584854 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c37b24-c02b-49db-9240-c1116dd8f13c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:16.586297 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c37b24-c02b-49db-9240-c1116dd8f13c None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:16.597706 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application [None req-e2c37b24-c02b-49db-9240-c1116dd8f13c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 18 21:42:16.597706 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:16.597706 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:42:16.597706 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:42:16.597706 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:42:16.597706 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:42:16.597706 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:42:16.597706 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:42:16.597706 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:42:16.597706 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:42:16.597706 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:42:16.597706 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:42:16.597706 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 21:42:16.597706 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 21:42:16.597706 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 21:42:16.597706 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 21:42:16.604351 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:42:16.604351 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:42:16.604351 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 21:42:16.604351 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 21:42:16.604351 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 21:42:16.604351 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 21:42:16.604351 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:42:16.604351 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:42:16.604351 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:42:16.604351 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:42:16.604351 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:42:16.604351 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application with Lock( Aug 18 21:42:16.604351 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:42:16.604351 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:42:16.604351 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:42:16.604351 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:42:16.604351 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:42:16.604351 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:42:16.605565 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:42:16.605565 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:42:16.605565 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 21:42:16.605565 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 21:42:16.605565 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 21:42:16.605565 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 21:42:16.605565 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 21:42:16.605565 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 21:42:16.605565 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 18 21:42:16.605565 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:42:16.605565 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 372/745] 10.222.0.27 () {56 vars in 1117 bytes} [Thu Aug 18 21:42:16 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:42:16.605565 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c37b24-c02b-49db-9240-c1116dd8f13c None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:16.617181 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 374/746] 10.222.0.27 () {60 vars in 1141 bytes} [Thu Aug 18 21:42:16 2022] POST /identity/v3/services => generated 240 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:42:16.618663 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdbe719-e854-4b21-9091-b0f088ce0a0a None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:16.723329 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c37b24-c02b-49db-9240-c1116dd8f13c None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:16.777554 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec43b9ee-e83c-4e2d-90c4-5cdfb1ccec25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:16.778203 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec43b9ee-e83c-4e2d-90c4-5cdfb1ccec25 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:16.778481 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec43b9ee-e83c-4e2d-90c4-5cdfb1ccec25 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:16.778754 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec43b9ee-e83c-4e2d-90c4-5cdfb1ccec25 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:16.788892 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec43b9ee-e83c-4e2d-90c4-5cdfb1ccec25 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:16.789295 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdbe719-e854-4b21-9091-b0f088ce0a0a None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:16.791224 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec43b9ee-e83c-4e2d-90c4-5cdfb1ccec25 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:16.806837 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application [None req-ec43b9ee-e83c-4e2d-90c4-5cdfb1ccec25 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 21:42:16.806837 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:16.806837 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:42:16.806837 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:42:16.806837 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:42:16.806837 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:42:16.806837 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:42:16.806837 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:42:16.806837 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:42:16.806837 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:42:16.806837 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:42:16.806837 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:42:16.806837 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 21:42:16.806837 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 21:42:16.806837 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 21:42:16.807767 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 21:42:16.807767 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:42:16.807767 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:42:16.807767 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:42:16.807767 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:42:16.807767 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:42:16.807767 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:42:16.807767 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:42:16.807767 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application with Lock( Aug 18 21:42:16.807767 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:42:16.807767 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:42:16.807767 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:42:16.807767 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:42:16.807767 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:42:16.807767 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:42:16.807767 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:42:16.807767 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:42:16.809093 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 21:42:16.809093 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 21:42:16.809093 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 21:42:16.809093 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 21:42:16.809093 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 21:42:16.809093 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 21:42:16.809093 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 21:42:16.809093 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:42:16.809093 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 373/747] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Aug 18 21:42:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:42:16.809578 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec43b9ee-e83c-4e2d-90c4-5cdfb1ccec25 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:16.835144 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e52360-5f5d-4996-9e64-2666daff71f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:16.835144 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e52360-5f5d-4996-9e64-2666daff71f5 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:16.835433 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e52360-5f5d-4996-9e64-2666daff71f5 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:16.835570 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e52360-5f5d-4996-9e64-2666daff71f5 None admin] PATH_INFO: `/v3/roles` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:16.836230 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e52360-5f5d-4996-9e64-2666daff71f5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:16.836522 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e52360-5f5d-4996-9e64-2666daff71f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:16.837903 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e52360-5f5d-4996-9e64-2666daff71f5 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:16.840521 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:16.851852 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 375/748] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Aug 18 21:42:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:42:16.853288 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e52360-5f5d-4996-9e64-2666daff71f5 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:16.876633 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:16.931955 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec43b9ee-e83c-4e2d-90c4-5cdfb1ccec25 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:16.974672 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0581483e-1785-492b-b98b-2439908c6f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:16.975366 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0581483e-1785-492b-b98b-2439908c6f10 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:16.975833 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0581483e-1785-492b-b98b-2439908c6f10 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:16.976176 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0581483e-1785-492b-b98b-2439908c6f10 None admin] PATH_INFO: `/v3/users` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:16.977315 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0581483e-1785-492b-b98b-2439908c6f10 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:16.977831 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0581483e-1785-492b-b98b-2439908c6f10 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:16.979414 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0581483e-1785-492b-b98b-2439908c6f10 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:16.980041 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e52360-5f5d-4996-9e64-2666daff71f5 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:17.005967 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 374/749] 10.222.0.27 () {56 vars in 1149 bytes} [Thu Aug 18 21:42:16 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:42:17.005967 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0581483e-1785-492b-b98b-2439908c6f10 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:17.024984 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f992fa0e-5aad-4f0a-887f-3e30849a44cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:17.025985 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f992fa0e-5aad-4f0a-887f-3e30849a44cb None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:17.026263 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f992fa0e-5aad-4f0a-887f-3e30849a44cb None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:17.026669 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f992fa0e-5aad-4f0a-887f-3e30849a44cb None admin] PATH_INFO: `/v3/projects` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:17.027499 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f992fa0e-5aad-4f0a-887f-3e30849a44cb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:17.027801 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f992fa0e-5aad-4f0a-887f-3e30849a44cb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:17.029871 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f992fa0e-5aad-4f0a-887f-3e30849a44cb None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:17.046334 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 376/750] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Aug 18 21:42:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:42:17.048662 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f992fa0e-5aad-4f0a-887f-3e30849a44cb None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:17.095757 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:17.127256 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0581483e-1785-492b-b98b-2439908c6f10 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:17.147474 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:17.172438 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f992fa0e-5aad-4f0a-887f-3e30849a44cb None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:17.172700 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0fc32e-e377-4b34-b698-09c664f12075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:17.173607 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0fc32e-e377-4b34-b698-09c664f12075 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:17.174286 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0fc32e-e377-4b34-b698-09c664f12075 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:17.174709 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0fc32e-e377-4b34-b698-09c664f12075 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:17.188701 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0fc32e-e377-4b34-b698-09c664f12075 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:17.190436 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0fc32e-e377-4b34-b698-09c664f12075 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:17.207109 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application [None req-0d0fc32e-e377-4b34-b698-09c664f12075 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:42:17.207109 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:17.207109 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:42:17.207109 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:42:17.207109 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:42:17.207109 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:42:17.207109 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:42:17.207109 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:42:17.207109 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:42:17.207109 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:42:17.207109 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:42:17.207109 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:42:17.207109 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 21:42:17.207109 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 21:42:17.207109 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 21:42:17.207109 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 21:42:17.209929 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:42:17.209929 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:42:17.209929 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:42:17.209929 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:42:17.209929 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:42:17.209929 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:42:17.209929 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:42:17.209929 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application with Lock( Aug 18 21:42:17.209929 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:42:17.209929 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:42:17.209929 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:42:17.209929 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:42:17.209929 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:42:17.209929 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:42:17.209929 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:42:17.209929 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:42:17.209929 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 21:42:17.210978 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 21:42:17.210978 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:42:17.210978 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:42:17.210978 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 375/751] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 18 21:42:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:42:17.210978 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0fc32e-e377-4b34-b698-09c664f12075 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:17.221585 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0519d1f-8711-4686-abd1-985ac4602184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:17.222662 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0519d1f-8711-4686-abd1-985ac4602184 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:17.223008 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0519d1f-8711-4686-abd1-985ac4602184 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:17.223290 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0519d1f-8711-4686-abd1-985ac4602184 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:17.306968 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0519d1f-8711-4686-abd1-985ac4602184 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:17.308529 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0519d1f-8711-4686-abd1-985ac4602184 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:17.346780 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0fc32e-e377-4b34-b698-09c664f12075 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:17.377911 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:17.383921 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1814d2c-792e-4e5f-82cc-c051ef8615e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:17.394409 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1814d2c-792e-4e5f-82cc-c051ef8615e7 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:17.394409 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1814d2c-792e-4e5f-82cc-c051ef8615e7 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:17.394409 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1814d2c-792e-4e5f-82cc-c051ef8615e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:17.394409 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1814d2c-792e-4e5f-82cc-c051ef8615e7 None admin] RBAC: Adding query filter params (role.id=0833202e2a3d47d1b6b3af57006641b1, scope.project.id=4b54801b90484d689034f838f85fc0a4, user.id=9ae59e6dca304c949942ae769acedc74) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:17.394409 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1814d2c-792e-4e5f-82cc-c051ef8615e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:17.394409 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1814d2c-792e-4e5f-82cc-c051ef8615e7 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:17.401075 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 376/752] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Aug 18 21:42:17 2022] GET /identity/v3/role_assignments?user.id=9ae59e6dca304c949942ae769acedc74&scope.project.id=4b54801b90484d689034f838f85fc0a4&role.id=0833202e2a3d47d1b6b3af57006641b1 => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:42:17.402063 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1814d2c-792e-4e5f-82cc-c051ef8615e7 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:17.409070 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:17.437128 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 377/753] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Aug 18 21:42:17 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 18 21:42:17.443138 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0519d1f-8711-4686-abd1-985ac4602184 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:17.554617 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0519d1f-8711-4686-abd1-985ac4602184 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:17.592272 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e2e897-c046-4828-ac27-c40c7d287ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:17.593664 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e2e897-c046-4828-ac27-c40c7d287ab2 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:17.594855 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e2e897-c046-4828-ac27-c40c7d287ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:17.595359 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e2e897-c046-4828-ac27-c40c7d287ab2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:17.608564 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e2e897-c046-4828-ac27-c40c7d287ab2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:17.611176 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e2e897-c046-4828-ac27-c40c7d287ab2 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:17.631835 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application [None req-09e2e897-c046-4828-ac27-c40c7d287ab2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:42:17.631835 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:17.631835 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:42:17.631835 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:42:17.631835 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:42:17.631835 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:42:17.631835 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:42:17.631835 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:42:17.631835 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:42:17.631835 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:42:17.631835 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:42:17.631835 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:42:17.631835 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 21:42:17.631835 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 21:42:17.631835 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 21:42:17.631835 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 21:42:17.632875 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:42:17.632875 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:42:17.632875 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:42:17.632875 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:42:17.632875 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:42:17.632875 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:42:17.632875 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:42:17.632875 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application with Lock( Aug 18 21:42:17.632875 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:42:17.632875 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:42:17.632875 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:42:17.632875 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:42:17.632875 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:42:17.632875 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:42:17.632875 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:42:17.632875 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:42:17.632875 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 21:42:17.633769 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 21:42:17.633769 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:42:17.633769 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:42:17.641622 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 378/754] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 18 21:42:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:42:17.643808 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e2e897-c046-4828-ac27-c40c7d287ab2 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:17.663036 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1814d2c-792e-4e5f-82cc-c051ef8615e7 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:17.716998 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:17.721340 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a31cd9a-6e35-479d-800c-7c4622c7b41c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:17.722406 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a31cd9a-6e35-479d-800c-7c4622c7b41c None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:17.722406 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a31cd9a-6e35-479d-800c-7c4622c7b41c None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:17.722583 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a31cd9a-6e35-479d-800c-7c4622c7b41c None admin] PATH_INFO: `/v3/domains` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:17.723147 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a31cd9a-6e35-479d-800c-7c4622c7b41c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:17.723450 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a31cd9a-6e35-479d-800c-7c4622c7b41c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:17.725233 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a31cd9a-6e35-479d-800c-7c4622c7b41c None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:17.753085 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 377/755] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 18 21:42:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:42:17.758066 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a31cd9a-6e35-479d-800c-7c4622c7b41c None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:17.788573 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e2e897-c046-4828-ac27-c40c7d287ab2 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:17.823401 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:17.826513 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311ac781-583b-49e9-8251-a55124249ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:17.827399 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311ac781-583b-49e9-8251-a55124249ea5 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:17.827880 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311ac781-583b-49e9-8251-a55124249ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:17.828609 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311ac781-583b-49e9-8251-a55124249ea5 None admin] PATH_INFO: `/v3/domains` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:17.829558 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311ac781-583b-49e9-8251-a55124249ea5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:17.830037 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311ac781-583b-49e9-8251-a55124249ea5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:17.831567 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311ac781-583b-49e9-8251-a55124249ea5 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:17.849222 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 379/756] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 18 21:42:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:42:17.851500 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311ac781-583b-49e9-8251-a55124249ea5 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:17.888920 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a31cd9a-6e35-479d-800c-7c4622c7b41c None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:17.961286 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311ac781-583b-49e9-8251-a55124249ea5 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:17.998103 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bf9ee4-325c-4249-aa9e-bcf03b9e5154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:17.999106 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bf9ee4-325c-4249-aa9e-bcf03b9e5154 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:17.999681 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bf9ee4-325c-4249-aa9e-bcf03b9e5154 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:18.000190 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bf9ee4-325c-4249-aa9e-bcf03b9e5154 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:18.001415 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:18.009119 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bf9ee4-325c-4249-aa9e-bcf03b9e5154 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:18.009340 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3b8ee5-77a6-454f-98c9-561c66cfd2c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:18.009938 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3b8ee5-77a6-454f-98c9-561c66cfd2c2 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:18.010224 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3b8ee5-77a6-454f-98c9-561c66cfd2c2 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:18.010500 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3b8ee5-77a6-454f-98c9-561c66cfd2c2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:18.011823 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bf9ee4-325c-4249-aa9e-bcf03b9e5154 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:18.025811 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application [None req-b4bf9ee4-325c-4249-aa9e-bcf03b9e5154 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 21:42:18.025811 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:18.025811 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:42:18.025811 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:42:18.025811 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:42:18.025811 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:42:18.025811 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:42:18.025811 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:42:18.025811 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:42:18.025811 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:42:18.025811 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:42:18.025811 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:42:18.025811 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 21:42:18.025811 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 21:42:18.025811 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 21:42:18.033564 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 21:42:18.033564 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:42:18.033564 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:42:18.033564 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:42:18.033564 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:42:18.033564 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:42:18.033564 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:42:18.033564 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:42:18.033564 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application with Lock( Aug 18 21:42:18.033564 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:42:18.033564 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:42:18.033564 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:42:18.033564 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:42:18.033564 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:42:18.033564 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:42:18.033564 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:42:18.033564 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:42:18.034479 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 21:42:18.034479 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 21:42:18.034479 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 21:42:18.034479 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 21:42:18.034479 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 21:42:18.034479 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 21:42:18.034479 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 21:42:18.034479 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:42:18.034479 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 380/757] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Aug 18 21:42:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 21:42:18.034948 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3b8ee5-77a6-454f-98c9-561c66cfd2c2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:18.034948 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3b8ee5-77a6-454f-98c9-561c66cfd2c2 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:18.036957 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bf9ee4-325c-4249-aa9e-bcf03b9e5154 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:18.059380 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application [None req-ad3b8ee5-77a6-454f-98c9-561c66cfd2c2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 18 21:42:18.059380 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:18.059380 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:42:18.059380 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:42:18.059380 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:42:18.059380 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:42:18.059380 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:42:18.059380 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:42:18.059380 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:42:18.059380 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:42:18.059380 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:42:18.059380 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:42:18.059380 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 21:42:18.059380 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 21:42:18.059380 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 21:42:18.059380 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 21:42:18.060382 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:42:18.060382 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:42:18.060382 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 21:42:18.060382 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 21:42:18.060382 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 21:42:18.060382 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 21:42:18.060382 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:42:18.060382 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:42:18.060382 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:42:18.060382 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:42:18.060382 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:42:18.060382 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application with Lock( Aug 18 21:42:18.060382 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:42:18.060382 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:42:18.060382 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:42:18.060382 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:42:18.060382 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:42:18.060382 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:42:18.062000 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:42:18.062000 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:42:18.062000 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 21:42:18.062000 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 21:42:18.062000 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 21:42:18.062000 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 21:42:18.062000 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 21:42:18.062000 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 21:42:18.062000 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 18 21:42:18.062000 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:42:18.062000 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 378/758] 10.222.0.27 () {56 vars in 1093 bytes} [Thu Aug 18 21:42:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 21:42:18.068625 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3b8ee5-77a6-454f-98c9-561c66cfd2c2 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:18.180815 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bf9ee4-325c-4249-aa9e-bcf03b9e5154 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:18.246063 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3b8ee5-77a6-454f-98c9-561c66cfd2c2 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:18.277169 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:18.289165 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6f13f9-da6a-4fce-80cb-93aaac734328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:18.289165 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6f13f9-da6a-4fce-80cb-93aaac734328 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:18.289165 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6f13f9-da6a-4fce-80cb-93aaac734328 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:18.289165 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6f13f9-da6a-4fce-80cb-93aaac734328 None admin] PATH_INFO: `/v3/projects` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:18.289788 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6f13f9-da6a-4fce-80cb-93aaac734328 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:18.289788 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6f13f9-da6a-4fce-80cb-93aaac734328 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:18.296618 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6f13f9-da6a-4fce-80cb-93aaac734328 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:18.312445 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f53ef7-ee17-4909-9bce-933093baaab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:18.313617 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f53ef7-ee17-4909-9bce-933093baaab0 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:18.313951 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f53ef7-ee17-4909-9bce-933093baaab0 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:18.314271 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f53ef7-ee17-4909-9bce-933093baaab0 None admin] PATH_INFO: `/v3/users` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:18.315016 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f53ef7-ee17-4909-9bce-933093baaab0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:18.315323 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f53ef7-ee17-4909-9bce-933093baaab0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:18.316795 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f53ef7-ee17-4909-9bce-933093baaab0 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:18.324772 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 381/759] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Aug 18 21:42:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 21:42:18.327296 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a9776b-9555-4eb3-ae64-e5b245528b2c None None] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:18.328047 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a9776b-9555-4eb3-ae64-e5b245528b2c None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:18.329359 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a9776b-9555-4eb3-ae64-e5b245528b2c None None] PATH_INFO: `/` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:18.333596 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 382/760] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:42:18 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:42:18.335509 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 379/761] 10.222.0.27 () {56 vars in 1133 bytes} [Thu Aug 18 21:42:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:42:18.338579 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a9776b-9555-4eb3-ae64-e5b245528b2c None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:18.340565 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f53ef7-ee17-4909-9bce-933093baaab0 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:18.358031 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:18.465303 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a9776b-9555-4eb3-ae64-e5b245528b2c None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:18.504799 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85d8751-4b79-491e-aa46-4601f72be8db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:18.505406 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85d8751-4b79-491e-aa46-4601f72be8db None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:18.505687 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85d8751-4b79-491e-aa46-4601f72be8db None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:18.505976 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85d8751-4b79-491e-aa46-4601f72be8db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:18.506861 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85d8751-4b79-491e-aa46-4601f72be8db None admin] RBAC: Adding query filter params (role.id=30d8ac11e30e4b1d83940485e98d147c, scope.project.id=4b54801b90484d689034f838f85fc0a4, user.id=f079aa6ed5594a4982172b51b93ac54f) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:18.507256 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85d8751-4b79-491e-aa46-4601f72be8db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:18.508702 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85d8751-4b79-491e-aa46-4601f72be8db None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:18.520632 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 383/762] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Aug 18 21:42:18 2022] GET /identity/v3/role_assignments?user.id=f079aa6ed5594a4982172b51b93ac54f&scope.project.id=4b54801b90484d689034f838f85fc0a4&role.id=30d8ac11e30e4b1d83940485e98d147c => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:42:18.520632 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d406d3f-e210-4969-af3c-41c9993624b8 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:18.520632 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d406d3f-e210-4969-af3c-41c9993624b8 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:18.520632 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d406d3f-e210-4969-af3c-41c9993624b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:18.539132 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-2d406d3f-e210-4969-af3c-41c9993624b8 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:42:18.540360 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-2d406d3f-e210-4969-af3c-41c9993624b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:42:18.541004 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f53ef7-ee17-4909-9bce-933093baaab0 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:18.616077 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 384/763] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:42:18 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 21:42:18.634269 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561cde62-7697-45e0-82e9-1930791ad17d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:18.635386 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561cde62-7697-45e0-82e9-1930791ad17d None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:18.635873 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561cde62-7697-45e0-82e9-1930791ad17d None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:18.636405 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561cde62-7697-45e0-82e9-1930791ad17d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:18.650657 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561cde62-7697-45e0-82e9-1930791ad17d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:18.652623 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561cde62-7697-45e0-82e9-1930791ad17d None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:18.671049 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application [None req-561cde62-7697-45e0-82e9-1930791ad17d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:42:18.671049 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:18.671049 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:42:18.671049 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:42:18.671049 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:42:18.671049 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:42:18.671049 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:42:18.671049 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:42:18.671049 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:42:18.671049 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:42:18.671049 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:42:18.671049 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:42:18.671049 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 21:42:18.671049 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 21:42:18.671049 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 21:42:18.671049 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 21:42:18.672101 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:42:18.672101 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:42:18.672101 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:42:18.672101 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:42:18.672101 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:42:18.672101 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:42:18.672101 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:42:18.672101 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application with Lock( Aug 18 21:42:18.672101 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:42:18.672101 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:42:18.672101 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:42:18.672101 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:42:18.672101 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:42:18.672101 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:42:18.672101 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:42:18.672101 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:42:18.672101 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 21:42:18.673988 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 21:42:18.673988 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:42:18.673988 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:42:18.676350 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 380/764] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 18 21:42:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:42:18.681718 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d406d3f-e210-4969-af3c-41c9993624b8 None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:18.685401 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:18.804361 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8e1edf-ab51-4381-b04a-97aa884fa92a None None] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:18.805153 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8e1edf-ab51-4381-b04a-97aa884fa92a None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:18.805633 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8e1edf-ab51-4381-b04a-97aa884fa92a None None] PATH_INFO: `/` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:18.807322 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 381/765] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:42:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 21:42:18.814854 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac37f39d-f5dc-487d-af4b-30b07e14d731 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:18.815447 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac37f39d-f5dc-487d-af4b-30b07e14d731 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:18.816012 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac37f39d-f5dc-487d-af4b-30b07e14d731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:18.825904 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d406d3f-e210-4969-af3c-41c9993624b8 None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:18.854653 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-ac37f39d-f5dc-487d-af4b-30b07e14d731 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:42:18.856252 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-ac37f39d-f5dc-487d-af4b-30b07e14d731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:42:18.871151 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340e5be7-acc4-44b1-81c3-4f1e13b2b211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:18.871767 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340e5be7-acc4-44b1-81c3-4f1e13b2b211 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:18.872048 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340e5be7-acc4-44b1-81c3-4f1e13b2b211 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:18.872326 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340e5be7-acc4-44b1-81c3-4f1e13b2b211 None admin] PATH_INFO: `/v3/domains` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:18.873017 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340e5be7-acc4-44b1-81c3-4f1e13b2b211 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:18.873379 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340e5be7-acc4-44b1-81c3-4f1e13b2b211 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:18.877562 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340e5be7-acc4-44b1-81c3-4f1e13b2b211 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:18.897084 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:18.899300 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 385/766] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 18 21:42:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:42:18.904622 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340e5be7-acc4-44b1-81c3-4f1e13b2b211 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:18.994856 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:19.005893 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 382/767] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:42:18 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 21:42:19.012124 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac37f39d-f5dc-487d-af4b-30b07e14d731 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:19.044336 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340e5be7-acc4-44b1-81c3-4f1e13b2b211 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:19.091799 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf498d6-3f79-47b5-99e9-cd648539b1da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:19.093767 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf498d6-3f79-47b5-99e9-cd648539b1da None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:19.095170 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf498d6-3f79-47b5-99e9-cd648539b1da None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:19.096914 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf498d6-3f79-47b5-99e9-cd648539b1da None admin] PATH_INFO: `/v3/projects/service` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:19.110675 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf498d6-3f79-47b5-99e9-cd648539b1da None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:19.112784 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf498d6-3f79-47b5-99e9-cd648539b1da None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:19.129352 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application [None req-2bf498d6-3f79-47b5-99e9-cd648539b1da None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 21:42:19.129352 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:19.129352 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:42:19.129352 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:42:19.129352 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:42:19.129352 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:42:19.129352 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:42:19.129352 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:42:19.129352 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:42:19.129352 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:42:19.129352 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:42:19.129352 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:42:19.129352 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 21:42:19.129352 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 21:42:19.129352 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 21:42:19.132306 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 21:42:19.132306 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:42:19.132306 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:42:19.132306 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:42:19.132306 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:42:19.132306 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:42:19.132306 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:42:19.132306 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:42:19.132306 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application with Lock( Aug 18 21:42:19.132306 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:42:19.132306 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:42:19.132306 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:42:19.132306 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:42:19.132306 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:42:19.132306 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:42:19.132306 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:42:19.132306 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:42:19.133447 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 21:42:19.133447 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 21:42:19.133447 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 21:42:19.133447 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 21:42:19.133447 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 21:42:19.133447 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 21:42:19.133447 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 21:42:19.133447 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:42:19.133447 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 386/768] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Aug 18 21:42:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:42:19.136457 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf498d6-3f79-47b5-99e9-cd648539b1da None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:19.161044 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac37f39d-f5dc-487d-af4b-30b07e14d731 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:19.229491 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe2ea0b-a951-4141-b21c-0479713877a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:19.230619 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe2ea0b-a951-4141-b21c-0479713877a3 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:19.232076 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe2ea0b-a951-4141-b21c-0479713877a3 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:19.233103 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe2ea0b-a951-4141-b21c-0479713877a3 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:19.235597 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe2ea0b-a951-4141-b21c-0479713877a3 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:19.237652 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe2ea0b-a951-4141-b21c-0479713877a3 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:19.256853 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application [None req-dfe2ea0b-a951-4141-b21c-0479713877a3 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 18 21:42:19.256853 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:19.256853 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 21:42:19.256853 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 21:42:19.256853 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 21:42:19.256853 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 21:42:19.256853 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 21:42:19.256853 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 21:42:19.256853 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 18 21:42:19.256853 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:42:19.256853 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 21:42:19.256853 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:42:19.256853 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:19.256853 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:42:19.256853 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:42:19.256853 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:42:19.256853 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:42:19.258325 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:42:19.258325 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:42:19.258325 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:42:19.258325 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:42:19.258325 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:42:19.258325 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:42:19.258325 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 21:42:19.258325 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 21:42:19.258325 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 21:42:19.258325 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 21:42:19.258325 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:42:19.258325 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:42:19.258325 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:42:19.258325 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:42:19.258325 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:42:19.258325 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:42:19.259166 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:42:19.259166 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application with Lock( Aug 18 21:42:19.259166 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:42:19.259166 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:42:19.259166 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:42:19.259166 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:42:19.259166 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:42:19.259166 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:42:19.259166 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:42:19.259166 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:42:19.259166 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 21:42:19.259166 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 21:42:19.259166 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 18 21:42:19.259166 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:42:19.275527 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 383/769] 10.222.0.27 () {56 vars in 1129 bytes} [Thu Aug 18 21:42:19 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 21:42:19.278827 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe2ea0b-a951-4141-b21c-0479713877a3 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:19.318448 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:19.339893 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf498d6-3f79-47b5-99e9-cd648539b1da None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:19.374343 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:19.388293 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5fa6a6-a218-4902-9d0a-55b55cda92df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:19.389092 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5fa6a6-a218-4902-9d0a-55b55cda92df None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:19.389585 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5fa6a6-a218-4902-9d0a-55b55cda92df None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:19.390051 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5fa6a6-a218-4902-9d0a-55b55cda92df None admin] PATH_INFO: `/v3/projects` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:19.392134 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5fa6a6-a218-4902-9d0a-55b55cda92df None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:19.392681 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5fa6a6-a218-4902-9d0a-55b55cda92df None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:19.394143 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5fa6a6-a218-4902-9d0a-55b55cda92df None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:19.407584 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 387/770] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Aug 18 21:42:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:42:19.408433 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5fa6a6-a218-4902-9d0a-55b55cda92df None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:19.442909 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe2ea0b-a951-4141-b21c-0479713877a3 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:19.495452 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48db3ee1-b457-47ac-93e0-35d38a0fb417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:19.496647 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48db3ee1-b457-47ac-93e0-35d38a0fb417 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:19.497280 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48db3ee1-b457-47ac-93e0-35d38a0fb417 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:19.497760 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48db3ee1-b457-47ac-93e0-35d38a0fb417 None admin] PATH_INFO: `/v3/services` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:19.498907 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48db3ee1-b457-47ac-93e0-35d38a0fb417 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:19.499465 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48db3ee1-b457-47ac-93e0-35d38a0fb417 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:19.502483 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48db3ee1-b457-47ac-93e0-35d38a0fb417 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:19.509727 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 384/771] 10.222.0.27 () {56 vars in 1124 bytes} [Thu Aug 18 21:42:19 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:42:19.510910 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48db3ee1-b457-47ac-93e0-35d38a0fb417 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:19.519867 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5fa6a6-a218-4902-9d0a-55b55cda92df None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:19.556554 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e25dec4-e173-432b-a255-f06de00c82a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:19.557207 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e25dec4-e173-432b-a255-f06de00c82a0 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:19.557489 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e25dec4-e173-432b-a255-f06de00c82a0 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:19.557850 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e25dec4-e173-432b-a255-f06de00c82a0 None admin] PATH_INFO: `/v3/services/network` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:19.558341 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e25dec4-e173-432b-a255-f06de00c82a0 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:19.559765 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e25dec4-e173-432b-a255-f06de00c82a0 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:19.572051 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application [None req-7e25dec4-e173-432b-a255-f06de00c82a0 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 18 21:42:19.572051 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:19.572051 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 21:42:19.572051 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 21:42:19.572051 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 21:42:19.572051 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 21:42:19.572051 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 21:42:19.572051 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 21:42:19.572051 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 18 21:42:19.572051 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:42:19.572051 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 21:42:19.572051 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:42:19.572051 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:19.572051 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:42:19.572051 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:42:19.572051 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:42:19.572051 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:42:19.573340 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:42:19.573340 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:42:19.573340 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:42:19.573340 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:42:19.573340 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:42:19.573340 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:42:19.573340 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 21:42:19.573340 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 21:42:19.573340 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 21:42:19.573340 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 21:42:19.573340 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:42:19.573340 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:42:19.573340 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:42:19.573340 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:42:19.573340 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:42:19.573340 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:42:19.574614 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:42:19.574614 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application with Lock( Aug 18 21:42:19.574614 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:42:19.574614 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:42:19.574614 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:42:19.574614 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:42:19.574614 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:42:19.574614 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:42:19.574614 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:42:19.574614 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:42:19.574614 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 21:42:19.574614 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 21:42:19.574614 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 18 21:42:19.574614 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:42:19.574614 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 388/772] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Aug 18 21:42:19 2022] GET /identity/v3/services/network => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:42:19.575417 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e25dec4-e173-432b-a255-f06de00c82a0 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:19.630707 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:19.634713 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:19.657877 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48db3ee1-b457-47ac-93e0-35d38a0fb417 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:19.693838 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e25dec4-e173-432b-a255-f06de00c82a0 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:19.700207 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a98ab23-9c16-4f92-8114-fc9308b1f415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:19.701195 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a98ab23-9c16-4f92-8114-fc9308b1f415 None admin] REQUEST_METHOD: `PUT` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:19.701689 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a98ab23-9c16-4f92-8114-fc9308b1f415 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:19.702169 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a98ab23-9c16-4f92-8114-fc9308b1f415 None admin] PATH_INFO: `/v3/projects/4b54801b90484d689034f838f85fc0a4/users/a39cd50340184779ac589bbcb7cac9aa/roles/0833202e2a3d47d1b6b3af57006641b1` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:19.705511 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a98ab23-9c16-4f92-8114-fc9308b1f415 None admin] RBAC: Authorizing `identity:create_grant(project_id=4b54801b90484d689034f838f85fc0a4, user_id=a39cd50340184779ac589bbcb7cac9aa, role_id=0833202e2a3d47d1b6b3af57006641b1)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:19.708395 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a98ab23-9c16-4f92-8114-fc9308b1f415 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:19.732899 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d21733-affd-42ac-9390-7e42054e0afc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:19.733514 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d21733-affd-42ac-9390-7e42054e0afc None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:19.733792 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d21733-affd-42ac-9390-7e42054e0afc None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:19.734118 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d21733-affd-42ac-9390-7e42054e0afc None admin] PATH_INFO: `/v3/services` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:19.734710 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d21733-affd-42ac-9390-7e42054e0afc None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:19.735636 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d21733-affd-42ac-9390-7e42054e0afc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:19.737137 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d21733-affd-42ac-9390-7e42054e0afc None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:19.742474 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 389/773] 10.222.0.27 () {56 vars in 1124 bytes} [Thu Aug 18 21:42:19 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:42:19.743070 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d21733-affd-42ac-9390-7e42054e0afc None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:19.790587 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 385/774] 10.222.0.27 () {58 vars in 1439 bytes} [Thu Aug 18 21:42:19 2022] PUT /identity/v3/projects/4b54801b90484d689034f838f85fc0a4/users/a39cd50340184779ac589bbcb7cac9aa/roles/0833202e2a3d47d1b6b3af57006641b1 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:42:19.793172 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a98ab23-9c16-4f92-8114-fc9308b1f415 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:19.900715 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d21733-affd-42ac-9390-7e42054e0afc None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:19.916887 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:19.928435 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a98ab23-9c16-4f92-8114-fc9308b1f415 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:19.942260 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b54602-7bd0-4840-bcce-3f7c6b92692d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:19.942977 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b54602-7bd0-4840-bcce-3f7c6b92692d None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:19.943159 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b54602-7bd0-4840-bcce-3f7c6b92692d None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:19.943488 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b54602-7bd0-4840-bcce-3f7c6b92692d None admin] PATH_INFO: `/v3/services` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:19.944062 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b54602-7bd0-4840-bcce-3f7c6b92692d None admin] RBAC: Adding query filter params (name=network) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:19.944366 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b54602-7bd0-4840-bcce-3f7c6b92692d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:19.946988 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b54602-7bd0-4840-bcce-3f7c6b92692d None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:19.952440 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 390/775] 10.222.0.27 () {56 vars in 1112 bytes} [Thu Aug 18 21:42:19 2022] GET /identity/v3/services?name=network => generated 124 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:42:19.954558 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aa4f1c-0530-4fb5-a243-0bafc1366ef9 None None] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:19.954775 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aa4f1c-0530-4fb5-a243-0bafc1366ef9 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:19.955054 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aa4f1c-0530-4fb5-a243-0bafc1366ef9 None None] PATH_INFO: `/` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:19.956570 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 391/776] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:42:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:42:19.961464 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aa4f1c-0530-4fb5-a243-0bafc1366ef9 None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:19.971416 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124d3a93-4df9-4230-b43d-fea3eca7e683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:19.972277 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124d3a93-4df9-4230-b43d-fea3eca7e683 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:19.972737 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124d3a93-4df9-4230-b43d-fea3eca7e683 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:19.973194 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124d3a93-4df9-4230-b43d-fea3eca7e683 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:19.974100 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124d3a93-4df9-4230-b43d-fea3eca7e683 None admin] RBAC: Adding query filter params (interface=public, service_id=f73cd1538373456e8e025c509fc0e534, region_id=RegionOne) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:19.974557 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124d3a93-4df9-4230-b43d-fea3eca7e683 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:19.976140 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124d3a93-4df9-4230-b43d-fea3eca7e683 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:19.984647 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 386/777] 10.222.0.27 () {56 vars in 1251 bytes} [Thu Aug 18 21:42:19 2022] GET /identity/v3/endpoints?service_id=f73cd1538373456e8e025c509fc0e534&interface=public®ion_id=RegionOne => generated 194 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:42:19.986714 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdebb40-7b21-4be5-9f12-2c41dfe5f626 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:19.987155 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdebb40-7b21-4be5-9f12-2c41dfe5f626 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:19.987578 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdebb40-7b21-4be5-9f12-2c41dfe5f626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:20.002664 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:20.008540 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-8cdebb40-7b21-4be5-9f12-2c41dfe5f626 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:42:20.009836 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-8cdebb40-7b21-4be5-9f12-2c41dfe5f626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:42:20.079839 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aa4f1c-0530-4fb5-a243-0bafc1366ef9 None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:20.086437 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 387/778] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:42:19 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 21:42:20.092620 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdebb40-7b21-4be5-9f12-2c41dfe5f626 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:20.165453 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0078cce-fd3d-4793-89fd-4f5cb855ae5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:20.166319 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0078cce-fd3d-4793-89fd-4f5cb855ae5e None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:20.166752 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0078cce-fd3d-4793-89fd-4f5cb855ae5e None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:20.167173 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0078cce-fd3d-4793-89fd-4f5cb855ae5e None admin] PATH_INFO: `/v3/services` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:20.167962 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0078cce-fd3d-4793-89fd-4f5cb855ae5e None admin] RBAC: Adding query filter params (type=network) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:20.168509 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0078cce-fd3d-4793-89fd-4f5cb855ae5e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:20.170084 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0078cce-fd3d-4793-89fd-4f5cb855ae5e None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:20.187046 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 392/779] 10.222.0.27 () {56 vars in 1112 bytes} [Thu Aug 18 21:42:19 2022] GET /identity/v3/services?type=network => generated 350 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:42:20.197580 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0078cce-fd3d-4793-89fd-4f5cb855ae5e None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:20.200960 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdebb40-7b21-4be5-9f12-2c41dfe5f626 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:20.239090 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5739e7e1-3a90-4ebb-9690-0fd5fd9d0e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:20.239756 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5739e7e1-3a90-4ebb-9690-0fd5fd9d0e25 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:20.240040 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5739e7e1-3a90-4ebb-9690-0fd5fd9d0e25 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:20.240318 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5739e7e1-3a90-4ebb-9690-0fd5fd9d0e25 None admin] PATH_INFO: `/v3/services` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:20.241061 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5739e7e1-3a90-4ebb-9690-0fd5fd9d0e25 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:20.242456 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5739e7e1-3a90-4ebb-9690-0fd5fd9d0e25 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:20.248180 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:20.248477 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 388/780] 10.222.0.27 () {56 vars in 1087 bytes} [Thu Aug 18 21:42:20 2022] GET /identity/v3/services => generated 772 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:42:20.290062 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:20.475997 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0078cce-fd3d-4793-89fd-4f5cb855ae5e None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:20.518405 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cfc985-765e-41d3-916b-bf3e0bca1f52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:20.519022 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cfc985-765e-41d3-916b-bf3e0bca1f52 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:20.519301 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cfc985-765e-41d3-916b-bf3e0bca1f52 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:20.519574 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cfc985-765e-41d3-916b-bf3e0bca1f52 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:20.520283 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cfc985-765e-41d3-916b-bf3e0bca1f52 None admin] RBAC: Adding query filter params (interface=public, service_id=2cd5237d75b54d95bf20a94e793e4074, region_id=RegionOne) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:20.520923 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cfc985-765e-41d3-916b-bf3e0bca1f52 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:20.521974 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cfc985-765e-41d3-916b-bf3e0bca1f52 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:20.531586 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 393/781] 10.222.0.27 () {56 vars in 1251 bytes} [Thu Aug 18 21:42:20 2022] GET /identity/v3/endpoints?service_id=2cd5237d75b54d95bf20a94e793e4074&interface=public®ion_id=RegionOne => generated 194 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:42:20.536749 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5739e7e1-3a90-4ebb-9690-0fd5fd9d0e25 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:20.570752 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cfc985-765e-41d3-916b-bf3e0bca1f52 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:20.656019 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5739e7e1-3a90-4ebb-9690-0fd5fd9d0e25 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:20.693491 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e01c90-9d5c-4a76-becc-2aa994b9a10b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:20.694135 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e01c90-9d5c-4a76-becc-2aa994b9a10b None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:20.694416 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e01c90-9d5c-4a76-becc-2aa994b9a10b None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:20.694687 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e01c90-9d5c-4a76-becc-2aa994b9a10b None admin] PATH_INFO: `/v3/services` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:20.695290 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e01c90-9d5c-4a76-becc-2aa994b9a10b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:20.696736 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e01c90-9d5c-4a76-becc-2aa994b9a10b None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:20.702306 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 389/782] 10.222.0.27 () {56 vars in 1087 bytes} [Thu Aug 18 21:42:20 2022] GET /identity/v3/services => generated 772 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 21:42:20.707202 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cfc985-765e-41d3-916b-bf3e0bca1f52 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:20.745095 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:20.753075 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6769f3d2-f934-46af-82b8-71eede061eb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:20.753813 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6769f3d2-f934-46af-82b8-71eede061eb0 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:20.754095 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6769f3d2-f934-46af-82b8-71eede061eb0 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:20.754371 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6769f3d2-f934-46af-82b8-71eede061eb0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:20.770838 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6769f3d2-f934-46af-82b8-71eede061eb0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:42:20.774613 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4948368-743e-443b-b7fc-9c3f07dd9798 None None] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:20.774901 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4948368-743e-443b-b7fc-9c3f07dd9798 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:20.775178 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4948368-743e-443b-b7fc-9c3f07dd9798 None None] PATH_INFO: `/` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:20.776618 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application [None req-6769f3d2-f934-46af-82b8-71eede061eb0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 21:42:20.776618 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:20.776618 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:42:20.776618 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:42:20.776618 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:42:20.776618 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:42:20.776618 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:42:20.776618 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:42:20.776618 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:42:20.776618 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:42:20.776618 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:42:20.776618 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:42:20.776618 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:42:20.776618 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:42:20.776618 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:42:20.776618 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:42:20.777575 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:42:20.777575 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:42:20.777575 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:42:20.777575 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:42:20.777575 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:42:20.777575 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:42:20.777575 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:42:20.777575 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:42:20.777575 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:42:20.777575 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:42:20.777575 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:42:20.777575 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application with Lock( Aug 18 21:42:20.777575 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:42:20.777575 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:42:20.777575 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:42:20.777575 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:42:20.778424 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:42:20.778424 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:42:20.778424 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:42:20.778424 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:42:20.778424 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:42:20.778424 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:42:20.778424 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:42:20.778424 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:42:20.778424 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:42:20.778424 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:42:20.778424 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 21:42:20.778424 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:42:20.779067 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 390/783] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:42:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:42:20.782825 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 394/784] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Aug 18 21:42:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 21:42:20.785135 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f49310-24e8-485c-9df7-05d3a05c754a None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:20.785505 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f49310-24e8-485c-9df7-05d3a05c754a None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:20.785866 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f49310-24e8-485c-9df7-05d3a05c754a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:20.788394 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6769f3d2-f934-46af-82b8-71eede061eb0 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:20.827612 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-76f49310-24e8-485c-9df7-05d3a05c754a None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:42:20.829551 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-76f49310-24e8-485c-9df7-05d3a05c754a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:42:20.924386 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6769f3d2-f934-46af-82b8-71eede061eb0 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:20.935730 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:20.947486 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 391/785] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:42:20 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 21:42:20.967563 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbb2591-e2a3-4133-ba3f-8bfcf8317035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:20.968429 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbb2591-e2a3-4133-ba3f-8bfcf8317035 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:20.968887 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbb2591-e2a3-4133-ba3f-8bfcf8317035 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:20.969504 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbb2591-e2a3-4133-ba3f-8bfcf8317035 None admin] PATH_INFO: `/v3/roles` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:20.970394 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbb2591-e2a3-4133-ba3f-8bfcf8317035 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:20.970758 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbb2591-e2a3-4133-ba3f-8bfcf8317035 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:20.972252 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbb2591-e2a3-4133-ba3f-8bfcf8317035 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:20.982928 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 395/786] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Aug 18 21:42:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 21:42:20.988840 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f49310-24e8-485c-9df7-05d3a05c754a None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:21.096439 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f49310-24e8-485c-9df7-05d3a05c754a None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:21.133007 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e531a6c-af55-4ae8-b189-17e9e3d00927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:21.133723 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e531a6c-af55-4ae8-b189-17e9e3d00927 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:21.134016 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e531a6c-af55-4ae8-b189-17e9e3d00927 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:21.134290 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e531a6c-af55-4ae8-b189-17e9e3d00927 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:21.145851 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e531a6c-af55-4ae8-b189-17e9e3d00927 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:21.147313 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e531a6c-af55-4ae8-b189-17e9e3d00927 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:21.162944 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application [None req-9e531a6c-af55-4ae8-b189-17e9e3d00927 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:42:21.162944 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:21.162944 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:42:21.162944 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:42:21.162944 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:42:21.162944 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:42:21.162944 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:42:21.162944 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:42:21.162944 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:42:21.162944 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:42:21.162944 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:42:21.162944 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:42:21.162944 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 21:42:21.162944 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 21:42:21.162944 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 21:42:21.162944 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 21:42:21.167710 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:42:21.167710 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:42:21.167710 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:42:21.167710 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:42:21.167710 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:42:21.167710 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:42:21.167710 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:42:21.167710 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application with Lock( Aug 18 21:42:21.167710 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:42:21.167710 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:42:21.167710 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:42:21.167710 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:42:21.167710 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:42:21.167710 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:42:21.167710 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:42:21.167710 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:42:21.167710 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 21:42:21.169050 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 21:42:21.169050 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:42:21.169050 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:42:21.169050 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 392/787] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 18 21:42:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 21:42:21.170044 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbb2591-e2a3-4133-ba3f-8bfcf8317035 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:21.204325 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:21.287541 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e531a6c-af55-4ae8-b189-17e9e3d00927 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:21.304628 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbb2591-e2a3-4133-ba3f-8bfcf8317035 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:21.339862 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89da8706-6096-490c-8f38-c630d5a41e4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:21.340646 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89da8706-6096-490c-8f38-c630d5a41e4a None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:21.341086 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89da8706-6096-490c-8f38-c630d5a41e4a None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:21.341455 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89da8706-6096-490c-8f38-c630d5a41e4a None admin] PATH_INFO: `/v3/domains` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:21.344622 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89da8706-6096-490c-8f38-c630d5a41e4a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:21.344622 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89da8706-6096-490c-8f38-c630d5a41e4a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:21.344622 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89da8706-6096-490c-8f38-c630d5a41e4a None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:21.358127 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 396/788] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 18 21:42:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:42:21.363910 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89da8706-6096-490c-8f38-c630d5a41e4a None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:21.411128 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:21.506429 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:21.523774 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e531a6c-af55-4ae8-b189-17e9e3d00927 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:21.536794 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89da8706-6096-490c-8f38-c630d5a41e4a None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:21.581524 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a14e1a-7ddd-49ed-a612-5c7330769498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:21.582165 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a14e1a-7ddd-49ed-a612-5c7330769498 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:21.582443 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a14e1a-7ddd-49ed-a612-5c7330769498 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:21.582713 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a14e1a-7ddd-49ed-a612-5c7330769498 None admin] PATH_INFO: `/v3/users/swift` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:21.593629 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a14e1a-7ddd-49ed-a612-5c7330769498 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:21.595645 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a14e1a-7ddd-49ed-a612-5c7330769498 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:21.603436 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdcd722-fa51-4a43-8a9f-a91a68a6dd3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:21.604381 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdcd722-fa51-4a43-8a9f-a91a68a6dd3c None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:21.604801 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdcd722-fa51-4a43-8a9f-a91a68a6dd3c None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:21.605177 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdcd722-fa51-4a43-8a9f-a91a68a6dd3c None admin] PATH_INFO: `/v3/roles/service` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:21.609210 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application [None req-31a14e1a-7ddd-49ed-a612-5c7330769498 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 18 21:42:21.609210 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:21.609210 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:42:21.609210 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:42:21.609210 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:42:21.609210 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:42:21.609210 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:42:21.609210 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:42:21.609210 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:42:21.609210 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:42:21.609210 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:42:21.609210 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:42:21.609210 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 21:42:21.609210 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 21:42:21.609210 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 21:42:21.609210 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 21:42:21.611131 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:42:21.611131 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:42:21.611131 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 21:42:21.611131 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 21:42:21.611131 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 21:42:21.611131 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 21:42:21.611131 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:42:21.611131 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:42:21.611131 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:42:21.611131 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:42:21.611131 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:42:21.611131 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application with Lock( Aug 18 21:42:21.611131 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:42:21.611131 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:42:21.611131 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:42:21.611131 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:42:21.611131 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:42:21.611131 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:42:21.612095 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:42:21.612095 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:42:21.612095 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 21:42:21.612095 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 21:42:21.612095 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 21:42:21.612095 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 21:42:21.612095 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 21:42:21.612095 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 21:42:21.612095 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 18 21:42:21.612095 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:42:21.612095 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 397/789] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Aug 18 21:42:21 2022] GET /identity/v3/users/swift => generated 83 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:42:21.616582 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a14e1a-7ddd-49ed-a612-5c7330769498 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:21.620676 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdcd722-fa51-4a43-8a9f-a91a68a6dd3c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:42:21.626506 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application [None req-9fdcd722-fa51-4a43-8a9f-a91a68a6dd3c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 21:42:21.626506 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:21.626506 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:42:21.626506 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:42:21.626506 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:42:21.626506 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:42:21.626506 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:42:21.626506 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:42:21.626506 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:42:21.626506 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:42:21.626506 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:42:21.626506 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:42:21.626506 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:42:21.626506 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:42:21.626506 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:42:21.626506 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:42:21.627635 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:42:21.627635 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:42:21.627635 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:42:21.627635 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:42:21.627635 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:42:21.627635 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:42:21.627635 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:42:21.627635 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:42:21.627635 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:42:21.627635 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:42:21.627635 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:42:21.627635 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application with Lock( Aug 18 21:42:21.627635 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:42:21.627635 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:42:21.627635 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:42:21.627635 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:42:21.628501 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:42:21.628501 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:42:21.628501 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:42:21.628501 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:42:21.628501 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:42:21.628501 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:42:21.628501 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:42:21.628501 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:42:21.628501 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:42:21.628501 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:42:21.628501 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 21:42:21.628501 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:42:21.628501 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 393/790] 10.222.0.27 () {56 vars in 1102 bytes} [Thu Aug 18 21:42:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:42:21.633528 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdcd722-fa51-4a43-8a9f-a91a68a6dd3c None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:21.744727 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a14e1a-7ddd-49ed-a612-5c7330769498 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:21.788757 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baf5717-1d77-4efa-98cd-f342abf83afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:21.789391 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baf5717-1d77-4efa-98cd-f342abf83afb None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:21.790570 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baf5717-1d77-4efa-98cd-f342abf83afb None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:21.790850 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baf5717-1d77-4efa-98cd-f342abf83afb None admin] PATH_INFO: `/v3/users` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:21.791585 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baf5717-1d77-4efa-98cd-f342abf83afb None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:21.791890 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baf5717-1d77-4efa-98cd-f342abf83afb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:21.793344 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baf5717-1d77-4efa-98cd-f342abf83afb None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:21.815027 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 398/791] 10.222.0.27 () {56 vars in 1135 bytes} [Thu Aug 18 21:42:21 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 21:42:21.825634 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baf5717-1d77-4efa-98cd-f342abf83afb None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:21.829749 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:21.837298 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdcd722-fa51-4a43-8a9f-a91a68a6dd3c None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:21.845481 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:21.873894 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b31191-b7c8-496d-af8a-1370339cd176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:21.874433 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b31191-b7c8-496d-af8a-1370339cd176 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:21.874721 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b31191-b7c8-496d-af8a-1370339cd176 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:21.874998 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b31191-b7c8-496d-af8a-1370339cd176 None admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:21.875712 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b31191-b7c8-496d-af8a-1370339cd176 None admin] RBAC: Adding query filter params (name=service) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:21.876017 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b31191-b7c8-496d-af8a-1370339cd176 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:21.880371 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b31191-b7c8-496d-af8a-1370339cd176 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:21.900348 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 394/792] 10.222.0.27 () {56 vars in 1103 bytes} [Thu Aug 18 21:42:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 21:42:21.905889 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b31191-b7c8-496d-af8a-1370339cd176 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:21.996993 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baf5717-1d77-4efa-98cd-f342abf83afb None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:22.040972 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6297e8c6-cd64-4100-90c7-abb341b7db40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:22.041802 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6297e8c6-cd64-4100-90c7-abb341b7db40 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:22.042399 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6297e8c6-cd64-4100-90c7-abb341b7db40 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:22.042675 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6297e8c6-cd64-4100-90c7-abb341b7db40 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:22.048921 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b31191-b7c8-496d-af8a-1370339cd176 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:22.055257 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6297e8c6-cd64-4100-90c7-abb341b7db40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:22.056780 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6297e8c6-cd64-4100-90c7-abb341b7db40 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:22.075534 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application [None req-6297e8c6-cd64-4100-90c7-abb341b7db40 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:42:22.075534 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:22.075534 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:42:22.075534 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:42:22.075534 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:42:22.075534 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:42:22.075534 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:42:22.075534 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:42:22.075534 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:42:22.075534 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:42:22.075534 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:42:22.075534 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:42:22.075534 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 21:42:22.075534 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 21:42:22.075534 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 21:42:22.075534 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 21:42:22.077621 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:42:22.077621 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:42:22.077621 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:42:22.077621 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:42:22.077621 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:42:22.077621 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:42:22.077621 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:42:22.077621 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application with Lock( Aug 18 21:42:22.077621 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:42:22.077621 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:42:22.077621 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:42:22.077621 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:42:22.077621 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:42:22.077621 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:42:22.077621 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:42:22.077621 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:42:22.077621 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 21:42:22.080180 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 21:42:22.080180 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:42:22.080180 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:42:22.088628 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 399/793] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 18 21:42:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:42:22.088628 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c00251-a6ef-4053-b260-46c80d0ad5ed None None] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:22.088628 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c00251-a6ef-4053-b260-46c80d0ad5ed None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:22.088628 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c00251-a6ef-4053-b260-46c80d0ad5ed None None] PATH_INFO: `/` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:22.088628 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 400/794] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:42:22 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:42:22.088628 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c00251-a6ef-4053-b260-46c80d0ad5ed None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:22.098906 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b6aef5-7005-4004-9768-70bf1771f0b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:22.099540 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b6aef5-7005-4004-9768-70bf1771f0b3 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:22.099815 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b6aef5-7005-4004-9768-70bf1771f0b3 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:22.100084 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b6aef5-7005-4004-9768-70bf1771f0b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:22.113613 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b6aef5-7005-4004-9768-70bf1771f0b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:22.115113 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b6aef5-7005-4004-9768-70bf1771f0b3 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:22.136470 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application [None req-b3b6aef5-7005-4004-9768-70bf1771f0b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:42:22.136470 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:22.136470 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:42:22.136470 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:42:22.136470 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:42:22.136470 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:42:22.136470 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:42:22.136470 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:42:22.136470 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:42:22.136470 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:42:22.136470 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:42:22.136470 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:42:22.136470 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 21:42:22.136470 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 21:42:22.136470 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 21:42:22.136470 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 21:42:22.138363 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:42:22.138363 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:42:22.138363 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:42:22.138363 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:42:22.138363 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:42:22.138363 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:42:22.138363 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:42:22.138363 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application with Lock( Aug 18 21:42:22.138363 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:42:22.138363 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:42:22.138363 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:42:22.138363 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:42:22.138363 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:42:22.138363 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:42:22.138363 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:42:22.138363 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:42:22.138363 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 21:42:22.140256 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 21:42:22.140256 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:42:22.140256 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:42:22.144614 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 395/795] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 18 21:42:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 21:42:22.144614 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb72af2c-162d-409f-bde9-470c3a04311b None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:22.144614 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb72af2c-162d-409f-bde9-470c3a04311b None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:22.144614 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb72af2c-162d-409f-bde9-470c3a04311b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:22.162310 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:22.165207 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-bb72af2c-162d-409f-bde9-470c3a04311b None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:42:22.166604 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-bb72af2c-162d-409f-bde9-470c3a04311b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:42:22.182772 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:22.208888 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c00251-a6ef-4053-b260-46c80d0ad5ed None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:22.250352 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405b455b-80c6-4630-b262-c1ae93126102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:22.250352 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405b455b-80c6-4630-b262-c1ae93126102 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:22.250352 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405b455b-80c6-4630-b262-c1ae93126102 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:22.250352 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405b455b-80c6-4630-b262-c1ae93126102 None admin] PATH_INFO: `/v3/domains` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:22.251343 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405b455b-80c6-4630-b262-c1ae93126102 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:22.251343 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405b455b-80c6-4630-b262-c1ae93126102 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:22.251343 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405b455b-80c6-4630-b262-c1ae93126102 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:22.251804 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 396/796] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:42:22 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 21:42:22.253976 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb72af2c-162d-409f-bde9-470c3a04311b None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:22.270894 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 401/797] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 18 21:42:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:42:22.277240 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405b455b-80c6-4630-b262-c1ae93126102 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:22.440658 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb72af2c-162d-409f-bde9-470c3a04311b None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:22.448189 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405b455b-80c6-4630-b262-c1ae93126102 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:22.485361 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:22.509871 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c891f0-f5e9-4dce-8e69-c706166e7df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:22.510805 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c891f0-f5e9-4dce-8e69-c706166e7df5 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:22.511286 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c891f0-f5e9-4dce-8e69-c706166e7df5 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:22.511934 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c891f0-f5e9-4dce-8e69-c706166e7df5 None admin] PATH_INFO: `/v3/domains` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:22.513279 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c891f0-f5e9-4dce-8e69-c706166e7df5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:22.514141 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c891f0-f5e9-4dce-8e69-c706166e7df5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:22.517309 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c891f0-f5e9-4dce-8e69-c706166e7df5 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:22.519360 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf55597-9d25-4da3-b1e7-97f3a5a58490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:22.519991 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf55597-9d25-4da3-b1e7-97f3a5a58490 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:22.520273 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf55597-9d25-4da3-b1e7-97f3a5a58490 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:22.520561 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf55597-9d25-4da3-b1e7-97f3a5a58490 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:22.531006 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 397/798] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 18 21:42:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:42:22.531475 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf55597-9d25-4da3-b1e7-97f3a5a58490 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:22.535689 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf55597-9d25-4da3-b1e7-97f3a5a58490 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:22.536895 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c891f0-f5e9-4dce-8e69-c706166e7df5 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:22.546494 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application [None req-4cf55597-9d25-4da3-b1e7-97f3a5a58490 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 21:42:22.546494 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:22.546494 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:42:22.546494 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:42:22.546494 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:42:22.546494 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:42:22.546494 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:42:22.546494 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:42:22.546494 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:42:22.546494 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:42:22.546494 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:42:22.546494 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:42:22.546494 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 21:42:22.546494 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 21:42:22.546494 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 21:42:22.548331 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 21:42:22.548331 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:42:22.548331 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:42:22.548331 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:42:22.548331 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:42:22.548331 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:42:22.548331 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:42:22.548331 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:42:22.548331 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application with Lock( Aug 18 21:42:22.548331 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:42:22.548331 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:42:22.548331 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:42:22.548331 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:42:22.548331 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:42:22.548331 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:42:22.548331 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:42:22.548331 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:42:22.553762 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 21:42:22.553762 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 21:42:22.553762 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 21:42:22.553762 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 21:42:22.553762 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 21:42:22.553762 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 21:42:22.553762 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 21:42:22.553762 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:42:22.553762 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 402/799] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Aug 18 21:42:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 21:42:22.558621 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:22.566235 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf55597-9d25-4da3-b1e7-97f3a5a58490 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:22.653006 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c891f0-f5e9-4dce-8e69-c706166e7df5 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:22.683141 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf55597-9d25-4da3-b1e7-97f3a5a58490 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:22.690184 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6429454d-6743-406f-b858-4df517ad453d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:22.691165 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6429454d-6743-406f-b858-4df517ad453d None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:22.691649 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6429454d-6743-406f-b858-4df517ad453d None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:22.692121 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6429454d-6743-406f-b858-4df517ad453d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:22.701579 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6429454d-6743-406f-b858-4df517ad453d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:22.703166 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6429454d-6743-406f-b858-4df517ad453d None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:22.715280 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application [None req-6429454d-6743-406f-b858-4df517ad453d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 18 21:42:22.715280 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:22.715280 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:42:22.715280 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:42:22.715280 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:42:22.715280 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:42:22.715280 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:42:22.715280 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:42:22.715280 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:42:22.715280 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:42:22.715280 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:42:22.715280 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:42:22.715280 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 21:42:22.715280 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 21:42:22.715280 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 21:42:22.715280 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 21:42:22.716234 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:42:22.716234 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:42:22.716234 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 21:42:22.716234 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 21:42:22.716234 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 21:42:22.716234 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 21:42:22.716234 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:42:22.716234 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:42:22.716234 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:42:22.716234 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:42:22.716234 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:42:22.716234 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application with Lock( Aug 18 21:42:22.716234 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:42:22.716234 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:42:22.716234 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:42:22.716234 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:42:22.716234 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:42:22.716234 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:42:22.717518 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:42:22.717518 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:42:22.717518 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 21:42:22.717518 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 21:42:22.717518 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 21:42:22.717518 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 21:42:22.717518 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 21:42:22.717518 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 21:42:22.717518 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 18 21:42:22.717518 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:42:22.717518 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 398/800] 10.222.0.27 () {56 vars in 1117 bytes} [Thu Aug 18 21:42:22 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:42:22.717518 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6429454d-6743-406f-b858-4df517ad453d None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:22.727731 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56439584-2e5f-46ce-b4e4-68faba4e088b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:22.728348 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56439584-2e5f-46ce-b4e4-68faba4e088b None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:22.728653 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56439584-2e5f-46ce-b4e4-68faba4e088b None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:22.728929 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56439584-2e5f-46ce-b4e4-68faba4e088b None admin] PATH_INFO: `/v3/projects` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:22.729986 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56439584-2e5f-46ce-b4e4-68faba4e088b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:22.730290 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56439584-2e5f-46ce-b4e4-68faba4e088b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:22.732031 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56439584-2e5f-46ce-b4e4-68faba4e088b None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:22.749636 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 403/801] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Aug 18 21:42:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 21:42:22.749636 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e9e1b6-b6e5-42e7-93bf-e36d9872ca56 None None] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:22.749636 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e9e1b6-b6e5-42e7-93bf-e36d9872ca56 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:22.749636 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e9e1b6-b6e5-42e7-93bf-e36d9872ca56 None None] PATH_INFO: `/` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:22.749636 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 404/802] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:42:22 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:42:22.749636 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e9e1b6-b6e5-42e7-93bf-e36d9872ca56 None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:22.788748 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:22.798042 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:22.829410 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6429454d-6743-406f-b858-4df517ad453d None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:22.858693 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e9e1b6-b6e5-42e7-93bf-e36d9872ca56 None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:22.864171 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0124c7-fab6-4b49-bdb0-5146799a2670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:22.865043 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0124c7-fab6-4b49-bdb0-5146799a2670 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:22.865485 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0124c7-fab6-4b49-bdb0-5146799a2670 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:22.865887 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0124c7-fab6-4b49-bdb0-5146799a2670 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:22.877135 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0124c7-fab6-4b49-bdb0-5146799a2670 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:42:22.882255 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application [None req-0d0124c7-fab6-4b49-bdb0-5146799a2670 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 21:42:22.882255 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:22.882255 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:42:22.882255 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:42:22.882255 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:42:22.882255 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:42:22.882255 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:42:22.882255 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:42:22.882255 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:42:22.882255 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:42:22.882255 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:42:22.882255 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:42:22.882255 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:42:22.882255 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:42:22.882255 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:42:22.882255 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:42:22.883354 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:42:22.883354 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:42:22.883354 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:42:22.883354 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:42:22.883354 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:42:22.883354 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:42:22.883354 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:42:22.883354 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:42:22.883354 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:42:22.883354 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:42:22.883354 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:42:22.883354 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application with Lock( Aug 18 21:42:22.883354 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:42:22.883354 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:42:22.883354 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:42:22.883354 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:42:22.884340 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:42:22.884340 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:42:22.884340 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:42:22.884340 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:42:22.884340 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:42:22.884340 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:42:22.884340 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:42:22.884340 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:42:22.884340 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:42:22.884340 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:42:22.884340 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 21:42:22.884340 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:42:22.884340 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 399/803] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Aug 18 21:42:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:42:22.885186 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0124c7-fab6-4b49-bdb0-5146799a2670 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:22.901140 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf43cd5f-a687-4791-b0c2-b0fb7a8e1f82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:22.901991 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf43cd5f-a687-4791-b0c2-b0fb7a8e1f82 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:22.902270 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf43cd5f-a687-4791-b0c2-b0fb7a8e1f82 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:22.902549 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf43cd5f-a687-4791-b0c2-b0fb7a8e1f82 None admin] PATH_INFO: `/v3/users` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:22.903252 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf43cd5f-a687-4791-b0c2-b0fb7a8e1f82 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:22.903552 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf43cd5f-a687-4791-b0c2-b0fb7a8e1f82 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:22.905041 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf43cd5f-a687-4791-b0c2-b0fb7a8e1f82 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:22.929319 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 405/804] 10.222.0.27 () {56 vars in 1149 bytes} [Thu Aug 18 21:42:22 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:42:22.929319 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8c2a61-b339-4cd1-9818-86d0ac1fc1a9 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:22.929319 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8c2a61-b339-4cd1-9818-86d0ac1fc1a9 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:22.929319 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8c2a61-b339-4cd1-9818-86d0ac1fc1a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:22.943576 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-eb8c2a61-b339-4cd1-9818-86d0ac1fc1a9 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:42:22.944724 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-eb8c2a61-b339-4cd1-9818-86d0ac1fc1a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:42:22.994242 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0124c7-fab6-4b49-bdb0-5146799a2670 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:23.024622 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 406/805] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:42:22 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 21:42:23.024622 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8c2a61-b339-4cd1-9818-86d0ac1fc1a9 None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:23.028058 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:23.032736 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d62aad9-4e40-4d4c-8c75-5cafc40acc39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:23.033530 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d62aad9-4e40-4d4c-8c75-5cafc40acc39 None admin] REQUEST_METHOD: `PUT` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:23.033805 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d62aad9-4e40-4d4c-8c75-5cafc40acc39 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:23.034072 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d62aad9-4e40-4d4c-8c75-5cafc40acc39 None admin] PATH_INFO: `/v3/projects/4b54801b90484d689034f838f85fc0a4/users/9ae59e6dca304c949942ae769acedc74/roles/0833202e2a3d47d1b6b3af57006641b1` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:23.036125 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d62aad9-4e40-4d4c-8c75-5cafc40acc39 None admin] RBAC: Authorizing `identity:create_grant(project_id=4b54801b90484d689034f838f85fc0a4, user_id=9ae59e6dca304c949942ae769acedc74, role_id=0833202e2a3d47d1b6b3af57006641b1)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:23.037753 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d62aad9-4e40-4d4c-8c75-5cafc40acc39 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:23.053255 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:23.126893 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8c2a61-b339-4cd1-9818-86d0ac1fc1a9 None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:23.144245 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 400/806] 10.222.0.27 () {58 vars in 1439 bytes} [Thu Aug 18 21:42:22 2022] PUT /identity/v3/projects/4b54801b90484d689034f838f85fc0a4/users/9ae59e6dca304c949942ae769acedc74/roles/0833202e2a3d47d1b6b3af57006641b1 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:42:23.145434 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d62aad9-4e40-4d4c-8c75-5cafc40acc39 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:23.195460 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ed16b3-6347-44af-b22d-fc4e4e00df3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:23.195998 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ed16b3-6347-44af-b22d-fc4e4e00df3a None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:23.196282 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ed16b3-6347-44af-b22d-fc4e4e00df3a None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:23.196551 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ed16b3-6347-44af-b22d-fc4e4e00df3a None admin] PATH_INFO: `/v3/roles` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:23.198403 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ed16b3-6347-44af-b22d-fc4e4e00df3a None admin] RBAC: Adding query filter params (name=admin) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:23.200104 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ed16b3-6347-44af-b22d-fc4e4e00df3a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:23.204416 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ed16b3-6347-44af-b22d-fc4e4e00df3a None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:23.222413 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 407/807] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Aug 18 21:42:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:42:23.227649 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ed16b3-6347-44af-b22d-fc4e4e00df3a None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:23.325006 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d62aad9-4e40-4d4c-8c75-5cafc40acc39 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:23.342335 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:23.356848 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ed16b3-6347-44af-b22d-fc4e4e00df3a None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:23.362188 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6058f253-995b-4ce2-82bc-44e022f4b3e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:23.362989 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6058f253-995b-4ce2-82bc-44e022f4b3e6 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:23.363094 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6058f253-995b-4ce2-82bc-44e022f4b3e6 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:23.363531 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6058f253-995b-4ce2-82bc-44e022f4b3e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:23.374937 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6058f253-995b-4ce2-82bc-44e022f4b3e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:23.377114 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6058f253-995b-4ce2-82bc-44e022f4b3e6 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:23.393015 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application [None req-6058f253-995b-4ce2-82bc-44e022f4b3e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:42:23.393015 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:23.393015 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:42:23.393015 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:42:23.393015 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:42:23.393015 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:42:23.393015 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:42:23.393015 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:42:23.393015 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:42:23.393015 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:42:23.393015 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:42:23.393015 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:42:23.393015 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 21:42:23.393015 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 21:42:23.393015 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 21:42:23.393015 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 21:42:23.394004 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:42:23.394004 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:42:23.394004 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:42:23.394004 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:42:23.394004 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:42:23.394004 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:42:23.394004 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:42:23.394004 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application with Lock( Aug 18 21:42:23.394004 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:42:23.394004 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:42:23.394004 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:42:23.394004 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:42:23.394004 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:42:23.394004 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:42:23.394004 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:42:23.394004 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:42:23.394004 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 21:42:23.394929 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 21:42:23.394929 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:42:23.394929 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:42:23.395107 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2692107d-a61d-4a65-b334-619400b1943e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:23.395107 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2692107d-a61d-4a65-b334-619400b1943e None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:23.395107 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2692107d-a61d-4a65-b334-619400b1943e None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:23.395107 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2692107d-a61d-4a65-b334-619400b1943e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:23.395381 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 401/808] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 18 21:42:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:42:23.395761 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0214720-3fb9-4585-8aba-7a8106c6514e None None] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:23.395854 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0214720-3fb9-4585-8aba-7a8106c6514e None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:23.396297 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0214720-3fb9-4585-8aba-7a8106c6514e None None] PATH_INFO: `/` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:23.401551 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 402/809] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:42:23 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:42:23.403110 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0214720-3fb9-4585-8aba-7a8106c6514e None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:23.406942 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2692107d-a61d-4a65-b334-619400b1943e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:23.408366 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2692107d-a61d-4a65-b334-619400b1943e None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:23.423208 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application [None req-2692107d-a61d-4a65-b334-619400b1943e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:42:23.423208 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:23.423208 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:42:23.423208 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:42:23.423208 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:42:23.423208 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:42:23.423208 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:42:23.423208 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:42:23.423208 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:42:23.423208 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:42:23.423208 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:42:23.423208 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:42:23.423208 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 21:42:23.423208 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 21:42:23.423208 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 21:42:23.423208 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 21:42:23.424270 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:42:23.424270 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:42:23.424270 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:42:23.424270 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:42:23.424270 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:42:23.424270 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:42:23.424270 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:42:23.424270 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application with Lock( Aug 18 21:42:23.424270 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:42:23.424270 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:42:23.424270 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:42:23.424270 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:42:23.424270 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:42:23.424270 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:42:23.424270 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:42:23.424270 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:42:23.424270 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 21:42:23.425239 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 21:42:23.425239 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:42:23.425239 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:42:23.425239 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 408/810] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 18 21:42:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 21:42:23.425239 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2692107d-a61d-4a65-b334-619400b1943e None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:23.455807 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:23.522660 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0214720-3fb9-4585-8aba-7a8106c6514e None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:23.538249 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2692107d-a61d-4a65-b334-619400b1943e None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:23.559535 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffa18a2-c622-4f00-ae7b-c3f7e22034ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:23.560155 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffa18a2-c622-4f00-ae7b-c3f7e22034ba None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:23.560434 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffa18a2-c622-4f00-ae7b-c3f7e22034ba None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:23.560733 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffa18a2-c622-4f00-ae7b-c3f7e22034ba None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:23.561313 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffa18a2-c622-4f00-ae7b-c3f7e22034ba None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:23.562706 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffa18a2-c622-4f00-ae7b-c3f7e22034ba None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:23.571774 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application [None req-2ffa18a2-c622-4f00-ae7b-c3f7e22034ba None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 18 21:42:23.571774 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:23.571774 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 21:42:23.571774 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 21:42:23.571774 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 21:42:23.571774 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 21:42:23.571774 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 21:42:23.571774 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 21:42:23.571774 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 18 21:42:23.571774 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:42:23.571774 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 21:42:23.571774 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:42:23.571774 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:23.571774 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:42:23.571774 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:42:23.571774 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:42:23.571774 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:42:23.573000 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:42:23.573000 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:42:23.573000 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:42:23.573000 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:42:23.573000 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:42:23.573000 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:42:23.573000 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 21:42:23.573000 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 21:42:23.573000 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 21:42:23.573000 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 21:42:23.573000 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:42:23.573000 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:42:23.573000 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:42:23.573000 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:42:23.573000 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:42:23.573000 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:42:23.573873 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:42:23.573873 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application with Lock( Aug 18 21:42:23.573873 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:42:23.573873 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:42:23.573873 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:42:23.573873 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:42:23.573873 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:42:23.573873 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:42:23.573873 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:42:23.573873 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:42:23.573873 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 21:42:23.573873 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 21:42:23.573873 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 18 21:42:23.573873 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:42:23.573873 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 403/811] 10.222.0.27 () {56 vars in 1129 bytes} [Thu Aug 18 21:42:23 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:42:23.574664 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2e5edb-ad0a-4650-bcf6-2a35390eaa22 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:23.574664 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2e5edb-ad0a-4650-bcf6-2a35390eaa22 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:23.574664 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2e5edb-ad0a-4650-bcf6-2a35390eaa22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:23.581144 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e1c569-c760-40ae-ab27-035826269c63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:23.581707 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e1c569-c760-40ae-ab27-035826269c63 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:23.581925 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e1c569-c760-40ae-ab27-035826269c63 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:23.582199 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e1c569-c760-40ae-ab27-035826269c63 None admin] PATH_INFO: `/v3/domains` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:23.582840 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e1c569-c760-40ae-ab27-035826269c63 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:23.583138 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e1c569-c760-40ae-ab27-035826269c63 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:23.584655 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e1c569-c760-40ae-ab27-035826269c63 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:23.592520 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:23.593835 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-0d2e5edb-ad0a-4650-bcf6-2a35390eaa22 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:42:23.595862 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-0d2e5edb-ad0a-4650-bcf6-2a35390eaa22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:42:23.598453 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 409/812] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 18 21:42:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:42:23.603496 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e1c569-c760-40ae-ab27-035826269c63 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:23.669659 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 404/813] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:42:23 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 21:42:23.670600 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2e5edb-ad0a-4650-bcf6-2a35390eaa22 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:23.718677 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:23.720899 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e1c569-c760-40ae-ab27-035826269c63 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:23.756244 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f47f71-2247-42eb-bfb5-3885d134a577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:23.756780 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f47f71-2247-42eb-bfb5-3885d134a577 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:23.757059 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f47f71-2247-42eb-bfb5-3885d134a577 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:23.757438 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f47f71-2247-42eb-bfb5-3885d134a577 None admin] PATH_INFO: `/v3/domains` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:23.758105 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f47f71-2247-42eb-bfb5-3885d134a577 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:23.758455 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f47f71-2247-42eb-bfb5-3885d134a577 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:23.759920 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f47f71-2247-42eb-bfb5-3885d134a577 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:23.777642 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 410/814] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 18 21:42:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:42:23.777642 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f47f71-2247-42eb-bfb5-3885d134a577 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:23.814741 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2e5edb-ad0a-4650-bcf6-2a35390eaa22 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:23.838675 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:23.860261 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709417f0-64ef-42ad-9ace-16d8fb5453fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:23.861454 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709417f0-64ef-42ad-9ace-16d8fb5453fb None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:23.862044 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709417f0-64ef-42ad-9ace-16d8fb5453fb None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:23.862589 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709417f0-64ef-42ad-9ace-16d8fb5453fb None admin] PATH_INFO: `/v3/services` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:23.863364 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709417f0-64ef-42ad-9ace-16d8fb5453fb None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:23.863988 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709417f0-64ef-42ad-9ace-16d8fb5453fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:23.866181 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709417f0-64ef-42ad-9ace-16d8fb5453fb None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:23.873024 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 405/815] 10.222.0.27 () {56 vars in 1124 bytes} [Thu Aug 18 21:42:23 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:42:23.874337 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709417f0-64ef-42ad-9ace-16d8fb5453fb None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:23.886411 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f47f71-2247-42eb-bfb5-3885d134a577 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:23.924210 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9765c1bb-69eb-4c75-a056-541bb4837cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:23.925203 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9765c1bb-69eb-4c75-a056-541bb4837cc1 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:23.925583 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9765c1bb-69eb-4c75-a056-541bb4837cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:23.925952 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9765c1bb-69eb-4c75-a056-541bb4837cc1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:23.933310 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9765c1bb-69eb-4c75-a056-541bb4837cc1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:23.934953 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9765c1bb-69eb-4c75-a056-541bb4837cc1 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:23.948072 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application [None req-9765c1bb-69eb-4c75-a056-541bb4837cc1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 21:42:23.948072 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:23.948072 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:42:23.948072 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:42:23.948072 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:42:23.948072 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:42:23.948072 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:42:23.948072 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:42:23.948072 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:42:23.948072 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:42:23.948072 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:42:23.948072 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:42:23.948072 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 21:42:23.948072 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 21:42:23.948072 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 21:42:23.949210 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 21:42:23.949210 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:42:23.949210 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:42:23.949210 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:42:23.949210 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:42:23.949210 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:42:23.949210 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:42:23.949210 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:42:23.949210 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application with Lock( Aug 18 21:42:23.949210 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:42:23.949210 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:42:23.949210 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:42:23.949210 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:42:23.949210 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:42:23.949210 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:42:23.949210 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:42:23.949210 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:42:23.950280 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 21:42:23.950280 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 21:42:23.950280 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 21:42:23.950280 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 21:42:23.950280 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 21:42:23.950280 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 21:42:23.950280 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 21:42:23.950280 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:42:23.951160 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 411/816] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Aug 18 21:42:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:42:23.952111 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9765c1bb-69eb-4c75-a056-541bb4837cc1 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:24.001863 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:24.006467 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709417f0-64ef-42ad-9ace-16d8fb5453fb None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:24.047144 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e443866-6c57-43b7-b521-d2a25b45b41b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:24.048294 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e443866-6c57-43b7-b521-d2a25b45b41b None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:24.048668 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e443866-6c57-43b7-b521-d2a25b45b41b None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:24.049040 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e443866-6c57-43b7-b521-d2a25b45b41b None admin] PATH_INFO: `/v3/users/nova` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:24.056154 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e443866-6c57-43b7-b521-d2a25b45b41b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:24.057624 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e443866-6c57-43b7-b521-d2a25b45b41b None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:24.058505 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9765c1bb-69eb-4c75-a056-541bb4837cc1 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:24.069715 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application [None req-8e443866-6c57-43b7-b521-d2a25b45b41b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 18 21:42:24.069715 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:24.069715 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:42:24.069715 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:42:24.069715 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:42:24.069715 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:42:24.069715 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:42:24.069715 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:42:24.069715 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:42:24.069715 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:42:24.069715 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:42:24.069715 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:42:24.069715 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 21:42:24.069715 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 21:42:24.069715 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 21:42:24.069715 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 21:42:24.070686 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:42:24.070686 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:42:24.070686 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 21:42:24.070686 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 21:42:24.070686 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 21:42:24.070686 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 21:42:24.070686 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:42:24.070686 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:42:24.070686 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:42:24.070686 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:42:24.070686 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:42:24.070686 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application with Lock( Aug 18 21:42:24.070686 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:42:24.070686 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:42:24.070686 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:42:24.070686 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:42:24.070686 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:42:24.070686 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:42:24.071635 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:42:24.071635 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:42:24.071635 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 21:42:24.071635 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 21:42:24.071635 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 21:42:24.071635 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 21:42:24.071635 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 21:42:24.071635 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 21:42:24.071635 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 18 21:42:24.071635 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:42:24.071635 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 406/817] 10.222.0.27 () {56 vars in 1093 bytes} [Thu Aug 18 21:42:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:42:24.071635 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e443866-6c57-43b7-b521-d2a25b45b41b None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:24.082222 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:24.099671 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92120518-3d71-4e8b-94da-633e20fea7a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:24.100284 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92120518-3d71-4e8b-94da-633e20fea7a2 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:24.100569 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92120518-3d71-4e8b-94da-633e20fea7a2 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:24.100875 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92120518-3d71-4e8b-94da-633e20fea7a2 None admin] PATH_INFO: `/v3/services` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:24.101499 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92120518-3d71-4e8b-94da-633e20fea7a2 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:24.101803 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92120518-3d71-4e8b-94da-633e20fea7a2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:24.103152 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92120518-3d71-4e8b-94da-633e20fea7a2 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:24.113722 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 412/818] 10.222.0.27 () {56 vars in 1124 bytes} [Thu Aug 18 21:42:23 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:42:24.113722 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92120518-3d71-4e8b-94da-633e20fea7a2 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:24.187651 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e443866-6c57-43b7-b521-d2a25b45b41b None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:24.223589 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7305580-9197-4623-991b-29c1490ade23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:24.224217 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7305580-9197-4623-991b-29c1490ade23 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:24.224495 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7305580-9197-4623-991b-29c1490ade23 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:24.224809 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7305580-9197-4623-991b-29c1490ade23 None admin] PATH_INFO: `/v3/services/network` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:24.225166 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92120518-3d71-4e8b-94da-633e20fea7a2 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:24.225419 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7305580-9197-4623-991b-29c1490ade23 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:24.226783 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7305580-9197-4623-991b-29c1490ade23 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:24.235802 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application [None req-e7305580-9197-4623-991b-29c1490ade23 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 18 21:42:24.235802 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:24.235802 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 21:42:24.235802 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 21:42:24.235802 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 21:42:24.235802 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 21:42:24.235802 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 21:42:24.235802 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 21:42:24.235802 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 18 21:42:24.235802 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:42:24.235802 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 21:42:24.235802 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:42:24.235802 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:24.235802 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:42:24.235802 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:42:24.235802 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:42:24.235802 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:42:24.237037 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:42:24.237037 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:42:24.237037 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:42:24.237037 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:42:24.237037 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:42:24.237037 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:42:24.237037 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 21:42:24.237037 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 21:42:24.237037 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 21:42:24.237037 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 21:42:24.237037 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:42:24.237037 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:42:24.237037 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:42:24.237037 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:42:24.237037 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:42:24.237037 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:42:24.238139 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:42:24.238139 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application with Lock( Aug 18 21:42:24.238139 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:42:24.238139 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:42:24.238139 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:42:24.238139 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:42:24.238139 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:42:24.238139 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:42:24.238139 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:42:24.238139 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:42:24.238139 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 21:42:24.238139 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 21:42:24.238139 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 18 21:42:24.238139 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:42:24.241574 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 407/819] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Aug 18 21:42:24 2022] GET /identity/v3/services/network => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:42:24.242418 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7305580-9197-4623-991b-29c1490ade23 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:24.272272 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:24.275815 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb4a681-bb37-41e7-9c82-ed3920be3e9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:24.276428 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb4a681-bb37-41e7-9c82-ed3920be3e9e None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:24.278761 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb4a681-bb37-41e7-9c82-ed3920be3e9e None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:24.278761 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb4a681-bb37-41e7-9c82-ed3920be3e9e None admin] PATH_INFO: `/v3/projects` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:24.278761 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb4a681-bb37-41e7-9c82-ed3920be3e9e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:24.279016 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb4a681-bb37-41e7-9c82-ed3920be3e9e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:24.280496 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb4a681-bb37-41e7-9c82-ed3920be3e9e None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:24.295943 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 413/820] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Aug 18 21:42:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:42:24.297384 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb4a681-bb37-41e7-9c82-ed3920be3e9e None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:24.349894 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:24.357630 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7305580-9197-4623-991b-29c1490ade23 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:24.392906 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f169ece-6eef-4c9c-9a96-e6dfa5158752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:24.393497 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f169ece-6eef-4c9c-9a96-e6dfa5158752 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:24.393776 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f169ece-6eef-4c9c-9a96-e6dfa5158752 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:24.394043 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f169ece-6eef-4c9c-9a96-e6dfa5158752 None admin] PATH_INFO: `/v3/users` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:24.394762 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f169ece-6eef-4c9c-9a96-e6dfa5158752 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:24.395060 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f169ece-6eef-4c9c-9a96-e6dfa5158752 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:24.396472 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f169ece-6eef-4c9c-9a96-e6dfa5158752 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:24.410222 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb4a681-bb37-41e7-9c82-ed3920be3e9e None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:24.418179 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 408/821] 10.222.0.27 () {56 vars in 1133 bytes} [Thu Aug 18 21:42:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:42:24.418179 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f169ece-6eef-4c9c-9a96-e6dfa5158752 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:24.447758 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04ad34f-f9bd-48a1-95a4-056986c5b7be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:24.448432 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04ad34f-f9bd-48a1-95a4-056986c5b7be None admin] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:24.448786 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04ad34f-f9bd-48a1-95a4-056986c5b7be None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:24.449054 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04ad34f-f9bd-48a1-95a4-056986c5b7be None admin] PATH_INFO: `/v3/endpoints` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:24.449857 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04ad34f-f9bd-48a1-95a4-056986c5b7be None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:24.451373 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04ad34f-f9bd-48a1-95a4-056986c5b7be None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:24.497734 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:24.514989 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f169ece-6eef-4c9c-9a96-e6dfa5158752 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:24.588412 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 414/822] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 18 21:42:24 2022] POST /identity/v3/endpoints => generated 346 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:42:24.589828 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04ad34f-f9bd-48a1-95a4-056986c5b7be None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:24.682969 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05d0a84-c746-439d-a70d-bbd05cbd3bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:24.683599 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05d0a84-c746-439d-a70d-bbd05cbd3bf5 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:24.683848 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05d0a84-c746-439d-a70d-bbd05cbd3bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:24.684130 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05d0a84-c746-439d-a70d-bbd05cbd3bf5 None admin] PATH_INFO: `/v3/services` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:24.684786 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05d0a84-c746-439d-a70d-bbd05cbd3bf5 None admin] RBAC: Adding query filter params (name=network) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:24.685091 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05d0a84-c746-439d-a70d-bbd05cbd3bf5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:24.686802 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05d0a84-c746-439d-a70d-bbd05cbd3bf5 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:24.699742 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 409/823] 10.222.0.27 () {56 vars in 1112 bytes} [Thu Aug 18 21:42:24 2022] GET /identity/v3/services?name=network => generated 124 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:42:24.699742 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05d0a84-c746-439d-a70d-bbd05cbd3bf5 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:24.737149 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:24.743391 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04ad34f-f9bd-48a1-95a4-056986c5b7be None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:24.790519 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5758c33e-89fc-42eb-8e62-0e340af62c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:24.791194 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5758c33e-89fc-42eb-8e62-0e340af62c53 None admin] REQUEST_METHOD: `PUT` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:24.791480 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5758c33e-89fc-42eb-8e62-0e340af62c53 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:24.791757 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5758c33e-89fc-42eb-8e62-0e340af62c53 None admin] PATH_INFO: `/v3/projects/4b54801b90484d689034f838f85fc0a4/users/f079aa6ed5594a4982172b51b93ac54f/roles/30d8ac11e30e4b1d83940485e98d147c` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:24.815584 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5758c33e-89fc-42eb-8e62-0e340af62c53 None admin] RBAC: Authorizing `identity:create_grant(project_id=4b54801b90484d689034f838f85fc0a4, user_id=f079aa6ed5594a4982172b51b93ac54f, role_id=30d8ac11e30e4b1d83940485e98d147c)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:24.817072 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5758c33e-89fc-42eb-8e62-0e340af62c53 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:24.838516 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05d0a84-c746-439d-a70d-bbd05cbd3bf5 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:24.876530 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed1b1f1-a52c-48d5-abf9-62c1b6c0646a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:24.877233 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed1b1f1-a52c-48d5-abf9-62c1b6c0646a None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:24.877445 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed1b1f1-a52c-48d5-abf9-62c1b6c0646a None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:24.877797 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed1b1f1-a52c-48d5-abf9-62c1b6c0646a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:24.890327 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:24.907349 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 415/824] 10.222.0.27 () {58 vars in 1439 bytes} [Thu Aug 18 21:42:24 2022] PUT /identity/v3/projects/4b54801b90484d689034f838f85fc0a4/users/f079aa6ed5594a4982172b51b93ac54f/roles/30d8ac11e30e4b1d83940485e98d147c => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:42:24.908350 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5758c33e-89fc-42eb-8e62-0e340af62c53 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:24.971560 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed1b1f1-a52c-48d5-abf9-62c1b6c0646a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:24.973420 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed1b1f1-a52c-48d5-abf9-62c1b6c0646a None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:25.122517 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 410/825] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Aug 18 21:42:24 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 18 21:42:25.124205 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fc7594-cd5f-4325-9d1d-268f996d70aa None None] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:25.124502 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fc7594-cd5f-4325-9d1d-268f996d70aa None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:25.124804 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fc7594-cd5f-4325-9d1d-268f996d70aa None None] PATH_INFO: `/` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:25.129848 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 411/826] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:42:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:42:25.132772 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fc7594-cd5f-4325-9d1d-268f996d70aa None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:25.161649 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5758c33e-89fc-42eb-8e62-0e340af62c53 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:25.199673 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88651429-036c-4256-a01b-c27e8d9dcfe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:25.200283 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88651429-036c-4256-a01b-c27e8d9dcfe8 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:25.200563 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88651429-036c-4256-a01b-c27e8d9dcfe8 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:25.200875 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88651429-036c-4256-a01b-c27e8d9dcfe8 None admin] PATH_INFO: `/v3/services` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:25.201506 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88651429-036c-4256-a01b-c27e8d9dcfe8 None admin] RBAC: Adding query filter params (type=network) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:25.201807 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88651429-036c-4256-a01b-c27e8d9dcfe8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:25.203207 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88651429-036c-4256-a01b-c27e8d9dcfe8 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:25.209289 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 416/827] 10.222.0.27 () {56 vars in 1112 bytes} [Thu Aug 18 21:42:24 2022] GET /identity/v3/services?type=network => generated 350 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:42:25.209774 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:25.210494 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02f8d28-edfd-47c8-94f9-81074e4e88eb None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:25.210777 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02f8d28-edfd-47c8-94f9-81074e4e88eb None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:25.211049 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02f8d28-edfd-47c8-94f9-81074e4e88eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:25.230960 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-c02f8d28-edfd-47c8-94f9-81074e4e88eb None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:42:25.232172 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-c02f8d28-edfd-47c8-94f9-81074e4e88eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:42:25.241168 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:25.294488 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fc7594-cd5f-4325-9d1d-268f996d70aa None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:25.326847 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 417/828] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:42:25 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 21:42:25.328585 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02f8d28-edfd-47c8-94f9-81074e4e88eb None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:25.333940 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2454c70b-5976-4ec1-86ae-20b2036aeb58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:25.334922 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2454c70b-5976-4ec1-86ae-20b2036aeb58 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:25.335409 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2454c70b-5976-4ec1-86ae-20b2036aeb58 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:25.335935 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2454c70b-5976-4ec1-86ae-20b2036aeb58 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:25.348298 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2454c70b-5976-4ec1-86ae-20b2036aeb58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:25.350232 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2454c70b-5976-4ec1-86ae-20b2036aeb58 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:25.366141 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application [None req-2454c70b-5976-4ec1-86ae-20b2036aeb58 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:42:25.366141 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:25.366141 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:42:25.366141 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:42:25.366141 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:42:25.366141 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:42:25.366141 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:42:25.366141 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:42:25.366141 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:42:25.366141 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:42:25.366141 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:42:25.366141 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:42:25.366141 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 21:42:25.366141 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 21:42:25.366141 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 21:42:25.366141 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 21:42:25.367144 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:42:25.367144 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:42:25.367144 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:42:25.367144 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:42:25.367144 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:42:25.367144 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:42:25.367144 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:42:25.367144 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application with Lock( Aug 18 21:42:25.367144 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:42:25.367144 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:42:25.367144 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:42:25.367144 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:42:25.367144 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:42:25.367144 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:42:25.367144 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:42:25.367144 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:42:25.367144 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 21:42:25.368035 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 21:42:25.368035 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:42:25.368035 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:42:25.370144 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 412/829] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 18 21:42:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 21:42:25.386661 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2454c70b-5976-4ec1-86ae-20b2036aeb58 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:25.446573 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02f8d28-edfd-47c8-94f9-81074e4e88eb None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:25.482266 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713fa294-3123-4fd5-8634-53dfb875f724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:25.482876 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713fa294-3123-4fd5-8634-53dfb875f724 None admin] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:25.483149 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713fa294-3123-4fd5-8634-53dfb875f724 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:25.483657 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713fa294-3123-4fd5-8634-53dfb875f724 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:25.484316 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713fa294-3123-4fd5-8634-53dfb875f724 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:25.486005 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713fa294-3123-4fd5-8634-53dfb875f724 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:25.544971 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:25.550085 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2454c70b-5976-4ec1-86ae-20b2036aeb58 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:25.565543 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:25.576501 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 418/830] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 18 21:42:25 2022] POST /identity/v3/endpoints => generated 337 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:42:25.613411 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e46c447-1cb7-494c-9af0-26231fad9e3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:25.614040 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e46c447-1cb7-494c-9af0-26231fad9e3f None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:25.614318 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e46c447-1cb7-494c-9af0-26231fad9e3f None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:25.614593 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e46c447-1cb7-494c-9af0-26231fad9e3f None admin] PATH_INFO: `/v3/domains` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:25.615256 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e46c447-1cb7-494c-9af0-26231fad9e3f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:25.615554 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e46c447-1cb7-494c-9af0-26231fad9e3f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:25.617021 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e46c447-1cb7-494c-9af0-26231fad9e3f None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:25.636085 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 413/831] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 18 21:42:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:42:25.643028 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713fa294-3123-4fd5-8634-53dfb875f724 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:25.685155 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e46c447-1cb7-494c-9af0-26231fad9e3f None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:25.773011 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713fa294-3123-4fd5-8634-53dfb875f724 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:25.810367 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611617bc-514c-4518-8823-1fc98e7fdf38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:25.811000 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611617bc-514c-4518-8823-1fc98e7fdf38 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:25.811319 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611617bc-514c-4518-8823-1fc98e7fdf38 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:25.811592 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611617bc-514c-4518-8823-1fc98e7fdf38 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:25.819140 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611617bc-514c-4518-8823-1fc98e7fdf38 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:25.820720 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611617bc-514c-4518-8823-1fc98e7fdf38 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:25.830438 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e46c447-1cb7-494c-9af0-26231fad9e3f None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:25.832853 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application [None req-611617bc-514c-4518-8823-1fc98e7fdf38 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 21:42:25.832853 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:25.832853 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:42:25.832853 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:42:25.832853 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:42:25.832853 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:42:25.832853 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:42:25.832853 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:42:25.832853 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:42:25.832853 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:42:25.832853 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:42:25.832853 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:42:25.832853 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 21:42:25.832853 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 21:42:25.832853 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 21:42:25.833735 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 21:42:25.833735 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:42:25.833735 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:42:25.833735 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:42:25.833735 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:42:25.833735 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:42:25.833735 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:42:25.833735 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:42:25.833735 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application with Lock( Aug 18 21:42:25.833735 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:42:25.833735 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:42:25.833735 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:42:25.833735 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:42:25.833735 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:42:25.833735 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:42:25.833735 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:42:25.833735 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:42:25.834634 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 21:42:25.834634 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 21:42:25.834634 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 21:42:25.834634 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 21:42:25.834634 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 21:42:25.834634 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 21:42:25.834634 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 21:42:25.834634 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:42:25.838688 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 419/832] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Aug 18 21:42:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:42:25.839887 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611617bc-514c-4518-8823-1fc98e7fdf38 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:25.871594 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847e7fc3-30f1-45fd-99bc-96c9aa1dac8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:25.872683 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847e7fc3-30f1-45fd-99bc-96c9aa1dac8b None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:25.873180 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847e7fc3-30f1-45fd-99bc-96c9aa1dac8b None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:25.873663 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847e7fc3-30f1-45fd-99bc-96c9aa1dac8b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:25.886220 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847e7fc3-30f1-45fd-99bc-96c9aa1dac8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:42:25.892740 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application [None req-847e7fc3-30f1-45fd-99bc-96c9aa1dac8b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 21:42:25.892740 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:25.892740 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:42:25.892740 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:42:25.892740 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:42:25.892740 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:42:25.892740 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:42:25.892740 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:42:25.892740 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:42:25.892740 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:42:25.892740 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:42:25.892740 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:42:25.892740 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:42:25.892740 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:42:25.892740 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:42:25.892740 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:42:25.893726 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:42:25.893726 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:42:25.893726 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:42:25.893726 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:42:25.893726 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:42:25.893726 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:42:25.893726 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:42:25.893726 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:42:25.893726 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:42:25.893726 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:42:25.893726 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:42:25.893726 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application with Lock( Aug 18 21:42:25.893726 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:42:25.893726 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:42:25.893726 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:42:25.893726 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:42:25.894601 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:42:25.894601 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:42:25.894601 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:42:25.894601 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:42:25.894601 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:42:25.894601 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:42:25.894601 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:42:25.894601 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:42:25.894601 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:42:25.894601 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:42:25.894601 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 21:42:25.894601 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:42:25.897289 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 414/833] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Aug 18 21:42:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:42:25.903113 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847e7fc3-30f1-45fd-99bc-96c9aa1dac8b None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:25.916343 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:25.920718 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:25.960838 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611617bc-514c-4518-8823-1fc98e7fdf38 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:26.002088 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83b1813-5009-4f41-9ad5-ba21269fbf9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:26.003182 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83b1813-5009-4f41-9ad5-ba21269fbf9c None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:26.003698 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83b1813-5009-4f41-9ad5-ba21269fbf9c None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:26.004209 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83b1813-5009-4f41-9ad5-ba21269fbf9c None admin] PATH_INFO: `/v3/projects` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:26.005245 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83b1813-5009-4f41-9ad5-ba21269fbf9c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:26.005796 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83b1813-5009-4f41-9ad5-ba21269fbf9c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:26.007571 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83b1813-5009-4f41-9ad5-ba21269fbf9c None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:26.024816 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 420/834] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Aug 18 21:42:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:42:26.028726 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83b1813-5009-4f41-9ad5-ba21269fbf9c None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:26.029506 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847e7fc3-30f1-45fd-99bc-96c9aa1dac8b None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:26.072921 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8438f810-1c85-4d1b-944f-894b0ff351da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:26.073901 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8438f810-1c85-4d1b-944f-894b0ff351da None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:26.074404 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8438f810-1c85-4d1b-944f-894b0ff351da None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:26.074878 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8438f810-1c85-4d1b-944f-894b0ff351da None admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:26.075738 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8438f810-1c85-4d1b-944f-894b0ff351da None admin] RBAC: Adding query filter params (name=admin) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:26.076228 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8438f810-1c85-4d1b-944f-894b0ff351da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:26.077819 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8438f810-1c85-4d1b-944f-894b0ff351da None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:26.091673 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 415/835] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Aug 18 21:42:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 21:42:26.097308 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8438f810-1c85-4d1b-944f-894b0ff351da None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:26.158531 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83b1813-5009-4f41-9ad5-ba21269fbf9c None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:26.185476 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:26.193366 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:26.210698 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e4ccc3-6aed-4dcf-97ed-b3cc74b2c017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:26.211313 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e4ccc3-6aed-4dcf-97ed-b3cc74b2c017 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:26.211595 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e4ccc3-6aed-4dcf-97ed-b3cc74b2c017 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:26.211866 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e4ccc3-6aed-4dcf-97ed-b3cc74b2c017 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:26.212605 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e4ccc3-6aed-4dcf-97ed-b3cc74b2c017 None admin] RBAC: Adding query filter params (role.id=0833202e2a3d47d1b6b3af57006641b1, scope.project.id=4b54801b90484d689034f838f85fc0a4, user.id=a39cd50340184779ac589bbcb7cac9aa) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:26.212917 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e4ccc3-6aed-4dcf-97ed-b3cc74b2c017 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:26.214496 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e4ccc3-6aed-4dcf-97ed-b3cc74b2c017 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:26.228651 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8438f810-1c85-4d1b-944f-894b0ff351da None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:26.229021 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 421/836] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Aug 18 21:42:26 2022] GET /identity/v3/role_assignments?user.id=a39cd50340184779ac589bbcb7cac9aa&scope.project.id=4b54801b90484d689034f838f85fc0a4&role.id=0833202e2a3d47d1b6b3af57006641b1 => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 21:42:26.273055 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6badf683-7a01-4b01-ae8f-4936ff5719a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:26.273994 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6badf683-7a01-4b01-ae8f-4936ff5719a6 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:26.274460 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6badf683-7a01-4b01-ae8f-4936ff5719a6 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:26.274886 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6badf683-7a01-4b01-ae8f-4936ff5719a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:26.292520 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6badf683-7a01-4b01-ae8f-4936ff5719a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:26.294195 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6badf683-7a01-4b01-ae8f-4936ff5719a6 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:26.311272 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application [None req-6badf683-7a01-4b01-ae8f-4936ff5719a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:42:26.311272 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:26.311272 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:42:26.311272 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:42:26.311272 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:42:26.311272 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:42:26.311272 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:42:26.311272 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:42:26.311272 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:42:26.311272 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:42:26.311272 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:42:26.311272 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:42:26.311272 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 21:42:26.311272 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 21:42:26.311272 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 21:42:26.311272 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 21:42:26.312500 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:42:26.312500 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:42:26.312500 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:42:26.312500 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:42:26.312500 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:42:26.312500 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:42:26.312500 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:42:26.312500 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application with Lock( Aug 18 21:42:26.312500 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:42:26.312500 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:42:26.312500 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:42:26.312500 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:42:26.312500 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:42:26.312500 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:42:26.312500 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:42:26.312500 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:42:26.312500 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 21:42:26.314398 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 21:42:26.314398 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:42:26.314398 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:42:26.316247 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 416/837] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 18 21:42:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:42:26.325791 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e4ccc3-6aed-4dcf-97ed-b3cc74b2c017 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:26.436181 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e4ccc3-6aed-4dcf-97ed-b3cc74b2c017 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:26.473103 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b3b711-a3ee-49a9-958c-b7ad18f80ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:26.473703 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b3b711-a3ee-49a9-958c-b7ad18f80ad1 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:26.473980 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b3b711-a3ee-49a9-958c-b7ad18f80ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:26.474249 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b3b711-a3ee-49a9-958c-b7ad18f80ad1 None admin] PATH_INFO: `/v3/domains` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:26.474877 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b3b711-a3ee-49a9-958c-b7ad18f80ad1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:26.475175 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b3b711-a3ee-49a9-958c-b7ad18f80ad1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:26.476524 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b3b711-a3ee-49a9-958c-b7ad18f80ad1 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:26.490234 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 422/838] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 18 21:42:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:42:26.495688 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6badf683-7a01-4b01-ae8f-4936ff5719a6 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:26.604236 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6badf683-7a01-4b01-ae8f-4936ff5719a6 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:26.628996 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:26.639799 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8a6922-2a12-4798-8ae0-66937fd0aeff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:26.648213 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8a6922-2a12-4798-8ae0-66937fd0aeff None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:26.648213 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8a6922-2a12-4798-8ae0-66937fd0aeff None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:26.648213 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8a6922-2a12-4798-8ae0-66937fd0aeff None admin] PATH_INFO: `/v3/users/swift` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:26.649288 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8a6922-2a12-4798-8ae0-66937fd0aeff None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:26.650903 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8a6922-2a12-4798-8ae0-66937fd0aeff None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:26.663127 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application [None req-5d8a6922-2a12-4798-8ae0-66937fd0aeff None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 18 21:42:26.663127 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:26.663127 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:42:26.663127 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:42:26.663127 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:42:26.663127 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:42:26.663127 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:42:26.663127 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:42:26.663127 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:42:26.663127 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:42:26.663127 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:42:26.663127 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:42:26.663127 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 21:42:26.663127 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 21:42:26.663127 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 21:42:26.663127 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 21:42:26.664103 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:42:26.664103 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:42:26.664103 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 21:42:26.664103 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 21:42:26.664103 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 21:42:26.664103 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 21:42:26.664103 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:42:26.664103 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:42:26.664103 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:42:26.664103 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:42:26.664103 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:42:26.664103 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application with Lock( Aug 18 21:42:26.664103 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:42:26.664103 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:42:26.664103 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:42:26.664103 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:42:26.664103 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:42:26.664103 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:42:26.665093 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:42:26.665093 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:42:26.665093 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 21:42:26.665093 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 21:42:26.665093 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 21:42:26.665093 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 21:42:26.665093 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 21:42:26.665093 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 21:42:26.665093 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 18 21:42:26.665093 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:42:26.665093 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 417/839] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Aug 18 21:42:26 2022] GET /identity/v3/users/swift => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:42:26.674439 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b3b711-a3ee-49a9-958c-b7ad18f80ad1 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:26.723880 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:26.752076 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc657006-953d-4a8d-988f-e416bd6f31d7 None None] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:26.752762 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc657006-953d-4a8d-988f-e416bd6f31d7 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:26.752762 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc657006-953d-4a8d-988f-e416bd6f31d7 None None] PATH_INFO: `/` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:26.754247 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 418/840] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:42:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:42:26.759650 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292787ce-6420-40e6-a979-d8145492b38a None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:26.759930 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292787ce-6420-40e6-a979-d8145492b38a None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:26.760198 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292787ce-6420-40e6-a979-d8145492b38a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:26.782757 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-292787ce-6420-40e6-a979-d8145492b38a None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:42:26.784249 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-292787ce-6420-40e6-a979-d8145492b38a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:42:26.791553 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b3b711-a3ee-49a9-958c-b7ad18f80ad1 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:26.839107 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c820dc-9f48-4243-9081-cf3bcacd0ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:26.840083 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c820dc-9f48-4243-9081-cf3bcacd0ea5 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:26.840832 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c820dc-9f48-4243-9081-cf3bcacd0ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:26.841819 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c820dc-9f48-4243-9081-cf3bcacd0ea5 None admin] PATH_INFO: `/v3/users` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:26.843050 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c820dc-9f48-4243-9081-cf3bcacd0ea5 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:26.843567 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c820dc-9f48-4243-9081-cf3bcacd0ea5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:26.846769 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c820dc-9f48-4243-9081-cf3bcacd0ea5 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:26.868700 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 419/841] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:42:26 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 21:42:26.875352 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 423/842] 10.222.0.27 () {56 vars in 1135 bytes} [Thu Aug 18 21:42:26 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:42:26.877632 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292787ce-6420-40e6-a979-d8145492b38a None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:26.983038 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292787ce-6420-40e6-a979-d8145492b38a None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:26.998036 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:27.019860 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad2b4b7-accc-4ce1-b3df-f8a16b82f2f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:27.020838 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad2b4b7-accc-4ce1-b3df-f8a16b82f2f5 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:27.021342 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad2b4b7-accc-4ce1-b3df-f8a16b82f2f5 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:27.021807 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad2b4b7-accc-4ce1-b3df-f8a16b82f2f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:27.093613 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad2b4b7-accc-4ce1-b3df-f8a16b82f2f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:27.095664 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad2b4b7-accc-4ce1-b3df-f8a16b82f2f5 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:27.152390 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c820dc-9f48-4243-9081-cf3bcacd0ea5 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:27.199010 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 420/843] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Aug 18 21:42:26 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 18 21:42:27.200481 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99acb3f-3a37-4dd3-8711-94b01f8ee2ae None None] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:27.200800 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99acb3f-3a37-4dd3-8711-94b01f8ee2ae None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:27.201069 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99acb3f-3a37-4dd3-8711-94b01f8ee2ae None None] PATH_INFO: `/` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:27.202427 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 421/844] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:42:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:42:27.206875 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99acb3f-3a37-4dd3-8711-94b01f8ee2ae None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:27.222656 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:27.273859 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:27.277125 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c820dc-9f48-4243-9081-cf3bcacd0ea5 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:27.316867 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99acb3f-3a37-4dd3-8711-94b01f8ee2ae None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:27.318820 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ea7721-1ee9-4f8b-9145-8ed5dea4da6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:27.320221 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ea7721-1ee9-4f8b-9145-8ed5dea4da6d None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:27.320506 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ea7721-1ee9-4f8b-9145-8ed5dea4da6d None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:27.320816 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ea7721-1ee9-4f8b-9145-8ed5dea4da6d None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:27.321400 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ea7721-1ee9-4f8b-9145-8ed5dea4da6d None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:27.322761 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ea7721-1ee9-4f8b-9145-8ed5dea4da6d None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:27.332029 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application [None req-20ea7721-1ee9-4f8b-9145-8ed5dea4da6d None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 18 21:42:27.332029 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:27.332029 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 21:42:27.332029 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 21:42:27.332029 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 21:42:27.332029 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 21:42:27.332029 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 21:42:27.332029 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 21:42:27.332029 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 18 21:42:27.332029 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:42:27.332029 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 21:42:27.332029 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:42:27.332029 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:27.332029 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:42:27.332029 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:42:27.332029 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:42:27.332029 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:42:27.336839 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:42:27.336839 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:42:27.336839 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:42:27.336839 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:42:27.336839 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:42:27.336839 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:42:27.336839 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 21:42:27.336839 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 21:42:27.336839 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 21:42:27.336839 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 21:42:27.336839 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:42:27.336839 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:42:27.336839 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:42:27.336839 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:42:27.336839 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:42:27.336839 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:42:27.337751 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:42:27.337751 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application with Lock( Aug 18 21:42:27.337751 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:42:27.337751 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:42:27.337751 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:42:27.337751 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:42:27.337751 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:42:27.337751 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:42:27.337751 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:42:27.337751 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:42:27.337751 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 21:42:27.337751 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 21:42:27.337751 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 18 21:42:27.337751 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:42:27.337751 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 424/845] 10.222.0.27 () {56 vars in 1114 bytes} [Thu Aug 18 21:42:27 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:42:27.338556 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602dae07-ba98-4446-ae80-370b0bb6abd0 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:27.338556 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602dae07-ba98-4446-ae80-370b0bb6abd0 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:27.338556 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602dae07-ba98-4446-ae80-370b0bb6abd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:27.354621 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-602dae07-ba98-4446-ae80-370b0bb6abd0 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:42:27.355805 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-602dae07-ba98-4446-ae80-370b0bb6abd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:42:27.358353 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac11604a-29f5-4d40-8813-9906fd27b7f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:27.359795 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac11604a-29f5-4d40-8813-9906fd27b7f7 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:27.360761 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac11604a-29f5-4d40-8813-9906fd27b7f7 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:27.361040 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac11604a-29f5-4d40-8813-9906fd27b7f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:27.372721 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac11604a-29f5-4d40-8813-9906fd27b7f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:27.374232 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac11604a-29f5-4d40-8813-9906fd27b7f7 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:27.389597 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application [None req-ac11604a-29f5-4d40-8813-9906fd27b7f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:42:27.389597 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:27.389597 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:42:27.389597 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:42:27.389597 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:42:27.389597 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:42:27.389597 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:42:27.389597 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:42:27.389597 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:42:27.389597 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:42:27.389597 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:42:27.389597 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:42:27.389597 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 21:42:27.389597 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 21:42:27.389597 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 21:42:27.389597 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 21:42:27.390548 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:42:27.390548 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:42:27.390548 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:42:27.390548 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:42:27.390548 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:42:27.390548 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:42:27.390548 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:42:27.390548 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application with Lock( Aug 18 21:42:27.390548 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:42:27.390548 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:42:27.390548 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:42:27.390548 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:42:27.390548 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:42:27.390548 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:42:27.390548 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:42:27.390548 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:42:27.390548 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 21:42:27.392311 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 21:42:27.392311 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:42:27.392311 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:42:27.392311 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 422/846] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 18 21:42:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:42:27.392311 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac11604a-29f5-4d40-8813-9906fd27b7f7 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:27.441377 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 425/847] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:42:27 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 21:42:27.442851 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602dae07-ba98-4446-ae80-370b0bb6abd0 None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:27.463770 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:27.502936 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac11604a-29f5-4d40-8813-9906fd27b7f7 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:27.539219 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87777866-5324-4a77-aab5-fd1fc396a984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:27.539740 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87777866-5324-4a77-aab5-fd1fc396a984 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:27.540028 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87777866-5324-4a77-aab5-fd1fc396a984 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:27.540296 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87777866-5324-4a77-aab5-fd1fc396a984 None admin] PATH_INFO: `/v3/services` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:27.540975 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87777866-5324-4a77-aab5-fd1fc396a984 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:27.541278 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87777866-5324-4a77-aab5-fd1fc396a984 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:27.542653 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87777866-5324-4a77-aab5-fd1fc396a984 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:27.552366 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 423/848] 10.222.0.27 () {56 vars in 1114 bytes} [Thu Aug 18 21:42:27 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:42:27.553699 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87777866-5324-4a77-aab5-fd1fc396a984 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:27.577110 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:27.584286 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602dae07-ba98-4446-ae80-370b0bb6abd0 None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:27.623419 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc58ec4-cefa-4d77-ba01-5d06c14c9bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:27.624029 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc58ec4-cefa-4d77-ba01-5d06c14c9bd5 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:27.624308 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc58ec4-cefa-4d77-ba01-5d06c14c9bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:27.624581 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc58ec4-cefa-4d77-ba01-5d06c14c9bd5 None admin] PATH_INFO: `/v3/domains` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:27.625242 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc58ec4-cefa-4d77-ba01-5d06c14c9bd5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:27.625706 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc58ec4-cefa-4d77-ba01-5d06c14c9bd5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:27.627414 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc58ec4-cefa-4d77-ba01-5d06c14c9bd5 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:27.646402 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 426/849] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 18 21:42:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:42:27.652052 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc58ec4-cefa-4d77-ba01-5d06c14c9bd5 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:27.679587 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87777866-5324-4a77-aab5-fd1fc396a984 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:27.713509 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:27.720780 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a68fc2c-e686-4d55-918e-d3b7346bf73d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:27.721543 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a68fc2c-e686-4d55-918e-d3b7346bf73d None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:27.721726 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a68fc2c-e686-4d55-918e-d3b7346bf73d None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:27.738231 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a68fc2c-e686-4d55-918e-d3b7346bf73d None admin] PATH_INFO: `/v3/services` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:27.738231 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a68fc2c-e686-4d55-918e-d3b7346bf73d None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:27.738231 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a68fc2c-e686-4d55-918e-d3b7346bf73d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:27.738231 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a68fc2c-e686-4d55-918e-d3b7346bf73d None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:27.738231 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 424/850] 10.222.0.27 () {56 vars in 1114 bytes} [Thu Aug 18 21:42:27 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 21:42:27.745276 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a68fc2c-e686-4d55-918e-d3b7346bf73d None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:27.795455 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc58ec4-cefa-4d77-ba01-5d06c14c9bd5 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:27.835202 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baecbfd-31ad-4dd4-a882-e9c0bc157b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:27.836112 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baecbfd-31ad-4dd4-a882-e9c0bc157b09 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:27.836635 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baecbfd-31ad-4dd4-a882-e9c0bc157b09 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:27.837115 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baecbfd-31ad-4dd4-a882-e9c0bc157b09 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:27.845783 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baecbfd-31ad-4dd4-a882-e9c0bc157b09 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:27.847639 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baecbfd-31ad-4dd4-a882-e9c0bc157b09 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:27.861676 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application [None req-4baecbfd-31ad-4dd4-a882-e9c0bc157b09 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 21:42:27.861676 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:27.861676 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:42:27.861676 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:42:27.861676 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:42:27.861676 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:42:27.861676 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:42:27.861676 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:42:27.861676 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:42:27.861676 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:42:27.861676 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:42:27.861676 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:42:27.861676 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 21:42:27.861676 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 21:42:27.861676 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 21:42:27.862647 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 21:42:27.862647 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:42:27.862647 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:42:27.862647 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:42:27.862647 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:42:27.862647 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:42:27.862647 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:42:27.862647 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:42:27.862647 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application with Lock( Aug 18 21:42:27.862647 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:42:27.862647 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:42:27.862647 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:42:27.862647 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:42:27.862647 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:42:27.862647 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:42:27.862647 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:42:27.862647 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:42:27.863533 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 21:42:27.863533 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 21:42:27.863533 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 21:42:27.863533 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 21:42:27.863533 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 21:42:27.863533 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 21:42:27.863533 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 21:42:27.863533 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:42:27.864047 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a68fc2c-e686-4d55-918e-d3b7346bf73d None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:27.871221 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 427/851] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Aug 18 21:42:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:42:27.872509 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baecbfd-31ad-4dd4-a882-e9c0bc157b09 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:27.890155 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:27.901373 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8387e96-06c8-4763-84bb-2218ba40700e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:27.901998 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8387e96-06c8-4763-84bb-2218ba40700e None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:27.909516 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8387e96-06c8-4763-84bb-2218ba40700e None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:27.909516 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8387e96-06c8-4763-84bb-2218ba40700e None admin] PATH_INFO: `/v3/roles/service` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:27.915635 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8387e96-06c8-4763-84bb-2218ba40700e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:42:27.920818 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application [None req-f8387e96-06c8-4763-84bb-2218ba40700e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 21:42:27.920818 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:27.920818 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:42:27.920818 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:42:27.920818 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:42:27.920818 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:42:27.920818 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:42:27.920818 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:42:27.920818 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:42:27.920818 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:42:27.920818 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:42:27.920818 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:42:27.920818 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:42:27.920818 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:42:27.920818 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:42:27.920818 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:42:27.921852 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:42:27.921852 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:42:27.921852 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:42:27.921852 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:42:27.921852 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:42:27.921852 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:42:27.921852 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:42:27.921852 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:42:27.921852 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:42:27.921852 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:42:27.921852 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:42:27.921852 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application with Lock( Aug 18 21:42:27.921852 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:42:27.921852 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:42:27.921852 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:42:27.921852 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:42:27.923265 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:42:27.923265 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:42:27.923265 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:42:27.923265 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:42:27.923265 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:42:27.923265 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:42:27.923265 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:42:27.923265 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:42:27.923265 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:42:27.923265 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:42:27.923265 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 21:42:27.923265 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:42:27.923265 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 425/852] 10.222.0.27 () {56 vars in 1102 bytes} [Thu Aug 18 21:42:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 21:42:27.928707 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8387e96-06c8-4763-84bb-2218ba40700e None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:27.989649 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:28.009398 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baecbfd-31ad-4dd4-a882-e9c0bc157b09 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:28.046179 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7af03e2-505b-40bb-9dbe-d79f506c36d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:28.047119 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7af03e2-505b-40bb-9dbe-d79f506c36d3 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:28.047267 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8387e96-06c8-4763-84bb-2218ba40700e None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:28.048303 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7af03e2-505b-40bb-9dbe-d79f506c36d3 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:28.048976 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7af03e2-505b-40bb-9dbe-d79f506c36d3 None admin] PATH_INFO: `/v3/projects` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:28.049897 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7af03e2-505b-40bb-9dbe-d79f506c36d3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:28.050397 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7af03e2-505b-40bb-9dbe-d79f506c36d3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:28.052015 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7af03e2-505b-40bb-9dbe-d79f506c36d3 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:28.065303 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 428/853] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Aug 18 21:42:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:42:28.070875 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7af03e2-505b-40bb-9dbe-d79f506c36d3 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:28.090981 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dacb8d-b0f3-46d1-914a-08200892efaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:28.092008 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dacb8d-b0f3-46d1-914a-08200892efaf None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:28.092489 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dacb8d-b0f3-46d1-914a-08200892efaf None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:28.093067 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dacb8d-b0f3-46d1-914a-08200892efaf None admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:28.093930 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dacb8d-b0f3-46d1-914a-08200892efaf None admin] RBAC: Adding query filter params (name=service) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:28.094964 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dacb8d-b0f3-46d1-914a-08200892efaf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:28.096585 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dacb8d-b0f3-46d1-914a-08200892efaf None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:28.105956 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 426/854] 10.222.0.27 () {56 vars in 1103 bytes} [Thu Aug 18 21:42:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:42:28.111779 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dacb8d-b0f3-46d1-914a-08200892efaf None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:28.176989 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:28.209211 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7af03e2-505b-40bb-9dbe-d79f506c36d3 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:28.223900 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dacb8d-b0f3-46d1-914a-08200892efaf None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:28.242812 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:28.257261 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63183d2f-78fb-4423-99f6-371bf59e7849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:28.257874 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63183d2f-78fb-4423-99f6-371bf59e7849 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:28.258427 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63183d2f-78fb-4423-99f6-371bf59e7849 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:28.258704 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63183d2f-78fb-4423-99f6-371bf59e7849 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:28.259696 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63183d2f-78fb-4423-99f6-371bf59e7849 None admin] RBAC: Adding query filter params (role.id=0833202e2a3d47d1b6b3af57006641b1, scope.project.id=4b54801b90484d689034f838f85fc0a4, user.id=9ae59e6dca304c949942ae769acedc74) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:28.263785 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dab405-4cf6-4f19-8b23-d9c3cd000a2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:28.264739 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dab405-4cf6-4f19-8b23-d9c3cd000a2a None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:28.265226 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dab405-4cf6-4f19-8b23-d9c3cd000a2a None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:28.265693 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63183d2f-78fb-4423-99f6-371bf59e7849 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:28.266179 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dab405-4cf6-4f19-8b23-d9c3cd000a2a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:28.267643 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63183d2f-78fb-4423-99f6-371bf59e7849 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:28.276766 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 429/855] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Aug 18 21:42:28 2022] GET /identity/v3/role_assignments?user.id=9ae59e6dca304c949942ae769acedc74&scope.project.id=4b54801b90484d689034f838f85fc0a4&role.id=0833202e2a3d47d1b6b3af57006641b1 => generated 608 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:42:28.285727 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dab405-4cf6-4f19-8b23-d9c3cd000a2a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:28.287570 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dab405-4cf6-4f19-8b23-d9c3cd000a2a None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:28.306389 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application [None req-c0dab405-4cf6-4f19-8b23-d9c3cd000a2a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:42:28.306389 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:28.306389 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:42:28.306389 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:42:28.306389 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:42:28.306389 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:42:28.306389 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:42:28.306389 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:42:28.306389 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:42:28.306389 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:42:28.306389 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:42:28.306389 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:42:28.306389 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 21:42:28.306389 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 21:42:28.306389 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 21:42:28.306389 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 21:42:28.307408 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:42:28.307408 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:42:28.307408 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:42:28.307408 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:42:28.307408 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:42:28.307408 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:42:28.307408 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:42:28.307408 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application with Lock( Aug 18 21:42:28.307408 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:42:28.307408 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:42:28.307408 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:42:28.307408 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:42:28.307408 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:42:28.307408 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:42:28.307408 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:42:28.307408 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:42:28.307408 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 21:42:28.308305 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 21:42:28.308305 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:42:28.308305 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:42:28.308305 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 427/856] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 18 21:42:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:42:28.317232 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63183d2f-78fb-4423-99f6-371bf59e7849 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:28.332641 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b07206-8a24-4e2c-ab81-abe9847cebfb None None] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:28.332982 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b07206-8a24-4e2c-ab81-abe9847cebfb None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:28.333199 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b07206-8a24-4e2c-ab81-abe9847cebfb None None] PATH_INFO: `/` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:28.334686 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 428/857] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:42:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 21:42:28.340348 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38ed7c9-fbdb-494a-986d-73bd7bd2479f None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:28.340640 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38ed7c9-fbdb-494a-986d-73bd7bd2479f None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:28.340910 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38ed7c9-fbdb-494a-986d-73bd7bd2479f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:28.371140 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-b38ed7c9-fbdb-494a-986d-73bd7bd2479f None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:42:28.373684 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-b38ed7c9-fbdb-494a-986d-73bd7bd2479f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:42:28.454452 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63183d2f-78fb-4423-99f6-371bf59e7849 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:28.480638 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 429/858] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:42:28 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 21:42:28.499747 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f46bbb-f2a7-4e23-8690-018a26c2241f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:28.500389 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f46bbb-f2a7-4e23-8690-018a26c2241f None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:28.501391 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f46bbb-f2a7-4e23-8690-018a26c2241f None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:28.501391 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f46bbb-f2a7-4e23-8690-018a26c2241f None admin] PATH_INFO: `/v3/domains` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:28.501878 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f46bbb-f2a7-4e23-8690-018a26c2241f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:28.502183 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f46bbb-f2a7-4e23-8690-018a26c2241f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:28.503545 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f46bbb-f2a7-4e23-8690-018a26c2241f None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:28.512847 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:28.517591 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 430/859] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 18 21:42:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 21:42:28.523708 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38ed7c9-fbdb-494a-986d-73bd7bd2479f None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:28.626598 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:28.630479 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38ed7c9-fbdb-494a-986d-73bd7bd2479f None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:28.666734 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411d7b08-4216-4d3d-b312-58be1a2a6b24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:28.667360 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411d7b08-4216-4d3d-b312-58be1a2a6b24 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:28.667632 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411d7b08-4216-4d3d-b312-58be1a2a6b24 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:28.667901 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411d7b08-4216-4d3d-b312-58be1a2a6b24 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:28.675477 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411d7b08-4216-4d3d-b312-58be1a2a6b24 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:28.676939 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411d7b08-4216-4d3d-b312-58be1a2a6b24 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:28.688750 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application [None req-411d7b08-4216-4d3d-b312-58be1a2a6b24 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 18 21:42:28.688750 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:28.688750 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:42:28.688750 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:42:28.688750 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:42:28.688750 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:42:28.688750 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:42:28.688750 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:42:28.688750 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:42:28.688750 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:42:28.688750 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:42:28.688750 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:42:28.688750 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 21:42:28.688750 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 21:42:28.688750 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 21:42:28.688750 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 21:42:28.689693 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:42:28.689693 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:42:28.689693 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 21:42:28.689693 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 21:42:28.689693 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 21:42:28.689693 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 21:42:28.689693 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:42:28.689693 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:42:28.689693 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:42:28.689693 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:42:28.689693 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:42:28.689693 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application with Lock( Aug 18 21:42:28.689693 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:42:28.689693 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:42:28.689693 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:42:28.689693 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:42:28.689693 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:42:28.689693 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:42:28.690839 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:42:28.690839 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:42:28.690839 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 21:42:28.690839 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 21:42:28.690839 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 21:42:28.690839 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 21:42:28.690839 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 21:42:28.690839 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 21:42:28.690839 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 18 21:42:28.690839 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:42:28.690839 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 430/860] 10.222.0.27 () {56 vars in 1117 bytes} [Thu Aug 18 21:42:28 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:42:28.695927 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f46bbb-f2a7-4e23-8690-018a26c2241f None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:28.757923 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411d7b08-4216-4d3d-b312-58be1a2a6b24 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:28.811634 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f46bbb-f2a7-4e23-8690-018a26c2241f None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:28.851130 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cac3b95-b32b-47d8-a118-16a9e03b11fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:28.851986 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cac3b95-b32b-47d8-a118-16a9e03b11fc None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:28.852445 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cac3b95-b32b-47d8-a118-16a9e03b11fc None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:28.852935 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cac3b95-b32b-47d8-a118-16a9e03b11fc None admin] PATH_INFO: `/v3/users` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:28.853808 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cac3b95-b32b-47d8-a118-16a9e03b11fc None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:28.854343 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cac3b95-b32b-47d8-a118-16a9e03b11fc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:28.855977 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cac3b95-b32b-47d8-a118-16a9e03b11fc None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:28.878520 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 431/861] 10.222.0.27 () {56 vars in 1149 bytes} [Thu Aug 18 21:42:28 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:42:28.879546 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411d7b08-4216-4d3d-b312-58be1a2a6b24 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:28.884624 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cac3b95-b32b-47d8-a118-16a9e03b11fc None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:28.920826 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fde48a-81c3-4c42-a5f3-92aee63e72ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:28.921882 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fde48a-81c3-4c42-a5f3-92aee63e72ff None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:28.923498 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fde48a-81c3-4c42-a5f3-92aee63e72ff None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:28.924216 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fde48a-81c3-4c42-a5f3-92aee63e72ff None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:28.924970 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fde48a-81c3-4c42-a5f3-92aee63e72ff None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:28.927220 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fde48a-81c3-4c42-a5f3-92aee63e72ff None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:28.937761 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application [None req-f1fde48a-81c3-4c42-a5f3-92aee63e72ff None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 18 21:42:28.937761 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:28.937761 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 21:42:28.937761 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 21:42:28.937761 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 21:42:28.937761 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 21:42:28.937761 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 21:42:28.937761 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 21:42:28.937761 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 18 21:42:28.937761 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:42:28.937761 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 21:42:28.937761 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:42:28.937761 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:28.937761 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:42:28.937761 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:42:28.937761 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:42:28.939084 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:42:28.939084 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:42:28.939084 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:42:28.939084 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:42:28.939084 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:42:28.939084 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:42:28.939084 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:42:28.939084 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 21:42:28.939084 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 21:42:28.939084 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 21:42:28.939084 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 21:42:28.939084 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:42:28.939084 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:42:28.939084 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:42:28.939084 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:42:28.939084 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:42:28.939084 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:42:28.939982 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:42:28.939982 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application with Lock( Aug 18 21:42:28.939982 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:42:28.939982 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:42:28.939982 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:42:28.939982 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:42:28.939982 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:42:28.939982 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:42:28.939982 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:42:28.939982 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:42:28.939982 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 21:42:28.939982 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 21:42:28.939982 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 18 21:42:28.939982 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:42:28.942072 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 431/862] 10.222.0.27 () {56 vars in 1132 bytes} [Thu Aug 18 21:42:28 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:42:28.952643 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fde48a-81c3-4c42-a5f3-92aee63e72ff None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:28.959446 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:28.979802 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:29.017463 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cac3b95-b32b-47d8-a118-16a9e03b11fc None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:29.069091 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f23e2e-3256-4771-bf7d-67ad32d40d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:29.069784 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f23e2e-3256-4771-bf7d-67ad32d40d4a None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:29.070065 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f23e2e-3256-4771-bf7d-67ad32d40d4a None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:29.070338 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f23e2e-3256-4771-bf7d-67ad32d40d4a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:29.071625 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fde48a-81c3-4c42-a5f3-92aee63e72ff None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:29.110399 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaf5f5f-127c-43a6-b8af-946d165c6be2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:29.111364 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaf5f5f-127c-43a6-b8af-946d165c6be2 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:29.111818 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaf5f5f-127c-43a6-b8af-946d165c6be2 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:29.112281 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaf5f5f-127c-43a6-b8af-946d165c6be2 None admin] PATH_INFO: `/v3/services` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:29.113101 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaf5f5f-127c-43a6-b8af-946d165c6be2 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:29.113570 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaf5f5f-127c-43a6-b8af-946d165c6be2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:29.115150 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaf5f5f-127c-43a6-b8af-946d165c6be2 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:29.120383 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 432/863] 10.222.0.27 () {56 vars in 1126 bytes} [Thu Aug 18 21:42:28 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:42:29.127164 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaf5f5f-127c-43a6-b8af-946d165c6be2 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:29.157565 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f23e2e-3256-4771-bf7d-67ad32d40d4a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:29.159086 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f23e2e-3256-4771-bf7d-67ad32d40d4a None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:29.215095 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:29.224367 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:29.240632 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaf5f5f-127c-43a6-b8af-946d165c6be2 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:29.272926 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 432/864] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Aug 18 21:42:28 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 18 21:42:29.274455 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f23e2e-3256-4771-bf7d-67ad32d40d4a None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:29.277302 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917b7e61-5daa-4871-b3c3-4287c023323f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:29.278144 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917b7e61-5daa-4871-b3c3-4287c023323f None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:29.278643 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917b7e61-5daa-4871-b3c3-4287c023323f None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:29.279164 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917b7e61-5daa-4871-b3c3-4287c023323f None admin] PATH_INFO: `/v3/services` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:29.279991 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917b7e61-5daa-4871-b3c3-4287c023323f None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:29.280492 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917b7e61-5daa-4871-b3c3-4287c023323f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:29.282245 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917b7e61-5daa-4871-b3c3-4287c023323f None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:29.294015 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 433/865] 10.222.0.27 () {56 vars in 1126 bytes} [Thu Aug 18 21:42:29 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:42:29.398583 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f23e2e-3256-4771-bf7d-67ad32d40d4a None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:29.437378 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b80660-f3c0-4d17-892d-a739cd87cf60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:29.438796 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b80660-f3c0-4d17-892d-a739cd87cf60 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:29.439219 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b80660-f3c0-4d17-892d-a739cd87cf60 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:29.439646 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b80660-f3c0-4d17-892d-a739cd87cf60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:29.450331 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b80660-f3c0-4d17-892d-a739cd87cf60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:29.451934 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b80660-f3c0-4d17-892d-a739cd87cf60 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:29.467813 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application [None req-a6b80660-f3c0-4d17-892d-a739cd87cf60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:42:29.467813 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:29.467813 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:42:29.467813 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:42:29.467813 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:42:29.467813 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:42:29.467813 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:42:29.467813 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:42:29.467813 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:42:29.467813 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:42:29.467813 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:42:29.467813 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:42:29.467813 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 21:42:29.467813 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 21:42:29.467813 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 21:42:29.467813 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 21:42:29.469026 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:42:29.469026 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:42:29.469026 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:42:29.469026 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:42:29.469026 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:42:29.469026 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:42:29.469026 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:42:29.469026 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application with Lock( Aug 18 21:42:29.469026 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:42:29.469026 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:42:29.469026 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:42:29.469026 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:42:29.469026 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:42:29.469026 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:42:29.469026 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:42:29.469026 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:42:29.469026 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 21:42:29.470932 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 21:42:29.470932 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:42:29.470932 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:42:29.472688 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 433/866] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 18 21:42:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:42:29.484632 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917b7e61-5daa-4871-b3c3-4287c023323f None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:29.588867 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917b7e61-5daa-4871-b3c3-4287c023323f None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:29.623241 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba893288-7e6e-4982-b36b-430fb6f1baf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:29.623845 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba893288-7e6e-4982-b36b-430fb6f1baf3 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:29.624125 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba893288-7e6e-4982-b36b-430fb6f1baf3 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:29.624441 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba893288-7e6e-4982-b36b-430fb6f1baf3 None admin] PATH_INFO: `/v3/domains` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:29.625132 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba893288-7e6e-4982-b36b-430fb6f1baf3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:29.625997 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba893288-7e6e-4982-b36b-430fb6f1baf3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:29.627532 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba893288-7e6e-4982-b36b-430fb6f1baf3 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:29.639651 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 434/867] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 18 21:42:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:42:29.646370 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b80660-f3c0-4d17-892d-a739cd87cf60 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:29.658587 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:29.746320 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbf0ee7-0067-4ea7-bc14-13e0018ec291 None None] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:29.746693 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbf0ee7-0067-4ea7-bc14-13e0018ec291 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:29.747345 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbf0ee7-0067-4ea7-bc14-13e0018ec291 None None] PATH_INFO: `/` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:29.749513 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 435/868] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:42:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:42:29.754886 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af2eff0-af4e-4de6-a994-065842f78734 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:29.755233 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af2eff0-af4e-4de6-a994-065842f78734 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:29.755493 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b80660-f3c0-4d17-892d-a739cd87cf60 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:29.755618 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af2eff0-af4e-4de6-a994-065842f78734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:29.776931 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-2af2eff0-af4e-4de6-a994-065842f78734 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:42:29.778803 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-2af2eff0-af4e-4de6-a994-065842f78734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:42:29.790259 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:29.792907 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a5093d-7b5f-449f-8bf2-e6bcb96b1e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:29.793800 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a5093d-7b5f-449f-8bf2-e6bcb96b1e83 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:29.794285 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a5093d-7b5f-449f-8bf2-e6bcb96b1e83 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:29.794709 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a5093d-7b5f-449f-8bf2-e6bcb96b1e83 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:29.802197 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a5093d-7b5f-449f-8bf2-e6bcb96b1e83 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:29.803891 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a5093d-7b5f-449f-8bf2-e6bcb96b1e83 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:29.816287 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application [None req-48a5093d-7b5f-449f-8bf2-e6bcb96b1e83 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 21:42:29.816287 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:29.816287 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:42:29.816287 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:42:29.816287 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:42:29.816287 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:42:29.816287 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:42:29.816287 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:42:29.816287 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:42:29.816287 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:42:29.816287 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:42:29.816287 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:42:29.816287 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 21:42:29.816287 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 21:42:29.816287 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 21:42:29.817735 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 21:42:29.817735 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:42:29.817735 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:42:29.817735 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:42:29.817735 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:42:29.817735 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:42:29.817735 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:42:29.817735 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:42:29.817735 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application with Lock( Aug 18 21:42:29.817735 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:42:29.817735 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:42:29.817735 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:42:29.817735 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:42:29.817735 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:42:29.817735 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:42:29.817735 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:42:29.817735 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:42:29.818614 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 21:42:29.818614 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 21:42:29.818614 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 21:42:29.818614 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 21:42:29.818614 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 21:42:29.818614 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 21:42:29.818614 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 21:42:29.818614 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:42:29.820967 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 434/869] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Aug 18 21:42:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:42:29.827570 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a5093d-7b5f-449f-8bf2-e6bcb96b1e83 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:29.863799 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 436/870] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:42:29 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 21:42:29.906114 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:29.941540 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a5093d-7b5f-449f-8bf2-e6bcb96b1e83 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:29.977912 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344cbb48-d20e-4a72-90e0-d085ac5bf3a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:29.978676 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344cbb48-d20e-4a72-90e0-d085ac5bf3a6 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:29.979052 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344cbb48-d20e-4a72-90e0-d085ac5bf3a6 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:29.979425 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344cbb48-d20e-4a72-90e0-d085ac5bf3a6 None admin] PATH_INFO: `/v3/projects` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:29.980233 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344cbb48-d20e-4a72-90e0-d085ac5bf3a6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:29.980668 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344cbb48-d20e-4a72-90e0-d085ac5bf3a6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:29.982237 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344cbb48-d20e-4a72-90e0-d085ac5bf3a6 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:30.001552 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 435/871] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Aug 18 21:42:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:42:30.005141 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af2eff0-af4e-4de6-a994-065842f78734 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:30.110901 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af2eff0-af4e-4de6-a994-065842f78734 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:30.141891 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344cbb48-d20e-4a72-90e0-d085ac5bf3a6 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:30.145881 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b218f79-a65a-4532-9456-f7bc37e6999a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:30.146808 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b218f79-a65a-4532-9456-f7bc37e6999a None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:30.147219 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b218f79-a65a-4532-9456-f7bc37e6999a None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:30.147631 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b218f79-a65a-4532-9456-f7bc37e6999a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:30.148492 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b218f79-a65a-4532-9456-f7bc37e6999a None admin] RBAC: Adding query filter params (role.id=30d8ac11e30e4b1d83940485e98d147c, scope.project.id=4b54801b90484d689034f838f85fc0a4, user.id=f079aa6ed5594a4982172b51b93ac54f) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:30.148978 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b218f79-a65a-4532-9456-f7bc37e6999a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:30.150554 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b218f79-a65a-4532-9456-f7bc37e6999a None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:30.157996 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 437/872] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Aug 18 21:42:30 2022] GET /identity/v3/role_assignments?user.id=f079aa6ed5594a4982172b51b93ac54f&scope.project.id=4b54801b90484d689034f838f85fc0a4&role.id=30d8ac11e30e4b1d83940485e98d147c => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 21:42:30.269364 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344cbb48-d20e-4a72-90e0-d085ac5bf3a6 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:30.307430 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:30.321987 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e93c5d-307d-462c-904c-334375f2f952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:30.322610 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e93c5d-307d-462c-904c-334375f2f952 None admin] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:30.322892 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e93c5d-307d-462c-904c-334375f2f952 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:30.323167 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e93c5d-307d-462c-904c-334375f2f952 None admin] PATH_INFO: `/v3/services` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:30.323843 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e93c5d-307d-462c-904c-334375f2f952 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:30.325314 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e93c5d-307d-462c-904c-334375f2f952 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:30.401096 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62f5e1f-5144-4b65-8aa1-dc49f97a894c None None] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:30.401416 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62f5e1f-5144-4b65-8aa1-dc49f97a894c None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:30.401646 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62f5e1f-5144-4b65-8aa1-dc49f97a894c None None] PATH_INFO: `/` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:30.403102 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 438/873] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:42:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 21:42:30.408207 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc821d3d-3638-4813-a775-e16b337af209 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:30.408494 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc821d3d-3638-4813-a775-e16b337af209 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:30.408816 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc821d3d-3638-4813-a775-e16b337af209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:30.417333 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:30.428941 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-fc821d3d-3638-4813-a775-e16b337af209 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:42:30.436954 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-fc821d3d-3638-4813-a775-e16b337af209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:42:30.437098 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 436/874] 10.222.0.27 () {60 vars in 1141 bytes} [Thu Aug 18 21:42:30 2022] POST /identity/v3/services => generated 251 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 21:42:30.519146 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 439/875] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:42:30 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 21:42:30.988013 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e93c5d-307d-462c-904c-334375f2f952 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:31.095702 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e93c5d-307d-462c-904c-334375f2f952 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:31.131576 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83102cc2-ed89-4097-b1c2-7c4125942d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:31.132215 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83102cc2-ed89-4097-b1c2-7c4125942d9a None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:31.132490 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83102cc2-ed89-4097-b1c2-7c4125942d9a None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:31.132787 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83102cc2-ed89-4097-b1c2-7c4125942d9a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:31.133363 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83102cc2-ed89-4097-b1c2-7c4125942d9a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:31.134745 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83102cc2-ed89-4097-b1c2-7c4125942d9a None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:31.143986 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application [None req-83102cc2-ed89-4097-b1c2-7c4125942d9a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 18 21:42:31.143986 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:31.143986 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 21:42:31.143986 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 21:42:31.143986 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 21:42:31.143986 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 21:42:31.143986 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 21:42:31.143986 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 21:42:31.143986 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 18 21:42:31.143986 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:42:31.143986 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 21:42:31.143986 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:42:31.143986 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:31.143986 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:42:31.143986 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:42:31.143986 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:42:31.143986 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:42:31.144988 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:42:31.144988 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:42:31.144988 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:42:31.144988 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:42:31.144988 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:42:31.144988 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:42:31.144988 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 21:42:31.144988 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 21:42:31.144988 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 21:42:31.144988 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 21:42:31.144988 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:42:31.144988 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:42:31.144988 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:42:31.144988 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:42:31.144988 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:42:31.144988 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:42:31.145817 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:42:31.145817 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application with Lock( Aug 18 21:42:31.145817 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:42:31.145817 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:42:31.145817 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:42:31.145817 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:42:31.145817 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:42:31.145817 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:42:31.145817 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:42:31.145817 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:42:31.145817 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 21:42:31.145817 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 21:42:31.145817 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 18 21:42:31.145817 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:42:31.145817 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 437/876] 10.222.0.27 () {56 vars in 1126 bytes} [Thu Aug 18 21:42:30 2022] GET /identity/v3/services/object-store => generated 93 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:42:31.153906 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc821d3d-3638-4813-a775-e16b337af209 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:31.263386 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc821d3d-3638-4813-a775-e16b337af209 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:31.292837 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:31.300138 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c504786-f2c2-4ed9-8f13-9ee425690c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:31.300795 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c504786-f2c2-4ed9-8f13-9ee425690c3b None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:31.301123 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c504786-f2c2-4ed9-8f13-9ee425690c3b None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:31.301397 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c504786-f2c2-4ed9-8f13-9ee425690c3b None admin] PATH_INFO: `/v3/services` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:31.302033 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c504786-f2c2-4ed9-8f13-9ee425690c3b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:31.302336 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c504786-f2c2-4ed9-8f13-9ee425690c3b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:31.303772 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c504786-f2c2-4ed9-8f13-9ee425690c3b None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:31.312608 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 440/877] 10.222.0.27 () {56 vars in 1122 bytes} [Thu Aug 18 21:42:31 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:42:31.315528 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83102cc2-ed89-4097-b1c2-7c4125942d9a None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:31.374484 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:31.425899 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83102cc2-ed89-4097-b1c2-7c4125942d9a None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:31.461513 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117e21a0-814c-418c-b48f-b94e2e3ccbf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:31.462324 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117e21a0-814c-418c-b48f-b94e2e3ccbf4 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:31.463131 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117e21a0-814c-418c-b48f-b94e2e3ccbf4 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:31.463407 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117e21a0-814c-418c-b48f-b94e2e3ccbf4 None admin] PATH_INFO: `/v3/services` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:31.464049 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117e21a0-814c-418c-b48f-b94e2e3ccbf4 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:31.464354 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117e21a0-814c-418c-b48f-b94e2e3ccbf4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:31.465889 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117e21a0-814c-418c-b48f-b94e2e3ccbf4 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:31.475048 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 438/878] 10.222.0.27 () {56 vars in 1122 bytes} [Thu Aug 18 21:42:31 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:42:31.503265 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2c4948-085d-4bf2-a96e-cb91edb3bf8d None None] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:31.503600 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2c4948-085d-4bf2-a96e-cb91edb3bf8d None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:31.503823 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2c4948-085d-4bf2-a96e-cb91edb3bf8d None None] PATH_INFO: `/` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:31.505409 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 441/879] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:42:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:42:31.511240 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1156cce-e78f-4d90-b518-4e6d7eaab20e None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:31.511533 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1156cce-e78f-4d90-b518-4e6d7eaab20e None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:31.511801 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1156cce-e78f-4d90-b518-4e6d7eaab20e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:31.533492 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-d1156cce-e78f-4d90-b518-4e6d7eaab20e None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:42:31.534685 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-d1156cce-e78f-4d90-b518-4e6d7eaab20e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:42:31.618918 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 439/880] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:42:31 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 21:42:31.896488 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2c4948-085d-4bf2-a96e-cb91edb3bf8d None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:32.008393 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2c4948-085d-4bf2-a96e-cb91edb3bf8d None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:32.044727 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f030bed-b806-416b-a749-f284fa33f071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:32.045333 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f030bed-b806-416b-a749-f284fa33f071 None admin] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:32.045607 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f030bed-b806-416b-a749-f284fa33f071 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:32.045873 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f030bed-b806-416b-a749-f284fa33f071 None admin] PATH_INFO: `/v3/services` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:32.046522 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f030bed-b806-416b-a749-f284fa33f071 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:32.048069 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f030bed-b806-416b-a749-f284fa33f071 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:32.143882 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 442/881] 10.222.0.27 () {60 vars in 1141 bytes} [Thu Aug 18 21:42:31 2022] POST /identity/v3/services => generated 269 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:42:32.400843 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2753dfd-1757-411b-b2cd-c0749ef21984 None None] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:32.401518 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2753dfd-1757-411b-b2cd-c0749ef21984 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:32.401518 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2753dfd-1757-411b-b2cd-c0749ef21984 None None] PATH_INFO: `/` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:32.402990 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 440/882] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:42:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:42:32.409255 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5c1730-f8cb-4c22-9d81-2d4095625da0 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:32.409902 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5c1730-f8cb-4c22-9d81-2d4095625da0 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:32.409902 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5c1730-f8cb-4c22-9d81-2d4095625da0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:32.414134 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce945b1-21c3-4218-8d07-39c771db4fc0 None None] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:32.414419 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce945b1-21c3-4218-8d07-39c771db4fc0 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:32.414824 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce945b1-21c3-4218-8d07-39c771db4fc0 None None] PATH_INFO: `/` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:32.416360 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 441/883] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:42:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 21:42:32.421277 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b242a3f-16f4-4e95-9bb5-23261c68e66a None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:32.421556 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b242a3f-16f4-4e95-9bb5-23261c68e66a None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:32.421828 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b242a3f-16f4-4e95-9bb5-23261c68e66a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:32.430377 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-7e5c1730-f8cb-4c22-9d81-2d4095625da0 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:42:32.431587 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-7e5c1730-f8cb-4c22-9d81-2d4095625da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:42:32.441331 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-2b242a3f-16f4-4e95-9bb5-23261c68e66a None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:42:32.442789 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-2b242a3f-16f4-4e95-9bb5-23261c68e66a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:42:32.496495 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:32.498108 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:32.530898 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 443/884] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:42:32 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 21:42:32.548999 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 442/885] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:42:32 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 21:42:32.810794 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5c1730-f8cb-4c22-9d81-2d4095625da0 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:32.820735 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b242a3f-16f4-4e95-9bb5-23261c68e66a None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:32.930515 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5c1730-f8cb-4c22-9d81-2d4095625da0 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:32.931218 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b242a3f-16f4-4e95-9bb5-23261c68e66a None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:32.969285 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a113376-5b71-4874-b9e6-178b4c506d27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:32.970078 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2c36f1-51fd-4064-b45f-a8be828f8311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:32.970480 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a113376-5b71-4874-b9e6-178b4c506d27 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:32.970786 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a113376-5b71-4874-b9e6-178b4c506d27 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:32.971037 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2c36f1-51fd-4064-b45f-a8be828f8311 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:32.971149 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a113376-5b71-4874-b9e6-178b4c506d27 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:32.971545 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2c36f1-51fd-4064-b45f-a8be828f8311 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:32.972030 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2c36f1-51fd-4064-b45f-a8be828f8311 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:32.973150 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2c36f1-51fd-4064-b45f-a8be828f8311 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:32.975716 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2c36f1-51fd-4064-b45f-a8be828f8311 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:32.982250 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a113376-5b71-4874-b9e6-178b4c506d27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:42:32.985898 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application [None req-2b2c36f1-51fd-4064-b45f-a8be828f8311 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 18 21:42:32.985898 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:32.985898 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 21:42:32.985898 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 21:42:32.985898 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 21:42:32.985898 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 21:42:32.985898 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 21:42:32.985898 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 21:42:32.985898 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 18 21:42:32.985898 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:42:32.985898 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 21:42:32.985898 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:42:32.985898 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:32.985898 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:42:32.985898 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:42:32.985898 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:42:32.985898 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:42:32.986992 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:42:32.986992 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:42:32.986992 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:42:32.986992 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:42:32.986992 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:42:32.986992 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:42:32.986992 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 21:42:32.986992 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 21:42:32.986992 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 21:42:32.986992 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 21:42:32.986992 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:42:32.986992 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:42:32.986992 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:42:32.986992 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:42:32.986992 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:42:32.986992 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:42:32.987936 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:42:32.987936 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application with Lock( Aug 18 21:42:32.987936 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:42:32.987936 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:42:32.987936 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:42:32.987936 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:42:32.987936 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:42:32.987936 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:42:32.987936 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:42:32.987936 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:42:32.987936 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 21:42:32.987936 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 21:42:32.987936 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 18 21:42:32.987936 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:42:32.989540 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application [None req-1a113376-5b71-4874-b9e6-178b4c506d27 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 18 21:42:32.989540 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:32.989540 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:42:32.989540 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:42:32.989540 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:42:32.989540 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:42:32.989540 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:42:32.989540 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:42:32.989540 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:42:32.989540 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:42:32.989540 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:42:32.989540 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:42:32.989540 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:42:32.989540 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:42:32.989540 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:42:32.989540 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:42:32.991594 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:42:32.991594 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:42:32.991594 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:42:32.991594 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:42:32.991594 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:42:32.991594 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:42:32.991594 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:42:32.991594 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:42:32.991594 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:42:32.991594 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:42:32.991594 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:42:32.991594 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application with Lock( Aug 18 21:42:32.991594 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:42:32.991594 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:42:32.991594 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:42:32.991594 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:42:32.993780 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:42:32.993780 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:42:32.993780 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:42:32.993780 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:42:32.993780 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:42:32.993780 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:42:32.993780 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:42:32.993780 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:42:32.993780 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:42:32.993780 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:42:32.993780 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 18 21:42:32.993780 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:42:32.995282 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 443/886] 10.222.0.27 () {56 vars in 1114 bytes} [Thu Aug 18 21:42:32 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 21:42:32.995430 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 444/887] 10.222.0.27 () {56 vars in 1120 bytes} [Thu Aug 18 21:42:32 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:42:32.995680 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2c36f1-51fd-4064-b45f-a8be828f8311 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:33.001557 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a113376-5b71-4874-b9e6-178b4c506d27 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:33.042170 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:33.058843 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:33.126102 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a113376-5b71-4874-b9e6-178b4c506d27 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:33.126731 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2c36f1-51fd-4064-b45f-a8be828f8311 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:33.165024 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e500efb6-c694-4742-95f6-1d374e9eb5b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:33.166816 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e500efb6-c694-4742-95f6-1d374e9eb5b5 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:33.166816 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e500efb6-c694-4742-95f6-1d374e9eb5b5 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:33.166816 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e500efb6-c694-4742-95f6-1d374e9eb5b5 None admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:33.167093 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e500efb6-c694-4742-95f6-1d374e9eb5b5 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:33.167300 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e500efb6-c694-4742-95f6-1d374e9eb5b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:33.169010 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e500efb6-c694-4742-95f6-1d374e9eb5b5 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:33.171994 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e729296-ca10-449b-b179-47661011a9fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:33.173501 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e729296-ca10-449b-b179-47661011a9fe None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:33.174026 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e729296-ca10-449b-b179-47661011a9fe None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:33.174403 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e729296-ca10-449b-b179-47661011a9fe None admin] PATH_INFO: `/v3/services` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:33.175143 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e729296-ca10-449b-b179-47661011a9fe None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:33.175990 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e729296-ca10-449b-b179-47661011a9fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:33.177810 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e729296-ca10-449b-b179-47661011a9fe None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:33.182796 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 444/888] 10.222.0.27 () {56 vars in 1114 bytes} [Thu Aug 18 21:42:32 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:42:33.183451 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 445/889] 10.222.0.27 () {56 vars in 1115 bytes} [Thu Aug 18 21:42:33 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:42:33.188726 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e500efb6-c694-4742-95f6-1d374e9eb5b5 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:33.188859 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e729296-ca10-449b-b179-47661011a9fe None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:33.313823 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e500efb6-c694-4742-95f6-1d374e9eb5b5 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:33.315969 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:33.338519 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:33.343036 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e729296-ca10-449b-b179-47661011a9fe None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:33.353094 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6b18bc-6226-46b2-ab8b-a5acc1c28872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:33.354014 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6b18bc-6226-46b2-ab8b-a5acc1c28872 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:33.354527 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6b18bc-6226-46b2-ab8b-a5acc1c28872 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:33.355013 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6b18bc-6226-46b2-ab8b-a5acc1c28872 None admin] PATH_INFO: `/v3/services` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:33.355809 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6b18bc-6226-46b2-ab8b-a5acc1c28872 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:33.356283 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6b18bc-6226-46b2-ab8b-a5acc1c28872 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:33.357896 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6b18bc-6226-46b2-ab8b-a5acc1c28872 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:33.368809 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 446/890] 10.222.0.27 () {56 vars in 1114 bytes} [Thu Aug 18 21:42:33 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:42:33.370208 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6b18bc-6226-46b2-ab8b-a5acc1c28872 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:33.384946 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa985b7-875b-4195-93a7-4ecc5c04a884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:33.386437 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa985b7-875b-4195-93a7-4ecc5c04a884 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:33.386753 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa985b7-875b-4195-93a7-4ecc5c04a884 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:33.387008 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa985b7-875b-4195-93a7-4ecc5c04a884 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:33.399138 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa985b7-875b-4195-93a7-4ecc5c04a884 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:33.400676 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa985b7-875b-4195-93a7-4ecc5c04a884 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:33.416347 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application [None req-2aa985b7-875b-4195-93a7-4ecc5c04a884 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:42:33.416347 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:33.416347 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:42:33.416347 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:42:33.416347 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:42:33.416347 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:42:33.416347 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:42:33.416347 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:42:33.416347 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:42:33.416347 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:42:33.416347 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:42:33.416347 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:42:33.416347 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 21:42:33.416347 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 21:42:33.416347 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 21:42:33.416347 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 21:42:33.417770 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:42:33.417770 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:42:33.417770 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:42:33.417770 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:42:33.417770 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:42:33.417770 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:42:33.417770 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:42:33.417770 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application with Lock( Aug 18 21:42:33.417770 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:42:33.417770 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:42:33.417770 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:42:33.417770 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:42:33.417770 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:42:33.417770 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:42:33.417770 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:42:33.417770 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:42:33.417770 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 21:42:33.418679 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 21:42:33.418679 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:42:33.418679 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:42:33.418679 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 445/891] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 18 21:42:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:42:33.423957 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa985b7-875b-4195-93a7-4ecc5c04a884 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:33.483951 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6b18bc-6226-46b2-ab8b-a5acc1c28872 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:33.519796 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272f304a-2120-4723-8bda-97999171748c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:33.520408 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272f304a-2120-4723-8bda-97999171748c None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:33.520710 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272f304a-2120-4723-8bda-97999171748c None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:33.520984 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272f304a-2120-4723-8bda-97999171748c None admin] PATH_INFO: `/v3/endpoints` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:33.521680 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272f304a-2120-4723-8bda-97999171748c None admin] RBAC: Adding query filter params (interface=public, service_id=a111d72b06474cffaec74d86b4c56128, region_id=RegionOne) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:33.522102 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272f304a-2120-4723-8bda-97999171748c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:33.523588 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272f304a-2120-4723-8bda-97999171748c None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:33.529984 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 447/892] 10.222.0.27 () {56 vars in 1251 bytes} [Thu Aug 18 21:42:33 2022] GET /identity/v3/endpoints?service_id=a111d72b06474cffaec74d86b4c56128&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:42:33.531538 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb4920b-8648-4b22-9d8b-4f253d5b25a3 None None] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:33.531926 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb4920b-8648-4b22-9d8b-4f253d5b25a3 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:33.532205 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb4920b-8648-4b22-9d8b-4f253d5b25a3 None None] PATH_INFO: `/` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:33.534832 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 448/893] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:42:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:42:33.535694 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb4920b-8648-4b22-9d8b-4f253d5b25a3 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:33.550545 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa985b7-875b-4195-93a7-4ecc5c04a884 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:33.567686 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:33.589697 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44780bbd-962b-4ea5-9c3a-a79d427cf542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:33.590684 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44780bbd-962b-4ea5-9c3a-a79d427cf542 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:33.591201 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44780bbd-962b-4ea5-9c3a-a79d427cf542 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:33.591650 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44780bbd-962b-4ea5-9c3a-a79d427cf542 None admin] PATH_INFO: `/v3/domains` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:33.592337 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44780bbd-962b-4ea5-9c3a-a79d427cf542 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:33.592684 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44780bbd-962b-4ea5-9c3a-a79d427cf542 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:33.594103 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44780bbd-962b-4ea5-9c3a-a79d427cf542 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:33.606749 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 446/894] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 18 21:42:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 21:42:33.608048 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cd6243-bbef-46e2-858f-fb020cbe1287 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:33.608399 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cd6243-bbef-46e2-858f-fb020cbe1287 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:33.608755 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cd6243-bbef-46e2-858f-fb020cbe1287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:33.627755 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-06cd6243-bbef-46e2-858f-fb020cbe1287 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:42:33.629073 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-06cd6243-bbef-46e2-858f-fb020cbe1287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:42:33.637234 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:33.648193 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb4920b-8648-4b22-9d8b-4f253d5b25a3 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:33.685509 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b755e3-8d12-49e2-84fc-4285d4277363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:33.686116 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b755e3-8d12-49e2-84fc-4285d4277363 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:33.686397 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b755e3-8d12-49e2-84fc-4285d4277363 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:33.686663 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b755e3-8d12-49e2-84fc-4285d4277363 None admin] PATH_INFO: `/v3/services` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:33.687266 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b755e3-8d12-49e2-84fc-4285d4277363 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:33.689279 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b755e3-8d12-49e2-84fc-4285d4277363 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:33.695265 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 449/895] 10.222.0.27 () {56 vars in 1087 bytes} [Thu Aug 18 21:42:33 2022] GET /identity/v3/services => generated 1268 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:42:33.696052 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b755e3-8d12-49e2-84fc-4285d4277363 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:33.712695 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 447/896] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:42:33 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 21:42:33.807410 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:33.815932 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b755e3-8d12-49e2-84fc-4285d4277363 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:33.852385 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cd3507-1009-4c6a-9838-902384b3e124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:33.858905 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cd3507-1009-4c6a-9838-902384b3e124 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:33.858905 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cd3507-1009-4c6a-9838-902384b3e124 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:33.858905 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cd3507-1009-4c6a-9838-902384b3e124 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:33.863332 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cd3507-1009-4c6a-9838-902384b3e124 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:33.865022 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cd3507-1009-4c6a-9838-902384b3e124 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:33.878075 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application [None req-f6cd3507-1009-4c6a-9838-902384b3e124 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 18 21:42:33.878075 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:33.878075 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:42:33.878075 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:42:33.878075 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:42:33.878075 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:42:33.878075 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:42:33.878075 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:42:33.878075 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:42:33.878075 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:42:33.878075 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:42:33.878075 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:42:33.878075 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 21:42:33.878075 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 21:42:33.878075 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 21:42:33.878075 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 21:42:33.879081 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:42:33.879081 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:42:33.879081 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 21:42:33.879081 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 21:42:33.879081 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 21:42:33.879081 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 21:42:33.879081 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:42:33.879081 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:42:33.879081 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:42:33.879081 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:42:33.879081 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:42:33.879081 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application with Lock( Aug 18 21:42:33.879081 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:42:33.879081 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:42:33.879081 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:42:33.879081 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:42:33.879081 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:42:33.879081 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:42:33.880021 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:42:33.880021 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:42:33.880021 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 21:42:33.880021 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 21:42:33.880021 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 21:42:33.880021 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 21:42:33.880021 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 21:42:33.880021 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 21:42:33.880021 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 18 21:42:33.880021 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:42:33.881450 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 450/897] 10.222.0.27 () {56 vars in 1117 bytes} [Thu Aug 18 21:42:33 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:42:33.887386 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cd6243-bbef-46e2-858f-fb020cbe1287 None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:33.985926 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cd3507-1009-4c6a-9838-902384b3e124 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:33.997851 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cd6243-bbef-46e2-858f-fb020cbe1287 None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:34.034591 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2423076d-30ca-49a6-a7ef-8e110b2da965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:34.035196 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2423076d-30ca-49a6-a7ef-8e110b2da965 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:34.035536 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2423076d-30ca-49a6-a7ef-8e110b2da965 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:34.035807 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2423076d-30ca-49a6-a7ef-8e110b2da965 None admin] PATH_INFO: `/v3/users` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:34.036516 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2423076d-30ca-49a6-a7ef-8e110b2da965 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:34.036855 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2423076d-30ca-49a6-a7ef-8e110b2da965 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:34.038265 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2423076d-30ca-49a6-a7ef-8e110b2da965 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:34.056977 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:34.061469 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 448/898] 10.222.0.27 () {56 vars in 1149 bytes} [Thu Aug 18 21:42:33 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:42:34.062356 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2423076d-30ca-49a6-a7ef-8e110b2da965 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:34.098035 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cd3507-1009-4c6a-9838-902384b3e124 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:34.134278 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7374da2d-9fd4-4c77-a31e-851fa8e4d3af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:34.135237 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7374da2d-9fd4-4c77-a31e-851fa8e4d3af None admin] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:34.135728 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7374da2d-9fd4-4c77-a31e-851fa8e4d3af None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:34.136190 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7374da2d-9fd4-4c77-a31e-851fa8e4d3af None admin] PATH_INFO: `/v3/services` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:34.137074 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7374da2d-9fd4-4c77-a31e-851fa8e4d3af None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:34.138724 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7374da2d-9fd4-4c77-a31e-851fa8e4d3af None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:34.167260 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2423076d-30ca-49a6-a7ef-8e110b2da965 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:34.201044 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a377fd35-842c-4d25-ba68-b17b58b51d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:34.201659 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a377fd35-842c-4d25-ba68-b17b58b51d05 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:34.201960 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a377fd35-842c-4d25-ba68-b17b58b51d05 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:34.202232 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a377fd35-842c-4d25-ba68-b17b58b51d05 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:34.271160 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:34.273410 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a377fd35-842c-4d25-ba68-b17b58b51d05 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:34.274868 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a377fd35-842c-4d25-ba68-b17b58b51d05 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:34.304654 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 451/899] 10.222.0.27 () {60 vars in 1141 bytes} [Thu Aug 18 21:42:33 2022] POST /identity/v3/services => generated 241 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 21:42:34.304654 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0671d2-7b73-49e0-ad3d-bc1d9e5ddc24 None None] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:34.304654 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0671d2-7b73-49e0-ad3d-bc1d9e5ddc24 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:34.304654 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0671d2-7b73-49e0-ad3d-bc1d9e5ddc24 None None] PATH_INFO: `/` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:34.309853 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 452/900] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:42:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:42:34.311327 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cb3915-5042-4bd1-a5b6-e5a3de78616f None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:34.311618 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cb3915-5042-4bd1-a5b6-e5a3de78616f None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:34.312635 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cb3915-5042-4bd1-a5b6-e5a3de78616f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:34.340251 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-c8cb3915-5042-4bd1-a5b6-e5a3de78616f None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:42:34.342709 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-c8cb3915-5042-4bd1-a5b6-e5a3de78616f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:42:34.358239 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:34.397509 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 449/901] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Aug 18 21:42:34 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 18 21:42:34.402801 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a377fd35-842c-4d25-ba68-b17b58b51d05 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:34.449479 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 453/902] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:42:34 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 21:42:34.514542 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:34.517726 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a377fd35-842c-4d25-ba68-b17b58b51d05 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:34.552736 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b281889-54f5-4bfa-b124-e81f39ef9828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:34.553371 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b281889-54f5-4bfa-b124-e81f39ef9828 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:34.553649 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b281889-54f5-4bfa-b124-e81f39ef9828 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:34.553923 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b281889-54f5-4bfa-b124-e81f39ef9828 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:34.565025 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b281889-54f5-4bfa-b124-e81f39ef9828 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:34.566960 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b281889-54f5-4bfa-b124-e81f39ef9828 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:34.582571 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application [None req-2b281889-54f5-4bfa-b124-e81f39ef9828 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:42:34.582571 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:34.582571 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:42:34.582571 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:42:34.582571 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:42:34.582571 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:42:34.582571 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:42:34.582571 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:42:34.582571 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:42:34.582571 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:42:34.582571 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:42:34.582571 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:42:34.582571 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 21:42:34.582571 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 21:42:34.582571 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 21:42:34.582571 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 21:42:34.583557 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:42:34.583557 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:42:34.583557 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:42:34.583557 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:42:34.583557 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:42:34.583557 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:42:34.583557 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:42:34.583557 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application with Lock( Aug 18 21:42:34.583557 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:42:34.583557 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:42:34.583557 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:42:34.583557 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:42:34.583557 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:42:34.583557 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:42:34.583557 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:42:34.583557 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:42:34.583557 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 21:42:34.584451 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 21:42:34.584451 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:42:34.584451 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:42:34.584451 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 450/903] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 18 21:42:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:42:34.589289 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cb3915-5042-4bd1-a5b6-e5a3de78616f None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:34.692954 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cb3915-5042-4bd1-a5b6-e5a3de78616f None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:34.728219 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b350ff-9009-4824-8dba-349f79c13041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:34.728852 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b350ff-9009-4824-8dba-349f79c13041 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:34.729127 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b350ff-9009-4824-8dba-349f79c13041 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:34.729397 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b350ff-9009-4824-8dba-349f79c13041 None admin] PATH_INFO: `/v3/domains` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:34.730043 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b350ff-9009-4824-8dba-349f79c13041 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:34.730339 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b350ff-9009-4824-8dba-349f79c13041 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:34.731711 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b350ff-9009-4824-8dba-349f79c13041 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:34.737722 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b281889-54f5-4bfa-b124-e81f39ef9828 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:34.742502 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:34.750301 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 454/904] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 18 21:42:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:42:34.757853 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b350ff-9009-4824-8dba-349f79c13041 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:34.851614 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b281889-54f5-4bfa-b124-e81f39ef9828 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:34.893217 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38ac29f-4d25-4638-859a-b6a7ee467b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:34.893856 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38ac29f-4d25-4638-859a-b6a7ee467b3b None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:34.894145 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38ac29f-4d25-4638-859a-b6a7ee467b3b None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:34.894404 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38ac29f-4d25-4638-859a-b6a7ee467b3b None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:34.894966 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38ac29f-4d25-4638-859a-b6a7ee467b3b None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:34.896321 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38ac29f-4d25-4638-859a-b6a7ee467b3b None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:34.901788 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b350ff-9009-4824-8dba-349f79c13041 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:34.905894 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application [None req-b38ac29f-4d25-4638-859a-b6a7ee467b3b None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 18 21:42:34.905894 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:34.905894 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 21:42:34.905894 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 21:42:34.905894 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 21:42:34.905894 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 21:42:34.905894 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 21:42:34.905894 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 21:42:34.905894 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 18 21:42:34.905894 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:42:34.905894 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 21:42:34.905894 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:42:34.905894 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:34.905894 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:42:34.905894 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:42:34.905894 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:42:34.907363 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:42:34.907363 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:42:34.907363 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:42:34.907363 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:42:34.907363 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:42:34.907363 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:42:34.907363 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:42:34.907363 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 21:42:34.907363 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 21:42:34.907363 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 21:42:34.907363 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 21:42:34.907363 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:42:34.907363 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:42:34.907363 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:42:34.907363 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:42:34.907363 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:42:34.907363 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:42:34.914344 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:42:34.914344 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application with Lock( Aug 18 21:42:34.914344 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:42:34.914344 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:42:34.914344 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:42:34.914344 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:42:34.914344 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:42:34.914344 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:42:34.914344 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:42:34.914344 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:42:34.914344 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 21:42:34.914344 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 21:42:34.914344 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 18 21:42:34.914344 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:42:34.914344 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 451/905] 10.222.0.27 () {56 vars in 1132 bytes} [Thu Aug 18 21:42:34 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 21:42:34.915681 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38ac29f-4d25-4638-859a-b6a7ee467b3b None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:34.941459 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:34.944477 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bd7ad9-f3c9-490c-b8f3-930f014ac34f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:34.945075 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bd7ad9-f3c9-490c-b8f3-930f014ac34f None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:34.945404 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bd7ad9-f3c9-490c-b8f3-930f014ac34f None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:34.945727 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bd7ad9-f3c9-490c-b8f3-930f014ac34f None admin] PATH_INFO: `/v3/projects/service` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:34.953065 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bd7ad9-f3c9-490c-b8f3-930f014ac34f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:34.955348 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bd7ad9-f3c9-490c-b8f3-930f014ac34f None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:34.966805 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application [None req-01bd7ad9-f3c9-490c-b8f3-930f014ac34f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 21:42:34.966805 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:34.966805 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:42:34.966805 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:42:34.966805 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:42:34.966805 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:42:34.966805 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:42:34.966805 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:42:34.966805 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:42:34.966805 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:42:34.966805 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:42:34.966805 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:42:34.966805 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 21:42:34.966805 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 21:42:34.966805 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 21:42:34.967727 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 21:42:34.967727 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:42:34.967727 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:42:34.967727 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:42:34.967727 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:42:34.967727 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:42:34.967727 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:42:34.967727 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:42:34.967727 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application with Lock( Aug 18 21:42:34.967727 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:42:34.967727 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:42:34.967727 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:42:34.967727 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:42:34.967727 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:42:34.967727 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:42:34.967727 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:42:34.967727 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:42:34.968640 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 21:42:34.968640 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 21:42:34.968640 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 21:42:34.968640 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 21:42:34.968640 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 21:42:34.968640 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 21:42:34.968640 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 21:42:34.968640 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:42:34.968640 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 455/906] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Aug 18 21:42:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:42:34.975118 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bd7ad9-f3c9-490c-b8f3-930f014ac34f None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:35.038162 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:35.056898 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38ac29f-4d25-4638-859a-b6a7ee467b3b None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:35.083633 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bd7ad9-f3c9-490c-b8f3-930f014ac34f None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:35.095508 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3dc423-906e-4ff9-9fa7-5f48e7f08208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:35.096469 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3dc423-906e-4ff9-9fa7-5f48e7f08208 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:35.096982 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3dc423-906e-4ff9-9fa7-5f48e7f08208 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:35.097488 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3dc423-906e-4ff9-9fa7-5f48e7f08208 None admin] PATH_INFO: `/v3/services` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:35.098322 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3dc423-906e-4ff9-9fa7-5f48e7f08208 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:35.098836 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3dc423-906e-4ff9-9fa7-5f48e7f08208 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:35.100390 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3dc423-906e-4ff9-9fa7-5f48e7f08208 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:35.110559 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 452/907] 10.222.0.27 () {56 vars in 1126 bytes} [Thu Aug 18 21:42:34 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 21:42:35.111812 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3dc423-906e-4ff9-9fa7-5f48e7f08208 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:35.120031 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad643a8-81eb-4866-b2b1-46ed51470cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:35.120664 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad643a8-81eb-4866-b2b1-46ed51470cb8 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:35.120945 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad643a8-81eb-4866-b2b1-46ed51470cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:35.121222 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad643a8-81eb-4866-b2b1-46ed51470cb8 None admin] PATH_INFO: `/v3/projects` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:35.122216 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad643a8-81eb-4866-b2b1-46ed51470cb8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:35.122328 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad643a8-81eb-4866-b2b1-46ed51470cb8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:35.123804 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad643a8-81eb-4866-b2b1-46ed51470cb8 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:35.142352 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 456/908] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Aug 18 21:42:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:42:35.143239 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad643a8-81eb-4866-b2b1-46ed51470cb8 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:35.201283 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:35.221703 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3dc423-906e-4ff9-9fa7-5f48e7f08208 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:35.250213 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad643a8-81eb-4866-b2b1-46ed51470cb8 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:35.259129 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c0a0cd-5c0d-4b8e-8489-1d932beb6b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:35.260016 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c0a0cd-5c0d-4b8e-8489-1d932beb6b7c None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:35.260531 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c0a0cd-5c0d-4b8e-8489-1d932beb6b7c None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:35.261075 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c0a0cd-5c0d-4b8e-8489-1d932beb6b7c None admin] PATH_INFO: `/v3/services` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:35.261912 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c0a0cd-5c0d-4b8e-8489-1d932beb6b7c None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:35.262419 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c0a0cd-5c0d-4b8e-8489-1d932beb6b7c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:35.263990 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c0a0cd-5c0d-4b8e-8489-1d932beb6b7c None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:35.273426 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:35.275009 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 453/909] 10.222.0.27 () {56 vars in 1126 bytes} [Thu Aug 18 21:42:35 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:42:35.276004 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c0a0cd-5c0d-4b8e-8489-1d932beb6b7c None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:35.294492 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf67342d-bb1a-4db1-861f-f68156fca193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:35.295313 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf67342d-bb1a-4db1-861f-f68156fca193 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:35.295749 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf67342d-bb1a-4db1-861f-f68156fca193 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:35.296310 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf67342d-bb1a-4db1-861f-f68156fca193 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:35.297313 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf67342d-bb1a-4db1-861f-f68156fca193 None admin] RBAC: Adding query filter params (role.id=ac9ba398413d4794800e1f777b75c1df, scope.project.id=4b54801b90484d689034f838f85fc0a4, user.id=f079aa6ed5594a4982172b51b93ac54f) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:35.298297 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf67342d-bb1a-4db1-861f-f68156fca193 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:35.299868 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf67342d-bb1a-4db1-861f-f68156fca193 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:35.312764 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 457/910] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Aug 18 21:42:35 2022] GET /identity/v3/role_assignments?user.id=f079aa6ed5594a4982172b51b93ac54f&scope.project.id=4b54801b90484d689034f838f85fc0a4&role.id=ac9ba398413d4794800e1f777b75c1df => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:42:35.394208 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c0a0cd-5c0d-4b8e-8489-1d932beb6b7c None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:35.432911 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc571a8f-db1a-41a7-9d0f-0f4140e63a11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:35.433536 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc571a8f-db1a-41a7-9d0f-0f4140e63a11 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:35.433816 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc571a8f-db1a-41a7-9d0f-0f4140e63a11 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:35.434087 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc571a8f-db1a-41a7-9d0f-0f4140e63a11 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:35.434802 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc571a8f-db1a-41a7-9d0f-0f4140e63a11 None admin] RBAC: Adding query filter params (interface=public, service_id=170669fe829448d3877340b7fb5f54b0, region_id=RegionOne) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:35.435109 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc571a8f-db1a-41a7-9d0f-0f4140e63a11 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:35.436480 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc571a8f-db1a-41a7-9d0f-0f4140e63a11 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:35.443525 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 454/911] 10.222.0.27 () {56 vars in 1251 bytes} [Thu Aug 18 21:42:35 2022] GET /identity/v3/endpoints?service_id=170669fe829448d3877340b7fb5f54b0&interface=public®ion_id=RegionOne => generated 194 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:42:35.450293 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf67342d-bb1a-4db1-861f-f68156fca193 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:35.555501 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf67342d-bb1a-4db1-861f-f68156fca193 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:35.591209 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c52e88-0eb8-4efe-94c4-4e8dcec68b80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:35.591850 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c52e88-0eb8-4efe-94c4-4e8dcec68b80 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:35.592092 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c52e88-0eb8-4efe-94c4-4e8dcec68b80 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:35.592343 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c52e88-0eb8-4efe-94c4-4e8dcec68b80 None admin] PATH_INFO: `/v3/services` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:35.592976 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c52e88-0eb8-4efe-94c4-4e8dcec68b80 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:35.594433 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c52e88-0eb8-4efe-94c4-4e8dcec68b80 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:35.601006 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 458/912] 10.222.0.27 () {56 vars in 1087 bytes} [Thu Aug 18 21:42:35 2022] GET /identity/v3/services => generated 1497 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:42:35.776189 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19354562-db27-4fb6-b331-bac6ab105562 None None] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:35.776750 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19354562-db27-4fb6-b331-bac6ab105562 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:35.776750 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19354562-db27-4fb6-b331-bac6ab105562 None None] PATH_INFO: `/` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:35.778365 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 455/913] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:42:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:42:35.784267 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392ee9c1-aed6-4a89-bda9-547e51c414cb None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:35.784557 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392ee9c1-aed6-4a89-bda9-547e51c414cb None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:35.784864 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392ee9c1-aed6-4a89-bda9-547e51c414cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:35.807949 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-392ee9c1-aed6-4a89-bda9-547e51c414cb None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:42:35.809100 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-392ee9c1-aed6-4a89-bda9-547e51c414cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:42:35.855883 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:35.882241 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 459/914] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:42:35 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 21:42:36.162719 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19354562-db27-4fb6-b331-bac6ab105562 None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:36.174913 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:36.273942 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19354562-db27-4fb6-b331-bac6ab105562 None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:36.311078 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f75262d-5e63-4c3c-9650-ec37edabf2c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:36.311707 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f75262d-5e63-4c3c-9650-ec37edabf2c0 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:36.311987 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f75262d-5e63-4c3c-9650-ec37edabf2c0 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:36.312262 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f75262d-5e63-4c3c-9650-ec37edabf2c0 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:36.312878 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f75262d-5e63-4c3c-9650-ec37edabf2c0 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:36.314587 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f75262d-5e63-4c3c-9650-ec37edabf2c0 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:36.323532 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application [None req-6f75262d-5e63-4c3c-9650-ec37edabf2c0 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 18 21:42:36.323532 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:36.323532 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 21:42:36.323532 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 21:42:36.323532 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 21:42:36.323532 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 21:42:36.323532 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 21:42:36.323532 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 21:42:36.323532 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 18 21:42:36.323532 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:42:36.323532 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 21:42:36.323532 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:42:36.323532 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:36.323532 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:42:36.323532 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:42:36.323532 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:42:36.323532 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:42:36.324524 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:42:36.324524 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:42:36.324524 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:42:36.324524 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:42:36.324524 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:42:36.324524 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:42:36.324524 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 21:42:36.324524 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 21:42:36.324524 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 21:42:36.324524 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 21:42:36.324524 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:42:36.324524 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:42:36.324524 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:42:36.324524 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:42:36.324524 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:42:36.324524 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:42:36.325409 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:42:36.325409 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application with Lock( Aug 18 21:42:36.325409 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:42:36.325409 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:42:36.325409 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:42:36.325409 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:42:36.325409 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:42:36.325409 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:42:36.325409 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:42:36.325409 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:42:36.325409 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 21:42:36.325409 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 21:42:36.325409 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 18 21:42:36.325409 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:42:36.325409 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 456/915] 10.222.0.27 () {56 vars in 1114 bytes} [Thu Aug 18 21:42:36 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:42:36.331243 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392ee9c1-aed6-4a89-bda9-547e51c414cb None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:36.338015 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6dc7b5-30cf-4d67-9339-17881b74eccf None None] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:36.338294 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6dc7b5-30cf-4d67-9339-17881b74eccf None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:36.338569 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6dc7b5-30cf-4d67-9339-17881b74eccf None None] PATH_INFO: `/` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:36.340097 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 457/916] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:42:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:42:36.345728 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362320e1-cce6-41e3-b0c7-48cc924839be None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:36.345990 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362320e1-cce6-41e3-b0c7-48cc924839be None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:36.346267 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362320e1-cce6-41e3-b0c7-48cc924839be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:36.365526 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-362320e1-cce6-41e3-b0c7-48cc924839be None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:42:36.366710 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-362320e1-cce6-41e3-b0c7-48cc924839be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:42:36.448828 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 458/917] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:42:36 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 21:42:36.462870 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392ee9c1-aed6-4a89-bda9-547e51c414cb None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:36.500447 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e022211-507d-4edf-a680-2d74dc7a77f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:36.501490 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e022211-507d-4edf-a680-2d74dc7a77f2 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:36.502019 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e022211-507d-4edf-a680-2d74dc7a77f2 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:36.502304 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e022211-507d-4edf-a680-2d74dc7a77f2 None admin] PATH_INFO: `/v3/services` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:36.502961 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e022211-507d-4edf-a680-2d74dc7a77f2 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:36.503265 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e022211-507d-4edf-a680-2d74dc7a77f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:36.504701 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e022211-507d-4edf-a680-2d74dc7a77f2 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:36.510691 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 460/918] 10.222.0.27 () {56 vars in 1114 bytes} [Thu Aug 18 21:42:36 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:42:36.515963 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362320e1-cce6-41e3-b0c7-48cc924839be None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:36.519783 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:36.626796 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362320e1-cce6-41e3-b0c7-48cc924839be None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:36.663630 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd57d56-e61e-4414-b006-261891a638ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:36.664563 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd57d56-e61e-4414-b006-261891a638ef None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:36.665051 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd57d56-e61e-4414-b006-261891a638ef None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:36.665518 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd57d56-e61e-4414-b006-261891a638ef None admin] PATH_INFO: `/v3/services` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:36.666338 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd57d56-e61e-4414-b006-261891a638ef None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:36.666821 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd57d56-e61e-4414-b006-261891a638ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:36.668361 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd57d56-e61e-4414-b006-261891a638ef None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:36.674764 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 459/919] 10.222.0.27 () {56 vars in 1114 bytes} [Thu Aug 18 21:42:36 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:42:36.681953 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e022211-507d-4edf-a680-2d74dc7a77f2 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:36.731971 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:36.750081 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd57d56-e61e-4414-b006-261891a638ef None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:36.808055 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e022211-507d-4edf-a680-2d74dc7a77f2 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:36.824512 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:36.854957 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04640c7-8462-4b1a-9457-c2f775e28bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:36.855950 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04640c7-8462-4b1a-9457-c2f775e28bcb None admin] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:36.856517 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04640c7-8462-4b1a-9457-c2f775e28bcb None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:36.856837 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04640c7-8462-4b1a-9457-c2f775e28bcb None admin] PATH_INFO: `/v3/endpoints` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:36.858156 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04640c7-8462-4b1a-9457-c2f775e28bcb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:36.859800 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04640c7-8462-4b1a-9457-c2f775e28bcb None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:36.864718 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd57d56-e61e-4414-b006-261891a638ef None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:36.903696 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db11652-8a1c-405e-b919-5a0e03f3bea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:36.904419 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db11652-8a1c-405e-b919-5a0e03f3bea5 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:36.904788 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db11652-8a1c-405e-b919-5a0e03f3bea5 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:36.905151 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db11652-8a1c-405e-b919-5a0e03f3bea5 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:36.905871 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db11652-8a1c-405e-b919-5a0e03f3bea5 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:36.907488 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db11652-8a1c-405e-b919-5a0e03f3bea5 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:36.916534 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application [None req-7db11652-8a1c-405e-b919-5a0e03f3bea5 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 18 21:42:36.916534 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:36.916534 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 21:42:36.916534 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 21:42:36.916534 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 21:42:36.916534 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 21:42:36.916534 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 21:42:36.916534 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 21:42:36.916534 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 18 21:42:36.916534 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:42:36.916534 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 21:42:36.916534 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:42:36.916534 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:36.916534 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:42:36.916534 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:42:36.916534 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:42:36.916534 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:42:36.917623 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:42:36.917623 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:42:36.917623 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:42:36.917623 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:42:36.917623 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:42:36.917623 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:42:36.917623 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 21:42:36.917623 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 21:42:36.917623 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 21:42:36.917623 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 21:42:36.917623 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:42:36.917623 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:42:36.917623 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:42:36.917623 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:42:36.917623 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:42:36.917623 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:42:36.918501 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:42:36.918501 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application with Lock( Aug 18 21:42:36.918501 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:42:36.918501 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:42:36.918501 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:42:36.918501 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:42:36.918501 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:42:36.918501 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:42:36.918501 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:42:36.918501 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:42:36.918501 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 21:42:36.918501 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 21:42:36.918501 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 18 21:42:36.918501 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:42:36.922536 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 460/920] 10.222.0.27 () {56 vars in 1126 bytes} [Thu Aug 18 21:42:36 2022] GET /identity/v3/services/object-store => generated 93 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:42:36.923473 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db11652-8a1c-405e-b919-5a0e03f3bea5 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:36.951565 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 461/921] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 18 21:42:36 2022] POST /identity/v3/endpoints => generated 346 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:42:37.051772 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db11652-8a1c-405e-b919-5a0e03f3bea5 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:37.086645 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:37.100791 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf108b4-b3bf-49fc-81d2-9fb6ebaa36fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:37.101835 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf108b4-b3bf-49fc-81d2-9fb6ebaa36fb None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:37.102322 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf108b4-b3bf-49fc-81d2-9fb6ebaa36fb None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:37.102810 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf108b4-b3bf-49fc-81d2-9fb6ebaa36fb None admin] PATH_INFO: `/v3/services` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:37.103652 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf108b4-b3bf-49fc-81d2-9fb6ebaa36fb None admin] RBAC: Adding query filter params (name=object-store) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:37.103956 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf108b4-b3bf-49fc-81d2-9fb6ebaa36fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:37.105348 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf108b4-b3bf-49fc-81d2-9fb6ebaa36fb None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:37.112128 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 461/922] 10.222.0.27 () {56 vars in 1122 bytes} [Thu Aug 18 21:42:36 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 21:42:37.117922 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04640c7-8462-4b1a-9457-c2f775e28bcb None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:37.229680 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:37.233910 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04640c7-8462-4b1a-9457-c2f775e28bcb None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:37.272173 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2420f1fe-87c7-466f-b5d8-7c9970dce1e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:37.272832 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2420f1fe-87c7-466f-b5d8-7c9970dce1e9 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:37.273121 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2420f1fe-87c7-466f-b5d8-7c9970dce1e9 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:37.273405 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2420f1fe-87c7-466f-b5d8-7c9970dce1e9 None admin] PATH_INFO: `/v3/services` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:37.274050 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2420f1fe-87c7-466f-b5d8-7c9970dce1e9 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:37.274359 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2420f1fe-87c7-466f-b5d8-7c9970dce1e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:37.275762 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2420f1fe-87c7-466f-b5d8-7c9970dce1e9 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:37.281303 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 462/923] 10.222.0.27 () {56 vars in 1122 bytes} [Thu Aug 18 21:42:37 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 21:42:37.288994 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf108b4-b3bf-49fc-81d2-9fb6ebaa36fb None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:37.398107 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf108b4-b3bf-49fc-81d2-9fb6ebaa36fb None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:37.399064 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3202c4f8-921b-4a59-aef4-c042cffeaa70 None None] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:37.399362 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3202c4f8-921b-4a59-aef4-c042cffeaa70 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:37.399644 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3202c4f8-921b-4a59-aef4-c042cffeaa70 None None] PATH_INFO: `/` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:37.401438 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 463/924] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:42:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:42:37.406627 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead28a1c-6f38-482e-9455-b581608e9edc None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:37.406949 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead28a1c-6f38-482e-9455-b581608e9edc None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:37.407323 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead28a1c-6f38-482e-9455-b581608e9edc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:37.427832 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-ead28a1c-6f38-482e-9455-b581608e9edc None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:42:37.429081 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-ead28a1c-6f38-482e-9455-b581608e9edc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:42:37.432624 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6412979-18b2-4d42-9cd4-d035d2bb0bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:37.433250 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6412979-18b2-4d42-9cd4-d035d2bb0bed None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:37.433528 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6412979-18b2-4d42-9cd4-d035d2bb0bed None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:37.433795 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6412979-18b2-4d42-9cd4-d035d2bb0bed None admin] PATH_INFO: `/v3/endpoints` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:37.434483 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6412979-18b2-4d42-9cd4-d035d2bb0bed None admin] RBAC: Adding query filter params (interface=public, service_id=f3605f06334845c6af7919b5886e70dc, region_id=RegionOne) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:37.434784 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6412979-18b2-4d42-9cd4-d035d2bb0bed None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:37.436134 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6412979-18b2-4d42-9cd4-d035d2bb0bed None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:37.442851 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 462/925] 10.222.0.27 () {56 vars in 1251 bytes} [Thu Aug 18 21:42:37 2022] GET /identity/v3/endpoints?service_id=f3605f06334845c6af7919b5886e70dc&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:42:37.448327 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6412979-18b2-4d42-9cd4-d035d2bb0bed None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:37.506189 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:37.516818 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 464/926] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:42:37 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 21:42:37.552827 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6412979-18b2-4d42-9cd4-d035d2bb0bed None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:37.587865 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609b2fd9-077c-4726-921e-3e9924c42f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:37.588472 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609b2fd9-077c-4726-921e-3e9924c42f04 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:37.588811 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609b2fd9-077c-4726-921e-3e9924c42f04 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:37.589043 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609b2fd9-077c-4726-921e-3e9924c42f04 None admin] PATH_INFO: `/v3/services` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:37.589167 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710b1090-58d5-400f-bf39-91a15c9a02c5 None None] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:37.589411 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710b1090-58d5-400f-bf39-91a15c9a02c5 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:37.589639 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609b2fd9-077c-4726-921e-3e9924c42f04 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:37.589741 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710b1090-58d5-400f-bf39-91a15c9a02c5 None None] PATH_INFO: `/` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:37.590981 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609b2fd9-077c-4726-921e-3e9924c42f04 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:37.592260 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 465/927] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:42:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 21:42:37.596984 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bdbc8c-0c70-45f8-8b69-96a80b53b85e None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:37.597267 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bdbc8c-0c70-45f8-8b69-96a80b53b85e None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:37.597539 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bdbc8c-0c70-45f8-8b69-96a80b53b85e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:37.598150 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 463/928] 10.222.0.27 () {56 vars in 1087 bytes} [Thu Aug 18 21:42:37 2022] GET /identity/v3/services => generated 1497 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 21:42:37.617928 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-67bdbc8c-0c70-45f8-8b69-96a80b53b85e None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:42:37.619223 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-67bdbc8c-0c70-45f8-8b69-96a80b53b85e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:42:37.704848 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 466/929] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:42:37 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 21:42:37.818674 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609b2fd9-077c-4726-921e-3e9924c42f04 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:37.926341 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609b2fd9-077c-4726-921e-3e9924c42f04 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:37.945906 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:37.963968 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa33151f-c08c-4cd3-8c29-3d25b7da19f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:37.964841 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa33151f-c08c-4cd3-8c29-3d25b7da19f4 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:37.965290 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa33151f-c08c-4cd3-8c29-3d25b7da19f4 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:37.965713 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa33151f-c08c-4cd3-8c29-3d25b7da19f4 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:37.968965 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bdbc8c-0c70-45f8-8b69-96a80b53b85e None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:37.984090 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa33151f-c08c-4cd3-8c29-3d25b7da19f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:42:37.989820 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application [None req-aa33151f-c08c-4cd3-8c29-3d25b7da19f4 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 18 21:42:37.989820 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:37.989820 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:42:37.989820 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:42:37.989820 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:42:37.989820 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:42:37.989820 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:42:37.989820 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:42:37.989820 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:42:37.989820 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:42:37.989820 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:42:37.989820 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:42:37.989820 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:42:37.989820 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:42:37.989820 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:42:37.989820 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:42:37.990763 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:42:37.990763 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:42:37.990763 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:42:37.990763 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:42:37.990763 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:42:37.990763 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:42:37.990763 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:42:37.990763 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:42:37.990763 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:42:37.990763 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:42:37.990763 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:42:37.990763 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application with Lock( Aug 18 21:42:37.990763 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:42:37.990763 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:42:37.990763 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:42:37.990763 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:42:37.991603 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:42:37.991603 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:42:37.991603 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:42:37.991603 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:42:37.991603 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:42:37.991603 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:42:37.991603 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:42:37.991603 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:42:37.991603 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:42:37.991603 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:42:37.991603 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 18 21:42:37.991603 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:42:37.991603 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 464/930] 10.222.0.27 () {56 vars in 1120 bytes} [Thu Aug 18 21:42:37 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:42:37.997532 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa33151f-c08c-4cd3-8c29-3d25b7da19f4 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:38.007524 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:38.103659 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bdbc8c-0c70-45f8-8b69-96a80b53b85e None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:38.122155 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa33151f-c08c-4cd3-8c29-3d25b7da19f4 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:38.140618 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b079e2d6-54bc-4512-9b8e-36e19e8f2526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:38.142679 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b079e2d6-54bc-4512-9b8e-36e19e8f2526 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:38.143213 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b079e2d6-54bc-4512-9b8e-36e19e8f2526 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:38.143695 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b079e2d6-54bc-4512-9b8e-36e19e8f2526 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:38.144514 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b079e2d6-54bc-4512-9b8e-36e19e8f2526 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:38.146203 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b079e2d6-54bc-4512-9b8e-36e19e8f2526 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:38.156264 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application [None req-b079e2d6-54bc-4512-9b8e-36e19e8f2526 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 18 21:42:38.156264 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:38.156264 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 21:42:38.156264 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 21:42:38.156264 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 21:42:38.156264 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 21:42:38.156264 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 21:42:38.156264 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 21:42:38.156264 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 18 21:42:38.156264 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:42:38.156264 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 21:42:38.156264 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:42:38.156264 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:38.156264 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:42:38.156264 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:42:38.156264 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:42:38.157824 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:42:38.157824 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:42:38.157824 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:42:38.157824 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:42:38.157824 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:42:38.157824 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:42:38.157824 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:42:38.157824 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 21:42:38.157824 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 21:42:38.157824 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 21:42:38.157824 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 21:42:38.157824 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:42:38.157824 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:42:38.157824 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:42:38.157824 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:42:38.157824 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:42:38.157824 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:42:38.158841 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:42:38.158841 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application with Lock( Aug 18 21:42:38.158841 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:42:38.158841 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:42:38.158841 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:42:38.158841 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:42:38.158841 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:42:38.158841 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:42:38.158841 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:42:38.158841 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:42:38.158841 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 21:42:38.158841 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 21:42:38.158841 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 18 21:42:38.158841 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:42:38.161594 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 467/931] 10.222.0.27 () {56 vars in 1132 bytes} [Thu Aug 18 21:42:37 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 21:42:38.167080 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b079e2d6-54bc-4512-9b8e-36e19e8f2526 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:38.169140 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f20b008-35d5-4533-8d75-5878f9fd5b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:38.169788 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f20b008-35d5-4533-8d75-5878f9fd5b1c None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:38.175847 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f20b008-35d5-4533-8d75-5878f9fd5b1c None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:38.175847 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f20b008-35d5-4533-8d75-5878f9fd5b1c None admin] PATH_INFO: `/v3/roles` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:38.175847 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f20b008-35d5-4533-8d75-5878f9fd5b1c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:38.175847 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f20b008-35d5-4533-8d75-5878f9fd5b1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:38.175847 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f20b008-35d5-4533-8d75-5878f9fd5b1c None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:38.189140 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 465/932] 10.222.0.27 () {56 vars in 1115 bytes} [Thu Aug 18 21:42:37 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:42:38.191446 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f20b008-35d5-4533-8d75-5878f9fd5b1c None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:38.241073 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:38.264083 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:38.282613 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b079e2d6-54bc-4512-9b8e-36e19e8f2526 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:38.309981 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f20b008-35d5-4533-8d75-5878f9fd5b1c None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:38.323396 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dff9883-98fb-4fa1-8903-007ac2381616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:38.323916 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dff9883-98fb-4fa1-8903-007ac2381616 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:38.324197 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dff9883-98fb-4fa1-8903-007ac2381616 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:38.324469 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dff9883-98fb-4fa1-8903-007ac2381616 None admin] PATH_INFO: `/v3/services` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:38.325129 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dff9883-98fb-4fa1-8903-007ac2381616 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:38.325428 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dff9883-98fb-4fa1-8903-007ac2381616 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:38.326794 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dff9883-98fb-4fa1-8903-007ac2381616 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:38.332152 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 468/933] 10.222.0.27 () {56 vars in 1126 bytes} [Thu Aug 18 21:42:38 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 21:42:38.337707 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dff9883-98fb-4fa1-8903-007ac2381616 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:38.352759 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633834f3-6117-45d1-9059-ce8ec555d4ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:38.353761 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633834f3-6117-45d1-9059-ce8ec555d4ee None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:38.354295 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633834f3-6117-45d1-9059-ce8ec555d4ee None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:38.354770 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633834f3-6117-45d1-9059-ce8ec555d4ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:38.367708 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633834f3-6117-45d1-9059-ce8ec555d4ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:38.369534 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633834f3-6117-45d1-9059-ce8ec555d4ee None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:38.386458 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application [None req-633834f3-6117-45d1-9059-ce8ec555d4ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:42:38.386458 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:38.386458 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:42:38.386458 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:42:38.386458 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:42:38.386458 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:42:38.386458 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:42:38.386458 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:42:38.386458 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:42:38.386458 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:42:38.386458 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:42:38.386458 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:42:38.386458 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 21:42:38.386458 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 21:42:38.386458 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 21:42:38.386458 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 21:42:38.387419 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:42:38.387419 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:42:38.387419 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:42:38.387419 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:42:38.387419 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:42:38.387419 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:42:38.387419 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:42:38.387419 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application with Lock( Aug 18 21:42:38.387419 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:42:38.387419 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:42:38.387419 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:42:38.387419 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:42:38.387419 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:42:38.387419 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:42:38.387419 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:42:38.387419 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:42:38.387419 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 21:42:38.388395 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 21:42:38.388395 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:42:38.388395 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:42:38.396770 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 466/934] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 18 21:42:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:42:38.398047 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633834f3-6117-45d1-9059-ce8ec555d4ee None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:38.443232 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dff9883-98fb-4fa1-8903-007ac2381616 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:38.478650 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f96b44e-4154-4c14-92c1-331102d84109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:38.479290 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f96b44e-4154-4c14-92c1-331102d84109 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:38.479568 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f96b44e-4154-4c14-92c1-331102d84109 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:38.479840 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f96b44e-4154-4c14-92c1-331102d84109 None admin] PATH_INFO: `/v3/services` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:38.480472 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f96b44e-4154-4c14-92c1-331102d84109 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:38.480806 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f96b44e-4154-4c14-92c1-331102d84109 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:38.482167 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f96b44e-4154-4c14-92c1-331102d84109 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:38.492618 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 469/935] 10.222.0.27 () {56 vars in 1126 bytes} [Thu Aug 18 21:42:38 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 21:42:38.493795 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f96b44e-4154-4c14-92c1-331102d84109 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:38.504486 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:38.510770 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:38.514424 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633834f3-6117-45d1-9059-ce8ec555d4ee None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:38.554061 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431d045d-f9e3-41a4-ac8e-f4825152f4f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:38.555010 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431d045d-f9e3-41a4-ac8e-f4825152f4f8 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:38.555551 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431d045d-f9e3-41a4-ac8e-f4825152f4f8 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:38.556033 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431d045d-f9e3-41a4-ac8e-f4825152f4f8 None admin] PATH_INFO: `/v3/domains` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:38.556928 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431d045d-f9e3-41a4-ac8e-f4825152f4f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:38.557411 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431d045d-f9e3-41a4-ac8e-f4825152f4f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:38.558962 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431d045d-f9e3-41a4-ac8e-f4825152f4f8 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:38.577015 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 467/936] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 18 21:42:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:42:38.578234 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431d045d-f9e3-41a4-ac8e-f4825152f4f8 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:38.600493 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f96b44e-4154-4c14-92c1-331102d84109 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:38.637666 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280f5314-de91-4da4-a787-b88bbfadbaa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:38.638304 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280f5314-de91-4da4-a787-b88bbfadbaa9 None admin] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:38.638653 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280f5314-de91-4da4-a787-b88bbfadbaa9 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:38.639051 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280f5314-de91-4da4-a787-b88bbfadbaa9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:38.639774 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280f5314-de91-4da4-a787-b88bbfadbaa9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:38.642113 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280f5314-de91-4da4-a787-b88bbfadbaa9 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:38.699603 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431d045d-f9e3-41a4-ac8e-f4825152f4f8 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:38.737521 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 470/937] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 18 21:42:38 2022] POST /identity/v3/endpoints => generated 347 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:42:38.748881 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a83565-a29b-4705-99af-031bc9083450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:38.749912 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a83565-a29b-4705-99af-031bc9083450 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:38.750368 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a83565-a29b-4705-99af-031bc9083450 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:38.751440 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a83565-a29b-4705-99af-031bc9083450 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:38.760942 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a83565-a29b-4705-99af-031bc9083450 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:38.762791 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a83565-a29b-4705-99af-031bc9083450 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:38.777207 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application [None req-b6a83565-a29b-4705-99af-031bc9083450 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 18 21:42:38.777207 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:38.777207 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:42:38.777207 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:42:38.777207 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:42:38.777207 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:42:38.777207 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:42:38.777207 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:42:38.777207 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:42:38.777207 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:42:38.777207 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:42:38.777207 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:42:38.777207 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 21:42:38.777207 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 21:42:38.777207 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 21:42:38.777207 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 21:42:38.778214 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:42:38.778214 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:42:38.778214 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 21:42:38.778214 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 21:42:38.778214 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 21:42:38.778214 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 21:42:38.778214 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:42:38.778214 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:42:38.778214 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:42:38.778214 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:42:38.778214 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:42:38.778214 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application with Lock( Aug 18 21:42:38.778214 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:42:38.778214 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:42:38.778214 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:42:38.778214 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:42:38.778214 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:42:38.778214 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:42:38.779173 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:42:38.779173 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:42:38.779173 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 21:42:38.779173 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 21:42:38.779173 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 21:42:38.779173 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 21:42:38.779173 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 21:42:38.779173 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 21:42:38.779173 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 18 21:42:38.779173 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:42:38.781670 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 468/938] 10.222.0.27 () {56 vars in 1117 bytes} [Thu Aug 18 21:42:38 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:42:38.789741 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280f5314-de91-4da4-a787-b88bbfadbaa9 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:38.870858 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:38.909584 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280f5314-de91-4da4-a787-b88bbfadbaa9 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:38.944576 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6c64fb-b812-4be0-92f3-d98584d78b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:38.945436 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6c64fb-b812-4be0-92f3-d98584d78b98 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:38.945941 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6c64fb-b812-4be0-92f3-d98584d78b98 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:38.946420 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6c64fb-b812-4be0-92f3-d98584d78b98 None admin] PATH_INFO: `/v3/users` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:38.947339 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6c64fb-b812-4be0-92f3-d98584d78b98 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:38.948071 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6c64fb-b812-4be0-92f3-d98584d78b98 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:38.949700 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6c64fb-b812-4be0-92f3-d98584d78b98 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:38.968684 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 471/939] 10.222.0.27 () {56 vars in 1149 bytes} [Thu Aug 18 21:42:38 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:42:38.978293 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a83565-a29b-4705-99af-031bc9083450 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:38.992064 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:39.010845 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cf72c3-5d34-4595-9911-1bd3d1207690 None None] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:39.010845 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cf72c3-5d34-4595-9911-1bd3d1207690 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:39.010845 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cf72c3-5d34-4595-9911-1bd3d1207690 None None] PATH_INFO: `/` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:39.010845 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 472/940] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:42:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:42:39.011608 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3485952e-3b4e-4f60-9afb-6022c993964e None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:39.011845 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3485952e-3b4e-4f60-9afb-6022c993964e None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:39.012124 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3485952e-3b4e-4f60-9afb-6022c993964e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:39.037767 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-3485952e-3b4e-4f60-9afb-6022c993964e None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:42:39.039326 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-3485952e-3b4e-4f60-9afb-6022c993964e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:42:39.109334 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a83565-a29b-4705-99af-031bc9083450 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:39.127887 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 473/941] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:42:39 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 21:42:39.158945 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83015108-0dda-4508-ae1a-4eb0094ed0a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:39.159577 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83015108-0dda-4508-ae1a-4eb0094ed0a1 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:39.159853 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83015108-0dda-4508-ae1a-4eb0094ed0a1 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:39.160122 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83015108-0dda-4508-ae1a-4eb0094ed0a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:39.171438 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83015108-0dda-4508-ae1a-4eb0094ed0a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:39.173598 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83015108-0dda-4508-ae1a-4eb0094ed0a1 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:39.188012 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application [None req-83015108-0dda-4508-ae1a-4eb0094ed0a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:42:39.188012 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:39.188012 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:42:39.188012 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:42:39.188012 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:42:39.188012 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:42:39.188012 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:42:39.188012 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:42:39.188012 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:42:39.188012 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:42:39.188012 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:42:39.188012 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:42:39.188012 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 21:42:39.188012 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 21:42:39.188012 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 21:42:39.188012 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 21:42:39.189467 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:42:39.189467 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:42:39.189467 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:42:39.189467 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:42:39.189467 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:42:39.189467 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:42:39.189467 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:42:39.189467 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application with Lock( Aug 18 21:42:39.189467 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:42:39.189467 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:42:39.189467 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:42:39.189467 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:42:39.189467 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:42:39.189467 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:42:39.189467 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:42:39.189467 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:42:39.189467 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 21:42:39.190420 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 21:42:39.190420 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:42:39.190420 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:42:39.190420 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 469/942] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 18 21:42:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:42:39.197096 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3485952e-3b4e-4f60-9afb-6022c993964e None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:39.262795 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:39.312120 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3485952e-3b4e-4f60-9afb-6022c993964e None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:39.349434 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7752620-83e4-4f1c-90d0-3b8227715219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:39.350446 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7752620-83e4-4f1c-90d0-3b8227715219 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:39.350932 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7752620-83e4-4f1c-90d0-3b8227715219 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:39.351459 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7752620-83e4-4f1c-90d0-3b8227715219 None admin] PATH_INFO: `/v3/domains` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:39.352328 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7752620-83e4-4f1c-90d0-3b8227715219 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:39.352895 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7752620-83e4-4f1c-90d0-3b8227715219 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:39.354488 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7752620-83e4-4f1c-90d0-3b8227715219 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:39.367786 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 474/943] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 18 21:42:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:42:39.377685 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83015108-0dda-4508-ae1a-4eb0094ed0a1 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:39.446656 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:39.463722 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7752620-83e4-4f1c-90d0-3b8227715219 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:39.495097 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83015108-0dda-4508-ae1a-4eb0094ed0a1 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:39.540478 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e5b66e-67a4-495b-82ae-fe1a1437e7ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:39.541055 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e5b66e-67a4-495b-82ae-fe1a1437e7ca None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:39.541336 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e5b66e-67a4-495b-82ae-fe1a1437e7ca None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:39.541605 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e5b66e-67a4-495b-82ae-fe1a1437e7ca None admin] PATH_INFO: `/v3/projects/service` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:39.548973 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e5b66e-67a4-495b-82ae-fe1a1437e7ca None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:39.550673 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e5b66e-67a4-495b-82ae-fe1a1437e7ca None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:39.562660 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application [None req-f5e5b66e-67a4-495b-82ae-fe1a1437e7ca None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 21:42:39.562660 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:39.562660 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:42:39.562660 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:42:39.562660 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:42:39.562660 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:42:39.562660 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:42:39.562660 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:42:39.562660 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:42:39.562660 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:42:39.562660 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:42:39.562660 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:42:39.562660 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 21:42:39.562660 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 21:42:39.562660 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 21:42:39.563609 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 21:42:39.563609 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:42:39.563609 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:42:39.563609 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:42:39.563609 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:42:39.563609 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:42:39.563609 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:42:39.563609 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:42:39.563609 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application with Lock( Aug 18 21:42:39.563609 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:42:39.563609 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:42:39.563609 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:42:39.563609 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:42:39.563609 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:42:39.563609 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:42:39.563609 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:42:39.563609 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:42:39.564491 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 21:42:39.564491 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 21:42:39.564491 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 21:42:39.564491 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 21:42:39.564491 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 21:42:39.564491 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 21:42:39.564491 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 21:42:39.564491 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:42:39.571433 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 470/944] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Aug 18 21:42:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:42:39.572981 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e5b66e-67a4-495b-82ae-fe1a1437e7ca None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:39.581912 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7752620-83e4-4f1c-90d0-3b8227715219 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:39.600353 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:39.618470 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d1cb55-ac99-43ff-afac-48ad3d0738ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:39.619675 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d1cb55-ac99-43ff-afac-48ad3d0738ec None admin] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:39.620207 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d1cb55-ac99-43ff-afac-48ad3d0738ec None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:39.620690 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d1cb55-ac99-43ff-afac-48ad3d0738ec None admin] PATH_INFO: `/v3/projects` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:39.621809 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d1cb55-ac99-43ff-afac-48ad3d0738ec None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:39.624009 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d1cb55-ac99-43ff-afac-48ad3d0738ec None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:39.628304 dv-cinder-853678-3-smb devstack@keystone.service[88097]: WARNING keystone.server.flask.common [None req-46d1cb55-ac99-43ff-afac-48ad3d0738ec None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 18 21:42:39.679319 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e5b66e-67a4-495b-82ae-fe1a1437e7ca None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:39.684390 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.sql.core [None req-46d1cb55-ac99-43ff-afac-48ad3d0738ec None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 18 21:42:39.684390 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 18 21:42:39.684390 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [parameters: {'id': '8a8d210f5b93454785d8a071a1b517fc', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 18 21:42:39.684390 dv-cinder-853678-3-smb devstack@keystone.service[88097]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88097) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 18 21:42:39.700874 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:39.702117 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application [None req-46d1cb55-ac99-43ff-afac-48ad3d0738ec None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 8a8d210f5b93454785d8a071a1b517fc.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 8a8d210f5b93454785d8a071a1b517fc. Aug 18 21:42:39.702117 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:39.702117 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 18 21:42:39.702117 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 18 21:42:39.702117 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 18 21:42:39.702117 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 18 21:42:39.702117 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 18 21:42:39.702117 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application result = self._query(query) Aug 18 21:42:39.702117 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 18 21:42:39.702117 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application conn.query(q) Aug 18 21:42:39.702117 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 18 21:42:39.702117 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 18 21:42:39.702117 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 18 21:42:39.703061 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application result.read() Aug 18 21:42:39.703061 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 18 21:42:39.703061 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 18 21:42:39.703061 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 18 21:42:39.703061 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 18 21:42:39.703061 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 18 21:42:39.703061 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 18 21:42:39.703061 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 18 21:42:39.703061 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 18 21:42:39.703061 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 18 21:42:39.703061 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:42:39.703061 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 18 21:42:39.703061 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:42:39.703061 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:39.703061 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 18 21:42:39.703061 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 18 21:42:39.703061 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 18 21:42:39.703061 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 18 21:42:39.704182 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 18 21:42:39.704182 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application next(self.gen) Aug 18 21:42:39.704182 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 18 21:42:39.704182 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application yield resource Aug 18 21:42:39.704182 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 18 21:42:39.704182 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application next(self.gen) Aug 18 21:42:39.704182 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 18 21:42:39.704182 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application self.session.rollback() Aug 18 21:42:39.704182 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 18 21:42:39.704182 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application self.force_reraise() Aug 18 21:42:39.704182 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 18 21:42:39.704182 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise self.value Aug 18 21:42:39.704182 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 18 21:42:39.704182 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 18 21:42:39.704182 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 18 21:42:39.704182 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application session.commit() Aug 18 21:42:39.704182 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 18 21:42:39.705262 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 18 21:42:39.705262 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 18 21:42:39.705262 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application self._prepare_impl() Aug 18 21:42:39.705262 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 18 21:42:39.705262 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application self.session.flush() Aug 18 21:42:39.705262 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 18 21:42:39.705262 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application self._flush(objects) Aug 18 21:42:39.705262 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 18 21:42:39.705262 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 18 21:42:39.705262 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 18 21:42:39.705262 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application compat.raise_( Aug 18 21:42:39.705262 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 18 21:42:39.705262 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception Aug 18 21:42:39.705262 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 18 21:42:39.705262 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application flush_context.execute() Aug 18 21:42:39.705262 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 18 21:42:39.705262 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application rec.execute(self) Aug 18 21:42:39.706149 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 18 21:42:39.706149 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 18 21:42:39.706149 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 18 21:42:39.706149 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 18 21:42:39.706149 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 18 21:42:39.706149 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 18 21:42:39.706149 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 18 21:42:39.706149 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 18 21:42:39.706149 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 18 21:42:39.706149 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 18 21:42:39.706149 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 18 21:42:39.706149 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 18 21:42:39.706149 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 18 21:42:39.706149 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 18 21:42:39.706149 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 18 21:42:39.706952 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 18 21:42:39.706952 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 18 21:42:39.706952 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception Aug 18 21:42:39.706952 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 18 21:42:39.706952 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 18 21:42:39.706952 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 18 21:42:39.706952 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 18 21:42:39.706952 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 18 21:42:39.706952 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application result = self._query(query) Aug 18 21:42:39.706952 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 18 21:42:39.706952 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application conn.query(q) Aug 18 21:42:39.706952 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 18 21:42:39.706952 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 18 21:42:39.706952 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 18 21:42:39.706952 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application result.read() Aug 18 21:42:39.706952 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 18 21:42:39.706952 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 18 21:42:39.707830 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 18 21:42:39.707830 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 18 21:42:39.707830 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 18 21:42:39.707830 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 18 21:42:39.707830 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 18 21:42:39.707830 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 18 21:42:39.707830 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 18 21:42:39.707830 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 18 21:42:39.707830 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application [parameters: {'id': '8a8d210f5b93454785d8a071a1b517fc', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 18 21:42:39.707830 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 18 21:42:39.707830 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:42:39.707830 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 21:42:39.707830 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:42:39.707830 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:39.707830 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 18 21:42:39.708635 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 18 21:42:39.708635 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 18 21:42:39.708635 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 18 21:42:39.708635 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 18 21:42:39.708635 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:42:39.708635 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 21:42:39.708635 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:42:39.708635 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:39.708635 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:42:39.708635 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:42:39.708635 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:42:39.708635 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:42:39.708635 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:42:39.708635 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:42:39.708635 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:42:39.708635 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:42:39.708635 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:42:39.709567 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:42:39.709567 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 18 21:42:39.709567 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 18 21:42:39.709567 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:42:39.709567 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:42:39.709567 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 18 21:42:39.709567 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 18 21:42:39.709567 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 8a8d210f5b93454785d8a071a1b517fc. Aug 18 21:42:39.709567 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:42:39.709567 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 475/945] 10.222.0.27 () {60 vars in 1140 bytes} [Thu Aug 18 21:42:39 2022] POST /identity/v3/projects => generated 262 bytes in 240 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:42:39.709567 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f75481-8455-47f4-b8f2-b7db8c04b88c None None] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:39.709567 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f75481-8455-47f4-b8f2-b7db8c04b88c None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:39.710419 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f75481-8455-47f4-b8f2-b7db8c04b88c None None] PATH_INFO: `/` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:39.712761 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 476/946] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:42:39 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:42:39.714267 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f75481-8455-47f4-b8f2-b7db8c04b88c None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:39.725760 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc2fd56-d871-4da9-b20a-5bc9d710d5be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:39.726954 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc2fd56-d871-4da9-b20a-5bc9d710d5be None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:39.727435 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc2fd56-d871-4da9-b20a-5bc9d710d5be None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:39.728168 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc2fd56-d871-4da9-b20a-5bc9d710d5be None admin] PATH_INFO: `/v3/projects` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:39.729079 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc2fd56-d871-4da9-b20a-5bc9d710d5be None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:39.729548 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc2fd56-d871-4da9-b20a-5bc9d710d5be None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:39.731210 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc2fd56-d871-4da9-b20a-5bc9d710d5be None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:39.745688 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 471/947] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Aug 18 21:42:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:42:39.747062 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d662ba47-72f0-4651-9d27-2c7a2c9f57fd None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:39.747495 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d662ba47-72f0-4651-9d27-2c7a2c9f57fd None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:39.747933 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d662ba47-72f0-4651-9d27-2c7a2c9f57fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:39.768725 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-d662ba47-72f0-4651-9d27-2c7a2c9f57fd None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:42:39.770397 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-d662ba47-72f0-4651-9d27-2c7a2c9f57fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:42:39.828418 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f75481-8455-47f4-b8f2-b7db8c04b88c None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:39.851358 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 472/948] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:42:39 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 21:42:39.852184 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d662ba47-72f0-4651-9d27-2c7a2c9f57fd None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:39.870571 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6bb38c-eca0-4362-814d-d47fdf98e366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:39.871339 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6bb38c-eca0-4362-814d-d47fdf98e366 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:39.871740 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6bb38c-eca0-4362-814d-d47fdf98e366 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:39.872123 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6bb38c-eca0-4362-814d-d47fdf98e366 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:39.880167 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6bb38c-eca0-4362-814d-d47fdf98e366 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:39.882035 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6bb38c-eca0-4362-814d-d47fdf98e366 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:39.894693 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application [None req-be6bb38c-eca0-4362-814d-d47fdf98e366 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 21:42:39.894693 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:39.894693 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:42:39.894693 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:42:39.894693 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:42:39.894693 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:42:39.894693 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:42:39.894693 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:42:39.894693 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:42:39.894693 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:42:39.894693 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:42:39.894693 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:42:39.894693 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 21:42:39.894693 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 21:42:39.894693 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 21:42:39.895754 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 21:42:39.895754 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:42:39.895754 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:42:39.895754 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:42:39.895754 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:42:39.895754 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:42:39.895754 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:42:39.895754 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:42:39.895754 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application with Lock( Aug 18 21:42:39.895754 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:42:39.895754 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:42:39.895754 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:42:39.895754 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:42:39.895754 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:42:39.895754 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:42:39.895754 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:42:39.895754 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:42:39.896669 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 21:42:39.896669 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 21:42:39.896669 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 21:42:39.896669 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 21:42:39.896669 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 21:42:39.896669 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 21:42:39.896669 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 21:42:39.896669 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:42:39.901114 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 477/949] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Aug 18 21:42:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:42:39.903123 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6bb38c-eca0-4362-814d-d47fdf98e366 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:39.947806 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:39.985992 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d662ba47-72f0-4651-9d27-2c7a2c9f57fd None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:39.997896 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:40.023029 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba9c8f9-ae91-481a-9c5c-23883178c7b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:40.023611 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba9c8f9-ae91-481a-9c5c-23883178c7b6 None admin] REQUEST_METHOD: `PUT` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:40.023886 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba9c8f9-ae91-481a-9c5c-23883178c7b6 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:40.024153 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba9c8f9-ae91-481a-9c5c-23883178c7b6 None admin] PATH_INFO: `/v3/projects/4b54801b90484d689034f838f85fc0a4/users/f079aa6ed5594a4982172b51b93ac54f/roles/ac9ba398413d4794800e1f777b75c1df` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:40.025785 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6bb38c-eca0-4362-814d-d47fdf98e366 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:40.026347 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba9c8f9-ae91-481a-9c5c-23883178c7b6 None admin] RBAC: Authorizing `identity:create_grant(project_id=4b54801b90484d689034f838f85fc0a4, user_id=f079aa6ed5594a4982172b51b93ac54f, role_id=ac9ba398413d4794800e1f777b75c1df)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:40.027759 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba9c8f9-ae91-481a-9c5c-23883178c7b6 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:40.061055 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5cadb3-a61b-4e2d-885b-42119bcd8abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:40.061663 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5cadb3-a61b-4e2d-885b-42119bcd8abf None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:40.061945 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5cadb3-a61b-4e2d-885b-42119bcd8abf None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:40.062219 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5cadb3-a61b-4e2d-885b-42119bcd8abf None admin] PATH_INFO: `/v3/projects` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:40.062880 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5cadb3-a61b-4e2d-885b-42119bcd8abf None admin] RBAC: Adding query filter params (name=service) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:40.063726 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5cadb3-a61b-4e2d-885b-42119bcd8abf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:40.065335 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5cadb3-a61b-4e2d-885b-42119bcd8abf None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:40.083455 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 478/950] 10.222.0.27 () {56 vars in 1112 bytes} [Thu Aug 18 21:42:39 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 21:42:40.114462 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 473/951] 10.222.0.27 () {58 vars in 1439 bytes} [Thu Aug 18 21:42:39 2022] PUT /identity/v3/projects/4b54801b90484d689034f838f85fc0a4/users/f079aa6ed5594a4982172b51b93ac54f/roles/ac9ba398413d4794800e1f777b75c1df => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:42:40.147026 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5cadb3-a61b-4e2d-885b-42119bcd8abf None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:40.267736 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:40.276325 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5cadb3-a61b-4e2d-885b-42119bcd8abf None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:40.322210 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c528849-3273-438f-a867-95ee314a9ca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:40.322837 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c528849-3273-438f-a867-95ee314a9ca4 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:40.323115 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c528849-3273-438f-a867-95ee314a9ca4 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:40.323387 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c528849-3273-438f-a867-95ee314a9ca4 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:40.323971 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c528849-3273-438f-a867-95ee314a9ca4 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:40.325371 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c528849-3273-438f-a867-95ee314a9ca4 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:40.335542 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application [None req-7c528849-3273-438f-a867-95ee314a9ca4 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 18 21:42:40.335542 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:40.335542 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 21:42:40.335542 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 21:42:40.335542 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 21:42:40.335542 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 21:42:40.335542 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 21:42:40.335542 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 21:42:40.335542 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 18 21:42:40.335542 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:42:40.335542 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 21:42:40.335542 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:42:40.335542 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:40.335542 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:42:40.335542 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:42:40.335542 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:42:40.335542 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:42:40.337039 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:42:40.337039 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:42:40.337039 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:42:40.337039 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:42:40.337039 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:42:40.337039 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:42:40.337039 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 21:42:40.337039 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 21:42:40.337039 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 21:42:40.337039 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 21:42:40.337039 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:42:40.337039 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:42:40.337039 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:42:40.337039 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:42:40.337039 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:42:40.337039 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:42:40.338149 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:42:40.338149 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application with Lock( Aug 18 21:42:40.338149 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:42:40.338149 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:42:40.338149 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:42:40.338149 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:42:40.338149 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:42:40.338149 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:42:40.338149 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:42:40.338149 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:42:40.338149 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 21:42:40.338149 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 21:42:40.338149 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 18 21:42:40.338149 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:42:40.338149 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 479/952] 10.222.0.27 () {56 vars in 1126 bytes} [Thu Aug 18 21:42:40 2022] GET /identity/v3/services/object-store => generated 93 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:42:40.346106 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba9c8f9-ae91-481a-9c5c-23883178c7b6 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:40.459134 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba9c8f9-ae91-481a-9c5c-23883178c7b6 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:40.495120 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a4cd9f-0946-44f3-ae56-30cd7f91f507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:40.495733 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a4cd9f-0946-44f3-ae56-30cd7f91f507 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:40.496007 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a4cd9f-0946-44f3-ae56-30cd7f91f507 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:40.496275 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a4cd9f-0946-44f3-ae56-30cd7f91f507 None admin] PATH_INFO: `/v3/services` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:40.496948 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a4cd9f-0946-44f3-ae56-30cd7f91f507 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:40.497249 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a4cd9f-0946-44f3-ae56-30cd7f91f507 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:40.498606 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a4cd9f-0946-44f3-ae56-30cd7f91f507 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:40.504430 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 474/953] 10.222.0.27 () {56 vars in 1122 bytes} [Thu Aug 18 21:42:40 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 21:42:40.510204 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c528849-3273-438f-a867-95ee314a9ca4 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:40.620780 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c528849-3273-438f-a867-95ee314a9ca4 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:40.657354 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4857ff20-460e-43a0-99b0-d77bfb7f1e9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:40.658385 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4857ff20-460e-43a0-99b0-d77bfb7f1e9e None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:40.658881 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4857ff20-460e-43a0-99b0-d77bfb7f1e9e None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:40.659359 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4857ff20-460e-43a0-99b0-d77bfb7f1e9e None admin] PATH_INFO: `/v3/services` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:40.660199 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4857ff20-460e-43a0-99b0-d77bfb7f1e9e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:40.660746 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4857ff20-460e-43a0-99b0-d77bfb7f1e9e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:40.662350 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4857ff20-460e-43a0-99b0-d77bfb7f1e9e None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:40.668370 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 480/954] 10.222.0.27 () {56 vars in 1122 bytes} [Thu Aug 18 21:42:40 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:42:40.677974 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a4cd9f-0946-44f3-ae56-30cd7f91f507 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:40.713756 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:40.785544 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a4cd9f-0946-44f3-ae56-30cd7f91f507 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:40.813724 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88641b1-f988-4055-9a98-b41084c220db None None] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:40.814385 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88641b1-f988-4055-9a98-b41084c220db None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:40.814916 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88641b1-f988-4055-9a98-b41084c220db None None] PATH_INFO: `/` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:40.816798 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 481/955] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:42:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:42:40.822076 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e6c36a-ea6d-41cb-bbb5-ac5050cb6724 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:40.822240 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c558ec-8e57-4bd6-bdd7-eea54da5b810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:40.822756 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c558ec-8e57-4bd6-bdd7-eea54da5b810 None admin] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:40.822981 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e6c36a-ea6d-41cb-bbb5-ac5050cb6724 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:40.823092 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c558ec-8e57-4bd6-bdd7-eea54da5b810 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:40.823285 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c558ec-8e57-4bd6-bdd7-eea54da5b810 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:40.823748 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e6c36a-ea6d-41cb-bbb5-ac5050cb6724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:40.823934 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c558ec-8e57-4bd6-bdd7-eea54da5b810 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:40.825379 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c558ec-8e57-4bd6-bdd7-eea54da5b810 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:40.843884 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-83e6c36a-ea6d-41cb-bbb5-ac5050cb6724 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:42:40.846549 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-83e6c36a-ea6d-41cb-bbb5-ac5050cb6724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:42:40.863891 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:40.916819 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 482/956] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:42:40 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 21:42:40.947721 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 475/957] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 18 21:42:40 2022] POST /identity/v3/endpoints => generated 349 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:42:41.196190 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e6c36a-ea6d-41cb-bbb5-ac5050cb6724 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:41.308322 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e6c36a-ea6d-41cb-bbb5-ac5050cb6724 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:41.351802 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89af9ebd-4726-4e18-a0e0-0adc9f3891ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:41.352435 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89af9ebd-4726-4e18-a0e0-0adc9f3891ba None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:41.352754 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89af9ebd-4726-4e18-a0e0-0adc9f3891ba None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:41.353027 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89af9ebd-4726-4e18-a0e0-0adc9f3891ba None admin] PATH_INFO: `/v3/services/compute` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:41.353673 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89af9ebd-4726-4e18-a0e0-0adc9f3891ba None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:41.355039 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89af9ebd-4726-4e18-a0e0-0adc9f3891ba None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:41.364308 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application [None req-89af9ebd-4726-4e18-a0e0-0adc9f3891ba None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 18 21:42:41.364308 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:41.364308 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 21:42:41.364308 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 21:42:41.364308 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 21:42:41.364308 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 21:42:41.364308 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 21:42:41.364308 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 21:42:41.364308 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 18 21:42:41.364308 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:42:41.364308 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 21:42:41.364308 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:42:41.364308 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:41.364308 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:42:41.364308 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:42:41.364308 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:42:41.364308 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:42:41.365374 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:42:41.365374 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:42:41.365374 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:42:41.365374 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:42:41.365374 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:42:41.365374 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:42:41.365374 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 21:42:41.365374 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 21:42:41.365374 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 21:42:41.365374 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 21:42:41.365374 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:42:41.365374 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:42:41.365374 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:42:41.365374 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:42:41.365374 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:42:41.365374 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:42:41.366809 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:42:41.366809 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application with Lock( Aug 18 21:42:41.366809 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:42:41.366809 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:42:41.366809 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:42:41.366809 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:42:41.366809 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:42:41.366809 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:42:41.366809 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:42:41.366809 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:42:41.366809 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 21:42:41.366809 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 21:42:41.366809 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 18 21:42:41.366809 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:42:41.366809 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 483/958] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Aug 18 21:42:41 2022] GET /identity/v3/services/compute => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:42:41.371563 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c558ec-8e57-4bd6-bdd7-eea54da5b810 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:41.472937 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:41.484049 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c558ec-8e57-4bd6-bdd7-eea54da5b810 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:41.520845 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dcad45-324d-4d5a-8f9f-55e66dd5c35d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:41.521942 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dcad45-324d-4d5a-8f9f-55e66dd5c35d None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:41.522436 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dcad45-324d-4d5a-8f9f-55e66dd5c35d None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:41.522907 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dcad45-324d-4d5a-8f9f-55e66dd5c35d None admin] PATH_INFO: `/v3/services` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:41.523735 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dcad45-324d-4d5a-8f9f-55e66dd5c35d None admin] RBAC: Adding query filter params (name=compute) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:41.524251 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dcad45-324d-4d5a-8f9f-55e66dd5c35d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:41.525850 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dcad45-324d-4d5a-8f9f-55e66dd5c35d None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:41.532790 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 476/959] 10.222.0.27 () {56 vars in 1112 bytes} [Thu Aug 18 21:42:41 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:42:41.538308 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89af9ebd-4726-4e18-a0e0-0adc9f3891ba None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:41.554455 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:41.648349 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89af9ebd-4726-4e18-a0e0-0adc9f3891ba None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:41.685316 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f843fe2f-f0f6-4309-9c38-52ea4d415f5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:41.685936 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f843fe2f-f0f6-4309-9c38-52ea4d415f5d None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:41.686276 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f843fe2f-f0f6-4309-9c38-52ea4d415f5d None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:41.686554 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f843fe2f-f0f6-4309-9c38-52ea4d415f5d None admin] PATH_INFO: `/v3/services` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:41.687188 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f843fe2f-f0f6-4309-9c38-52ea4d415f5d None admin] RBAC: Adding query filter params (type=compute) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:41.687488 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f843fe2f-f0f6-4309-9c38-52ea4d415f5d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:41.689847 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f843fe2f-f0f6-4309-9c38-52ea4d415f5d None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:41.694845 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 484/960] 10.222.0.27 () {56 vars in 1112 bytes} [Thu Aug 18 21:42:41 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:42:42.107253 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba70a1c5-73e8-47c4-ab72-6d6df208e15c None None] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:42.107664 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba70a1c5-73e8-47c4-ab72-6d6df208e15c None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:42.107864 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba70a1c5-73e8-47c4-ab72-6d6df208e15c None None] PATH_INFO: `/` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:42.109444 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 477/961] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:42:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:42:42.114977 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9169f8-0549-433a-a4e1-713e07cc1f0a None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:42.115438 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9169f8-0549-433a-a4e1-713e07cc1f0a None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:42.115535 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9169f8-0549-433a-a4e1-713e07cc1f0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:42.134379 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-ab9169f8-0549-433a-a4e1-713e07cc1f0a None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:42:42.135599 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-ab9169f8-0549-433a-a4e1-713e07cc1f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:42:42.210132 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 485/962] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:42:42 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 21:42:42.299484 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7d0fd5-67e5-4bd4-b2ee-45e3103f3dc1 None None] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:42.300120 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7d0fd5-67e5-4bd4-b2ee-45e3103f3dc1 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:42.300628 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7d0fd5-67e5-4bd4-b2ee-45e3103f3dc1 None None] PATH_INFO: `/` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:42.302441 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 478/963] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:42:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:42:42.307820 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b187e95-d136-4061-bce7-d9f04178d99c None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:42.308339 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b187e95-d136-4061-bce7-d9f04178d99c None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:42.308842 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b187e95-d136-4061-bce7-d9f04178d99c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:42.321744 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:42.328883 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-3b187e95-d136-4061-bce7-d9f04178d99c None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:42:42.330552 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-3b187e95-d136-4061-bce7-d9f04178d99c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:42:42.408047 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 486/964] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:42:42 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 21:42:42.496287 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7d0fd5-67e5-4bd4-b2ee-45e3103f3dc1 None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:42.613647 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7d0fd5-67e5-4bd4-b2ee-45e3103f3dc1 None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:42.652230 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cbbf53-20b6-472f-9dcb-d22d5637826c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:42.653307 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cbbf53-20b6-472f-9dcb-d22d5637826c None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:42.653803 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cbbf53-20b6-472f-9dcb-d22d5637826c None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:42.654272 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cbbf53-20b6-472f-9dcb-d22d5637826c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:42.667182 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cbbf53-20b6-472f-9dcb-d22d5637826c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:42:42.672983 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application [None req-69cbbf53-20b6-472f-9dcb-d22d5637826c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 18 21:42:42.672983 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:42.672983 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:42:42.672983 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:42:42.672983 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:42:42.672983 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:42:42.672983 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:42:42.672983 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:42:42.672983 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:42:42.672983 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:42:42.672983 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:42:42.672983 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:42:42.672983 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:42:42.672983 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:42:42.672983 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:42:42.672983 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:42:42.674006 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:42:42.674006 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:42:42.674006 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:42:42.674006 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:42:42.674006 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:42:42.674006 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:42:42.674006 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:42:42.674006 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:42:42.674006 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:42:42.674006 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:42:42.674006 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:42:42.674006 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application with Lock( Aug 18 21:42:42.674006 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:42:42.674006 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:42:42.674006 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:42:42.674006 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:42:42.674862 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:42:42.674862 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:42:42.674862 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:42:42.674862 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:42:42.674862 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:42:42.674862 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:42:42.674862 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:42:42.674862 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:42:42.674862 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:42:42.674862 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:42:42.674862 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 18 21:42:42.674862 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:42:42.677729 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 479/965] 10.222.0.27 () {56 vars in 1120 bytes} [Thu Aug 18 21:42:42 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:42:42.686505 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b187e95-d136-4061-bce7-d9f04178d99c None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:42.721710 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cbbf53-20b6-472f-9dcb-d22d5637826c None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:42.748229 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:42.828499 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b187e95-d136-4061-bce7-d9f04178d99c None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:42.888416 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7063ad-f1f3-4270-95db-5a2585bbd6e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:42.889144 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cbbf53-20b6-472f-9dcb-d22d5637826c None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:42.889477 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7063ad-f1f3-4270-95db-5a2585bbd6e4 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:42.889903 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7063ad-f1f3-4270-95db-5a2585bbd6e4 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:42.890353 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7063ad-f1f3-4270-95db-5a2585bbd6e4 None admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:42.891193 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7063ad-f1f3-4270-95db-5a2585bbd6e4 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:42.892016 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7063ad-f1f3-4270-95db-5a2585bbd6e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:42.894087 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7063ad-f1f3-4270-95db-5a2585bbd6e4 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:42.897348 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:42.905992 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 487/966] 10.222.0.27 () {56 vars in 1115 bytes} [Thu Aug 18 21:42:42 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:42:42.915407 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7063ad-f1f3-4270-95db-5a2585bbd6e4 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:42.938579 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62202109-0f31-4799-a5c7-feb3f442fb32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:42.939245 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62202109-0f31-4799-a5c7-feb3f442fb32 None admin] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:42.939648 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62202109-0f31-4799-a5c7-feb3f442fb32 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:42.940042 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62202109-0f31-4799-a5c7-feb3f442fb32 None admin] PATH_INFO: `/v3/users` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:42.942493 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62202109-0f31-4799-a5c7-feb3f442fb32 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:42.943977 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62202109-0f31-4799-a5c7-feb3f442fb32 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:42.947654 dv-cinder-853678-3-smb devstack@keystone.service[88096]: WARNING keystone.server.flask.common [None req-62202109-0f31-4799-a5c7-feb3f442fb32 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 18 21:42:43.014332 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.sql.core [None req-62202109-0f31-4799-a5c7-feb3f442fb32 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 18 21:42:43.014332 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 18 21:42:43.014332 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [parameters: {'user_id': '2b859ed6b930468db646aaea63e3de83', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 18 21:42:43.014332 dv-cinder-853678-3-smb devstack@keystone.service[88096]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88096) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 18 21:42:43.024619 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application [None req-62202109-0f31-4799-a5c7-feb3f442fb32 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 18 21:42:43.024619 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:43.024619 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 18 21:42:43.024619 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 18 21:42:43.024619 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 18 21:42:43.024619 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 18 21:42:43.024619 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 18 21:42:43.024619 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application result = self._query(query) Aug 18 21:42:43.024619 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 18 21:42:43.024619 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application conn.query(q) Aug 18 21:42:43.024619 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 18 21:42:43.024619 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 18 21:42:43.024619 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 18 21:42:43.024619 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application result.read() Aug 18 21:42:43.024619 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 18 21:42:43.025553 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 18 21:42:43.025553 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 18 21:42:43.025553 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 18 21:42:43.025553 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 18 21:42:43.025553 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 18 21:42:43.025553 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 18 21:42:43.025553 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 18 21:42:43.025553 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 18 21:42:43.025553 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:42:43.025553 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 18 21:42:43.025553 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:42:43.025553 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:43.025553 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 18 21:42:43.025553 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 18 21:42:43.025553 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 18 21:42:43.025553 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 18 21:42:43.025553 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 18 21:42:43.025553 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application next(self.gen) Aug 18 21:42:43.026525 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 18 21:42:43.026525 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application yield resource Aug 18 21:42:43.026525 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 18 21:42:43.026525 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application next(self.gen) Aug 18 21:42:43.026525 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 18 21:42:43.026525 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application self.session.rollback() Aug 18 21:42:43.026525 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 18 21:42:43.026525 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application self.force_reraise() Aug 18 21:42:43.026525 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 18 21:42:43.026525 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise self.value Aug 18 21:42:43.026525 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 18 21:42:43.026525 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 18 21:42:43.026525 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 18 21:42:43.026525 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application session.commit() Aug 18 21:42:43.026525 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 18 21:42:43.026525 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 18 21:42:43.026525 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 18 21:42:43.027430 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application self._prepare_impl() Aug 18 21:42:43.027430 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 18 21:42:43.027430 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application self.session.flush() Aug 18 21:42:43.027430 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 18 21:42:43.027430 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application self._flush(objects) Aug 18 21:42:43.027430 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 18 21:42:43.027430 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 18 21:42:43.027430 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 18 21:42:43.027430 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application compat.raise_( Aug 18 21:42:43.027430 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 18 21:42:43.027430 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception Aug 18 21:42:43.027430 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 18 21:42:43.027430 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application flush_context.execute() Aug 18 21:42:43.027430 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 18 21:42:43.027430 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application rec.execute(self) Aug 18 21:42:43.027430 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 18 21:42:43.027430 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 18 21:42:43.028317 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 18 21:42:43.028317 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 18 21:42:43.028317 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 18 21:42:43.028317 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 18 21:42:43.028317 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 18 21:42:43.028317 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 18 21:42:43.028317 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 18 21:42:43.028317 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 18 21:42:43.028317 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 18 21:42:43.028317 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 18 21:42:43.028317 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 18 21:42:43.028317 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 18 21:42:43.028317 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 18 21:42:43.028317 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 18 21:42:43.028317 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 18 21:42:43.028317 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception Aug 18 21:42:43.031020 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 18 21:42:43.031020 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 18 21:42:43.031020 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 18 21:42:43.031020 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 18 21:42:43.031020 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 18 21:42:43.031020 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application result = self._query(query) Aug 18 21:42:43.031020 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 18 21:42:43.031020 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application conn.query(q) Aug 18 21:42:43.031020 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 18 21:42:43.031020 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 18 21:42:43.031020 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 18 21:42:43.031020 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application result.read() Aug 18 21:42:43.031020 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 18 21:42:43.031020 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 18 21:42:43.031020 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 18 21:42:43.031020 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 18 21:42:43.033248 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 18 21:42:43.033248 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 18 21:42:43.033248 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 18 21:42:43.033248 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 18 21:42:43.033248 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 18 21:42:43.033248 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 18 21:42:43.033248 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application [parameters: {'user_id': '2b859ed6b930468db646aaea63e3de83', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 18 21:42:43.033248 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 18 21:42:43.033248 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:42:43.033248 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 21:42:43.033248 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:42:43.033248 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:43.033248 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:42:43.033248 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:42:43.033248 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:42:43.035163 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:42:43.035163 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:42:43.035163 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:42:43.035163 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:42:43.035163 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:42:43.035163 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:42:43.035163 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:42:43.035163 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 18 21:42:43.035163 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 18 21:42:43.035163 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:42:43.035163 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:42:43.035163 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 21:42:43.035163 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 21:42:43.035163 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 21:42:43.035163 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 21:42:43.035163 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 18 21:42:43.035163 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 18 21:42:43.037912 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 18 21:42:43.037912 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 18 21:42:43.037912 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 18 21:42:43.037912 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 18 21:42:43.037912 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 18 21:42:43.037912 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:42:43.037912 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 480/967] 10.222.0.27 () {60 vars in 1131 bytes} [Thu Aug 18 21:42:42 2022] POST /identity/v3/users => generated 160 bytes in 305 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 18 21:42:43.037912 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea5dad4-34f7-4773-89a2-938666d520ab None None] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:43.037912 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea5dad4-34f7-4773-89a2-938666d520ab None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:43.037912 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea5dad4-34f7-4773-89a2-938666d520ab None None] PATH_INFO: `/` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:43.038596 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 481/968] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:42:43 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:42:43.038596 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea5dad4-34f7-4773-89a2-938666d520ab None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:43.048031 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7063ad-f1f3-4270-95db-5a2585bbd6e4 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:43.092273 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a716ec1c-b2cd-4c14-82c7-209dfb777704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:43.092931 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a716ec1c-b2cd-4c14-82c7-209dfb777704 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:43.093311 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a716ec1c-b2cd-4c14-82c7-209dfb777704 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:43.093525 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a716ec1c-b2cd-4c14-82c7-209dfb777704 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:43.105261 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a716ec1c-b2cd-4c14-82c7-209dfb777704 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:43.106719 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a716ec1c-b2cd-4c14-82c7-209dfb777704 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:43.122673 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application [None req-a716ec1c-b2cd-4c14-82c7-209dfb777704 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:42:43.122673 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:43.122673 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:42:43.122673 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:42:43.122673 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:42:43.122673 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:42:43.122673 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:42:43.122673 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:42:43.122673 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:42:43.122673 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:42:43.122673 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:42:43.122673 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:42:43.122673 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 21:42:43.122673 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 21:42:43.122673 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 21:42:43.122673 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 21:42:43.124370 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:42:43.124370 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:42:43.124370 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:42:43.124370 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:42:43.124370 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:42:43.124370 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:42:43.124370 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:42:43.124370 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application with Lock( Aug 18 21:42:43.124370 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:42:43.124370 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:42:43.124370 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:42:43.124370 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:42:43.124370 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:42:43.124370 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:42:43.124370 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:42:43.124370 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:42:43.124370 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 21:42:43.125658 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 21:42:43.125658 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:42:43.125658 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:42:43.129267 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 488/969] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 18 21:42:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:42:43.132906 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75465111-fad9-40be-a17d-76335ab05ba8 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:43.132906 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75465111-fad9-40be-a17d-76335ab05ba8 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:43.132906 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75465111-fad9-40be-a17d-76335ab05ba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:43.146226 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:43.150644 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-75465111-fad9-40be-a17d-76335ab05ba8 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:42:43.152081 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-75465111-fad9-40be-a17d-76335ab05ba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:42:43.174420 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea5dad4-34f7-4773-89a2-938666d520ab None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:43.209010 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:43.211048 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c668caf9-8a7d-4501-b6e1-16c3f7c14280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:43.211687 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c668caf9-8a7d-4501-b6e1-16c3f7c14280 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:43.211963 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c668caf9-8a7d-4501-b6e1-16c3f7c14280 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:43.212231 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c668caf9-8a7d-4501-b6e1-16c3f7c14280 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:43.221749 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c668caf9-8a7d-4501-b6e1-16c3f7c14280 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:43.223378 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c668caf9-8a7d-4501-b6e1-16c3f7c14280 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:43.231696 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 489/970] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:42:43 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 21:42:43.232799 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75465111-fad9-40be-a17d-76335ab05ba8 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:43.236290 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application [None req-c668caf9-8a7d-4501-b6e1-16c3f7c14280 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 18 21:42:43.236290 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:43.236290 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:42:43.236290 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:42:43.236290 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:42:43.236290 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:42:43.236290 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:42:43.236290 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:42:43.236290 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:42:43.236290 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:42:43.236290 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:42:43.236290 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:42:43.236290 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 21:42:43.236290 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 21:42:43.236290 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 21:42:43.236290 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 21:42:43.237295 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:42:43.237295 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:42:43.237295 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 21:42:43.237295 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 21:42:43.237295 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 21:42:43.237295 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 21:42:43.237295 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:42:43.237295 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:42:43.237295 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:42:43.237295 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:42:43.237295 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:42:43.237295 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application with Lock( Aug 18 21:42:43.237295 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:42:43.237295 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:42:43.237295 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:42:43.237295 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:42:43.237295 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:42:43.237295 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:42:43.238269 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:42:43.238269 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:42:43.238269 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 21:42:43.238269 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 21:42:43.238269 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 21:42:43.238269 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 21:42:43.238269 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 21:42:43.238269 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 21:42:43.238269 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 18 21:42:43.238269 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:42:43.238269 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 482/971] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Aug 18 21:42:43 2022] GET /identity/v3/users/cinder => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:42:43.243075 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c668caf9-8a7d-4501-b6e1-16c3f7c14280 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:43.361944 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75465111-fad9-40be-a17d-76335ab05ba8 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:43.409221 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f2cb91-c691-42a4-8d33-410215478908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:43.409924 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f2cb91-c691-42a4-8d33-410215478908 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:43.410267 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f2cb91-c691-42a4-8d33-410215478908 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:43.411177 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f2cb91-c691-42a4-8d33-410215478908 None admin] PATH_INFO: `/v3/domains` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:43.412327 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f2cb91-c691-42a4-8d33-410215478908 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:43.412802 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f2cb91-c691-42a4-8d33-410215478908 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:43.414953 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f2cb91-c691-42a4-8d33-410215478908 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:43.424542 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c668caf9-8a7d-4501-b6e1-16c3f7c14280 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:43.432750 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 490/972] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 18 21:42:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:42:43.437639 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f2cb91-c691-42a4-8d33-410215478908 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:43.471944 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206b38c1-0668-443d-871e-563d0f08aa8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:43.471944 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206b38c1-0668-443d-871e-563d0f08aa8b None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:43.471944 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206b38c1-0668-443d-871e-563d0f08aa8b None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:43.471944 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206b38c1-0668-443d-871e-563d0f08aa8b None admin] PATH_INFO: `/v3/users` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:43.472633 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206b38c1-0668-443d-871e-563d0f08aa8b None admin] RBAC: Adding query filter params (name=cinder) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:43.473109 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206b38c1-0668-443d-871e-563d0f08aa8b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:43.474808 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206b38c1-0668-443d-871e-563d0f08aa8b None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:43.487178 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:43.495379 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:43.525363 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 483/973] 10.222.0.27 () {56 vars in 1101 bytes} [Thu Aug 18 21:42:43 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 21:42:43.554085 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206b38c1-0668-443d-871e-563d0f08aa8b None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:43.572036 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f2cb91-c691-42a4-8d33-410215478908 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:43.621346 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f5241e-9aa2-43b9-aeac-fe56098cacdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:43.622343 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f5241e-9aa2-43b9-aeac-fe56098cacdd None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:43.622805 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f5241e-9aa2-43b9-aeac-fe56098cacdd None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:43.623291 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f5241e-9aa2-43b9-aeac-fe56098cacdd None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:43.633610 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f5241e-9aa2-43b9-aeac-fe56098cacdd None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:43.635780 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f5241e-9aa2-43b9-aeac-fe56098cacdd None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:43.650005 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application [None req-83f5241e-9aa2-43b9-aeac-fe56098cacdd None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 18 21:42:43.650005 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:43.650005 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:42:43.650005 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:42:43.650005 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:42:43.650005 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:42:43.650005 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:42:43.650005 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:42:43.650005 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:42:43.650005 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:42:43.650005 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:42:43.650005 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:42:43.650005 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 21:42:43.650005 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 21:42:43.650005 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 21:42:43.650005 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 21:42:43.651049 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:42:43.651049 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:42:43.651049 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 21:42:43.651049 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 21:42:43.651049 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 21:42:43.651049 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 21:42:43.651049 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:42:43.651049 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:42:43.651049 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:42:43.651049 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:42:43.651049 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:42:43.651049 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application with Lock( Aug 18 21:42:43.651049 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:42:43.651049 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:42:43.651049 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:42:43.651049 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:42:43.651049 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:42:43.651049 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:42:43.652012 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:42:43.652012 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:42:43.652012 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 21:42:43.652012 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 21:42:43.652012 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 21:42:43.652012 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 21:42:43.652012 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 21:42:43.652012 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 21:42:43.652012 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 18 21:42:43.652012 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:42:43.654813 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 491/974] 10.222.0.27 () {56 vars in 1117 bytes} [Thu Aug 18 21:42:43 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:42:43.665659 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f5241e-9aa2-43b9-aeac-fe56098cacdd None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:43.697156 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206b38c1-0668-443d-871e-563d0f08aa8b None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:43.740477 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcfd4a6-62be-4c6c-a8ce-9033a3811112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:43.741119 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcfd4a6-62be-4c6c-a8ce-9033a3811112 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:43.741349 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcfd4a6-62be-4c6c-a8ce-9033a3811112 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:43.741619 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcfd4a6-62be-4c6c-a8ce-9033a3811112 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:43.742204 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcfd4a6-62be-4c6c-a8ce-9033a3811112 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:43.743699 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcfd4a6-62be-4c6c-a8ce-9033a3811112 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:43.754201 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application [None req-1dcfd4a6-62be-4c6c-a8ce-9033a3811112 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 18 21:42:43.754201 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:43.754201 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 21:42:43.754201 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 21:42:43.754201 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 21:42:43.754201 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 21:42:43.754201 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 21:42:43.754201 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 21:42:43.754201 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 18 21:42:43.754201 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:42:43.754201 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 21:42:43.754201 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:42:43.754201 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:43.754201 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:42:43.754201 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:42:43.754201 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:42:43.754201 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:42:43.755434 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:42:43.755434 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:42:43.755434 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:42:43.755434 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:42:43.755434 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:42:43.755434 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:42:43.755434 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 21:42:43.755434 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 21:42:43.755434 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 21:42:43.755434 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 21:42:43.755434 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:42:43.755434 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:42:43.755434 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:42:43.755434 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:42:43.755434 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:42:43.755434 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:42:43.756379 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:42:43.756379 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application with Lock( Aug 18 21:42:43.756379 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:42:43.756379 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:42:43.756379 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:42:43.756379 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:42:43.756379 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:42:43.756379 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:42:43.756379 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:42:43.756379 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:42:43.756379 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 21:42:43.756379 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 21:42:43.756379 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 18 21:42:43.756379 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:42:43.756379 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 484/975] 10.222.0.27 () {56 vars in 1126 bytes} [Thu Aug 18 21:42:43 2022] GET /identity/v3/services/object-store => generated 93 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 21:42:43.761434 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcfd4a6-62be-4c6c-a8ce-9033a3811112 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:43.815072 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:43.819059 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f5241e-9aa2-43b9-aeac-fe56098cacdd None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:43.839309 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:43.862075 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2228794-70a7-4adc-872e-70a3ed664601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:43.862678 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2228794-70a7-4adc-872e-70a3ed664601 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:43.862957 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2228794-70a7-4adc-872e-70a3ed664601 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:43.863228 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2228794-70a7-4adc-872e-70a3ed664601 None admin] PATH_INFO: `/v3/users` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:43.863961 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2228794-70a7-4adc-872e-70a3ed664601 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:43.864263 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2228794-70a7-4adc-872e-70a3ed664601 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:43.866003 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2228794-70a7-4adc-872e-70a3ed664601 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:43.883609 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcfd4a6-62be-4c6c-a8ce-9033a3811112 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:43.885022 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 492/976] 10.222.0.27 () {56 vars in 1149 bytes} [Thu Aug 18 21:42:43 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:42:43.886247 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb7bb69-55d1-48f0-9d04-0deeed0ad30b None None] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:43.886530 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb7bb69-55d1-48f0-9d04-0deeed0ad30b None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:43.886805 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb7bb69-55d1-48f0-9d04-0deeed0ad30b None None] PATH_INFO: `/` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:43.888393 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 493/977] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:42:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:42:43.890878 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb7bb69-55d1-48f0-9d04-0deeed0ad30b None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:43.922373 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7556d20-78f0-42f3-887d-051a9b5ee911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:43.923623 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7556d20-78f0-42f3-887d-051a9b5ee911 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:43.923957 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7556d20-78f0-42f3-887d-051a9b5ee911 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:43.924288 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7556d20-78f0-42f3-887d-051a9b5ee911 None admin] PATH_INFO: `/v3/services` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:43.925030 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7556d20-78f0-42f3-887d-051a9b5ee911 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:43.925327 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7556d20-78f0-42f3-887d-051a9b5ee911 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:43.926857 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7556d20-78f0-42f3-887d-051a9b5ee911 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:43.935977 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 485/978] 10.222.0.27 () {56 vars in 1122 bytes} [Thu Aug 18 21:42:43 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 21:42:43.935977 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5c38a2-ea96-4a2d-9470-9aeb4f70b45c None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:43.935977 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5c38a2-ea96-4a2d-9470-9aeb4f70b45c None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:43.935977 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5c38a2-ea96-4a2d-9470-9aeb4f70b45c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:43.954446 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-5d5c38a2-ea96-4a2d-9470-9aeb4f70b45c None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:42:43.956226 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-5d5c38a2-ea96-4a2d-9470-9aeb4f70b45c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:42:44.013251 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb7bb69-55d1-48f0-9d04-0deeed0ad30b None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:44.031747 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 486/979] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:42:43 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 21:42:44.033321 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5c38a2-ea96-4a2d-9470-9aeb4f70b45c None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:44.055204 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef123da9-f64d-48c7-bb25-71e7ba8730b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:44.055898 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef123da9-f64d-48c7-bb25-71e7ba8730b1 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:44.056243 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef123da9-f64d-48c7-bb25-71e7ba8730b1 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:44.056709 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef123da9-f64d-48c7-bb25-71e7ba8730b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:44.088404 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:44.093423 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:44.133968 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef123da9-f64d-48c7-bb25-71e7ba8730b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:44.135299 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef123da9-f64d-48c7-bb25-71e7ba8730b1 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:44.147456 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5c38a2-ea96-4a2d-9470-9aeb4f70b45c None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:44.186896 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e5162b-32e4-4fe4-92bf-8fe94d1bc58d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:44.187523 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e5162b-32e4-4fe4-92bf-8fe94d1bc58d None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:44.187815 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e5162b-32e4-4fe4-92bf-8fe94d1bc58d None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:44.188128 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e5162b-32e4-4fe4-92bf-8fe94d1bc58d None admin] PATH_INFO: `/v3/services` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:44.189483 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e5162b-32e4-4fe4-92bf-8fe94d1bc58d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:44.189792 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e5162b-32e4-4fe4-92bf-8fe94d1bc58d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:44.191165 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e5162b-32e4-4fe4-92bf-8fe94d1bc58d None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:44.196413 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 487/980] 10.222.0.27 () {56 vars in 1122 bytes} [Thu Aug 18 21:42:44 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:42:44.202107 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e5162b-32e4-4fe4-92bf-8fe94d1bc58d None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:44.246299 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 494/981] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Aug 18 21:42:43 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 18 21:42:44.252762 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef123da9-f64d-48c7-bb25-71e7ba8730b1 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:44.325295 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:44.328475 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e5162b-32e4-4fe4-92bf-8fe94d1bc58d None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:44.346451 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:44.364561 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f46c4e5-123e-4d08-888b-eac38706d0f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:44.365230 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f46c4e5-123e-4d08-888b-eac38706d0f0 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:44.365512 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f46c4e5-123e-4d08-888b-eac38706d0f0 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:44.365785 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f46c4e5-123e-4d08-888b-eac38706d0f0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:44.366497 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f46c4e5-123e-4d08-888b-eac38706d0f0 None admin] RBAC: Adding query filter params (interface=admin, service_id=f3605f06334845c6af7919b5886e70dc, region_id=RegionOne) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:44.366806 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f46c4e5-123e-4d08-888b-eac38706d0f0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:44.368164 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f46c4e5-123e-4d08-888b-eac38706d0f0 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:44.369910 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef123da9-f64d-48c7-bb25-71e7ba8730b1 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:44.373155 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 488/982] 10.222.0.27 () {56 vars in 1249 bytes} [Thu Aug 18 21:42:44 2022] GET /identity/v3/endpoints?service_id=f3605f06334845c6af7919b5886e70dc&interface=admin®ion_id=RegionOne => generated 193 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 21:42:44.373992 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f46c4e5-123e-4d08-888b-eac38706d0f0 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:44.411211 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c5fb96-1ad0-4847-9dbd-c958c2954ebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:44.412004 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c5fb96-1ad0-4847-9dbd-c958c2954ebd None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:44.412288 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c5fb96-1ad0-4847-9dbd-c958c2954ebd None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:44.412566 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c5fb96-1ad0-4847-9dbd-c958c2954ebd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:44.424036 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c5fb96-1ad0-4847-9dbd-c958c2954ebd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:44.425757 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c5fb96-1ad0-4847-9dbd-c958c2954ebd None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:44.470514 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application [None req-38c5fb96-1ad0-4847-9dbd-c958c2954ebd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:42:44.470514 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:44.470514 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:42:44.470514 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:42:44.470514 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:42:44.470514 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:42:44.470514 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:42:44.470514 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:42:44.470514 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:42:44.470514 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:42:44.470514 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:42:44.470514 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:42:44.470514 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 21:42:44.470514 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 21:42:44.470514 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 21:42:44.470514 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 21:42:44.471734 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:42:44.471734 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:42:44.471734 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:42:44.471734 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:42:44.471734 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:42:44.471734 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:42:44.471734 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:42:44.471734 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application with Lock( Aug 18 21:42:44.471734 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:42:44.471734 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:42:44.471734 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:42:44.471734 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:42:44.471734 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:42:44.471734 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:42:44.471734 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:42:44.471734 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:42:44.471734 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 21:42:44.472865 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 21:42:44.472865 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:42:44.472865 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:42:44.474282 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 495/983] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 18 21:42:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:42:44.475122 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c5fb96-1ad0-4847-9dbd-c958c2954ebd None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:44.486813 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f46c4e5-123e-4d08-888b-eac38706d0f0 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:44.521570 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18854322-3159-4b40-a74f-e60abadf8f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:44.522178 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18854322-3159-4b40-a74f-e60abadf8f32 None admin] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:44.522457 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18854322-3159-4b40-a74f-e60abadf8f32 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:44.522742 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18854322-3159-4b40-a74f-e60abadf8f32 None admin] PATH_INFO: `/v3/services` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:44.523382 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18854322-3159-4b40-a74f-e60abadf8f32 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:44.524781 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18854322-3159-4b40-a74f-e60abadf8f32 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:44.576660 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c5fb96-1ad0-4847-9dbd-c958c2954ebd None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:44.586607 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:44.604944 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 489/984] 10.222.0.27 () {60 vars in 1141 bytes} [Thu Aug 18 21:42:44 2022] POST /identity/v3/services => generated 242 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:42:44.605834 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18854322-3159-4b40-a74f-e60abadf8f32 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:44.620055 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc41c88a-f79e-4dfe-994f-f8d3bbb28538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:44.620989 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc41c88a-f79e-4dfe-994f-f8d3bbb28538 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:44.620989 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc41c88a-f79e-4dfe-994f-f8d3bbb28538 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:44.621273 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc41c88a-f79e-4dfe-994f-f8d3bbb28538 None admin] PATH_INFO: `/v3/services` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:44.621894 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc41c88a-f79e-4dfe-994f-f8d3bbb28538 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:44.623761 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc41c88a-f79e-4dfe-994f-f8d3bbb28538 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:44.632607 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 496/985] 10.222.0.27 () {56 vars in 1087 bytes} [Thu Aug 18 21:42:44 2022] GET /identity/v3/services => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:42:44.672307 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:44.742630 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18854322-3159-4b40-a74f-e60abadf8f32 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:44.784898 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18ebef5-1ac7-4d40-b78c-5c7e13301717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:44.785521 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18ebef5-1ac7-4d40-b78c-5c7e13301717 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:44.785804 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18ebef5-1ac7-4d40-b78c-5c7e13301717 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:44.786084 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18ebef5-1ac7-4d40-b78c-5c7e13301717 None admin] PATH_INFO: `/v3/domains` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:44.787914 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18ebef5-1ac7-4d40-b78c-5c7e13301717 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:44.787914 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18ebef5-1ac7-4d40-b78c-5c7e13301717 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:44.788398 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18ebef5-1ac7-4d40-b78c-5c7e13301717 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:44.801380 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 490/986] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 18 21:42:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:42:44.807341 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc41c88a-f79e-4dfe-994f-f8d3bbb28538 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:44.912022 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc41c88a-f79e-4dfe-994f-f8d3bbb28538 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:44.945822 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc845e3-e624-4f6f-8980-488de8b55218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:44.946456 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc845e3-e624-4f6f-8980-488de8b55218 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:44.946736 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc845e3-e624-4f6f-8980-488de8b55218 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:44.947011 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc845e3-e624-4f6f-8980-488de8b55218 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:44.953863 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc845e3-e624-4f6f-8980-488de8b55218 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:44.955842 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc845e3-e624-4f6f-8980-488de8b55218 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:44.967199 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application [None req-acc845e3-e624-4f6f-8980-488de8b55218 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 21:42:44.967199 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:44.967199 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:42:44.967199 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:42:44.967199 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:42:44.967199 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:42:44.967199 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:42:44.967199 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:42:44.967199 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:42:44.967199 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:42:44.967199 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:42:44.967199 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:42:44.967199 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 21:42:44.967199 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 21:42:44.967199 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 21:42:44.968118 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 21:42:44.968118 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:42:44.968118 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:42:44.968118 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:42:44.968118 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:42:44.968118 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:42:44.968118 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:42:44.968118 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:42:44.968118 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application with Lock( Aug 18 21:42:44.968118 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:42:44.968118 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:42:44.968118 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:42:44.968118 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:42:44.968118 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:42:44.968118 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:42:44.968118 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:42:44.968118 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:42:44.969421 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 21:42:44.969421 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 21:42:44.969421 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 21:42:44.969421 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 21:42:44.969421 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 21:42:44.969421 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 21:42:44.969421 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 21:42:44.969421 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:42:44.969421 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 497/987] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Aug 18 21:42:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 21:42:44.974753 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18ebef5-1ac7-4d40-b78c-5c7e13301717 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:45.076202 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:45.079343 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18ebef5-1ac7-4d40-b78c-5c7e13301717 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:45.126583 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e3f5b1-86a4-441e-b1d3-328b4a0a74ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:45.127284 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e3f5b1-86a4-441e-b1d3-328b4a0a74ac None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:45.127635 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e3f5b1-86a4-441e-b1d3-328b4a0a74ac None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:45.127977 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e3f5b1-86a4-441e-b1d3-328b4a0a74ac None admin] PATH_INFO: `/v3/projects` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:45.128836 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e3f5b1-86a4-441e-b1d3-328b4a0a74ac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:45.129259 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e3f5b1-86a4-441e-b1d3-328b4a0a74ac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:45.130790 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e3f5b1-86a4-441e-b1d3-328b4a0a74ac None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:45.143688 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 491/988] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Aug 18 21:42:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:42:45.150165 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc845e3-e624-4f6f-8980-488de8b55218 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:45.184051 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:45.255553 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc845e3-e624-4f6f-8980-488de8b55218 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:45.298309 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8e430e-c4d5-4d4f-a9f8-b63f5f99debb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:45.299082 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8e430e-c4d5-4d4f-a9f8-b63f5f99debb None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:45.299368 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8e430e-c4d5-4d4f-a9f8-b63f5f99debb None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:45.299643 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8e430e-c4d5-4d4f-a9f8-b63f5f99debb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:45.300380 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8e430e-c4d5-4d4f-a9f8-b63f5f99debb None admin] RBAC: Adding query filter params (role.id=ac9ba398413d4794800e1f777b75c1df, scope.project.id=4b54801b90484d689034f838f85fc0a4, user.id=f079aa6ed5594a4982172b51b93ac54f) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:45.300786 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8e430e-c4d5-4d4f-a9f8-b63f5f99debb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:45.302222 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8e430e-c4d5-4d4f-a9f8-b63f5f99debb None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:45.316636 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 498/989] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Aug 18 21:42:45 2022] GET /identity/v3/role_assignments?user.id=f079aa6ed5594a4982172b51b93ac54f&scope.project.id=4b54801b90484d689034f838f85fc0a4&role.id=ac9ba398413d4794800e1f777b75c1df => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:42:46.653639 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68797554-9982-43fb-abcc-45192e26e5fe None None] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:46.654162 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68797554-9982-43fb-abcc-45192e26e5fe None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:46.654241 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68797554-9982-43fb-abcc-45192e26e5fe None None] PATH_INFO: `/` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:46.655553 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 492/990] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:42:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:42:46.661497 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304ff979-7a22-47b8-b3e4-8e2130bbc133 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:46.661930 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304ff979-7a22-47b8-b3e4-8e2130bbc133 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:46.662103 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304ff979-7a22-47b8-b3e4-8e2130bbc133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:46.682366 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-304ff979-7a22-47b8-b3e4-8e2130bbc133 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:42:46.683565 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-304ff979-7a22-47b8-b3e4-8e2130bbc133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:42:46.752702 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 499/991] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:42:46 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 21:42:46.884673 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d68093-17f0-449d-9ce2-c95c19a1bb51 None None] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:46.885111 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d68093-17f0-449d-9ce2-c95c19a1bb51 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:46.885573 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d68093-17f0-449d-9ce2-c95c19a1bb51 None None] PATH_INFO: `/` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:46.888345 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 493/992] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:42:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:42:46.894384 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaaa68e-8206-4d92-af72-8451e90bd22e None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:46.894670 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaaa68e-8206-4d92-af72-8451e90bd22e None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:46.894945 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaaa68e-8206-4d92-af72-8451e90bd22e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:46.919383 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-4eaaa68e-8206-4d92-af72-8451e90bd22e None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:42:46.920510 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-4eaaa68e-8206-4d92-af72-8451e90bd22e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:42:46.943700 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:46.996843 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 500/993] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:42:46 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 21:42:47.042199 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d68093-17f0-449d-9ce2-c95c19a1bb51 None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:47.162127 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d68093-17f0-449d-9ce2-c95c19a1bb51 None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:47.201914 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac0d68a-9593-4e26-9281-a497ad05cacd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:47.202444 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac0d68a-9593-4e26-9281-a497ad05cacd None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:47.202723 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac0d68a-9593-4e26-9281-a497ad05cacd None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:47.202996 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac0d68a-9593-4e26-9281-a497ad05cacd None admin] PATH_INFO: `/v3/services/compute` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:47.203584 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac0d68a-9593-4e26-9281-a497ad05cacd None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:47.205300 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac0d68a-9593-4e26-9281-a497ad05cacd None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:47.216313 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application [None req-2ac0d68a-9593-4e26-9281-a497ad05cacd None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 18 21:42:47.216313 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:47.216313 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 21:42:47.216313 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 21:42:47.216313 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 21:42:47.216313 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 21:42:47.216313 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 21:42:47.216313 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 21:42:47.216313 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 18 21:42:47.216313 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:42:47.216313 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 21:42:47.216313 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:42:47.216313 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:47.216313 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:42:47.216313 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:42:47.216313 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:42:47.216313 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:42:47.217524 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:42:47.217524 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:42:47.217524 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:42:47.217524 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:42:47.217524 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:42:47.217524 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:42:47.217524 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 21:42:47.217524 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 21:42:47.217524 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 21:42:47.217524 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 21:42:47.217524 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:42:47.217524 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:42:47.217524 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:42:47.217524 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:42:47.217524 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:42:47.217524 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:42:47.218532 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:42:47.218532 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application with Lock( Aug 18 21:42:47.218532 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:42:47.218532 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:42:47.218532 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:42:47.218532 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:42:47.218532 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:42:47.218532 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:42:47.218532 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:42:47.218532 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:42:47.218532 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 21:42:47.218532 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 21:42:47.218532 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 18 21:42:47.218532 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:42:47.218532 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 494/994] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Aug 18 21:42:47 2022] GET /identity/v3/services/compute => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 21:42:47.225418 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaaa68e-8206-4d92-af72-8451e90bd22e None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:47.301504 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac0d68a-9593-4e26-9281-a497ad05cacd None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:47.332966 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:47.352543 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaaa68e-8206-4d92-af72-8451e90bd22e None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:47.388067 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394fe28e-1bf8-41b6-8e64-9ed4837cb2b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:47.389305 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394fe28e-1bf8-41b6-8e64-9ed4837cb2b7 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:47.389581 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394fe28e-1bf8-41b6-8e64-9ed4837cb2b7 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:47.389850 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394fe28e-1bf8-41b6-8e64-9ed4837cb2b7 None admin] PATH_INFO: `/v3/services` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:47.390486 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394fe28e-1bf8-41b6-8e64-9ed4837cb2b7 None admin] RBAC: Adding query filter params (name=compute) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:47.390785 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394fe28e-1bf8-41b6-8e64-9ed4837cb2b7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:47.393001 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394fe28e-1bf8-41b6-8e64-9ed4837cb2b7 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:47.398023 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 501/995] 10.222.0.27 () {56 vars in 1112 bytes} [Thu Aug 18 21:42:47 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:42:47.399254 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f14f718-2e7e-4940-8e7f-0b33294b2d44 None None] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:47.399457 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f14f718-2e7e-4940-8e7f-0b33294b2d44 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:47.399755 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f14f718-2e7e-4940-8e7f-0b33294b2d44 None None] PATH_INFO: `/` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:47.401104 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 502/996] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:42:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:42:47.403388 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f14f718-2e7e-4940-8e7f-0b33294b2d44 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:47.416302 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac0d68a-9593-4e26-9281-a497ad05cacd None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:47.422487 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:47.453462 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970baf25-207e-472e-a857-5b5355113de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:47.454959 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970baf25-207e-472e-a857-5b5355113de1 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:47.455457 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970baf25-207e-472e-a857-5b5355113de1 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:47.455835 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970baf25-207e-472e-a857-5b5355113de1 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:47.456419 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970baf25-207e-472e-a857-5b5355113de1 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:47.457800 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970baf25-207e-472e-a857-5b5355113de1 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:47.468427 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application [None req-970baf25-207e-472e-a857-5b5355113de1 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 18 21:42:47.468427 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:47.468427 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 21:42:47.468427 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 21:42:47.468427 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 21:42:47.468427 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 21:42:47.468427 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 21:42:47.468427 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 21:42:47.468427 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 18 21:42:47.468427 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:42:47.468427 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 21:42:47.468427 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:42:47.468427 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:47.468427 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:42:47.468427 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:42:47.468427 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:42:47.468427 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:42:47.470297 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:42:47.470297 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:42:47.470297 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:42:47.470297 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:42:47.470297 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:42:47.470297 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:42:47.470297 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 21:42:47.470297 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 21:42:47.470297 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 21:42:47.470297 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 21:42:47.470297 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:42:47.470297 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:42:47.470297 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:42:47.470297 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:42:47.470297 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:42:47.470297 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:42:47.471251 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:42:47.471251 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application with Lock( Aug 18 21:42:47.471251 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:42:47.471251 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:42:47.471251 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:42:47.471251 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:42:47.471251 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:42:47.471251 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:42:47.471251 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:42:47.471251 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:42:47.471251 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 21:42:47.471251 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 21:42:47.471251 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 18 21:42:47.471251 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:42:47.471251 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 495/997] 10.222.0.27 () {56 vars in 1126 bytes} [Thu Aug 18 21:42:47 2022] GET /identity/v3/services/object-store => generated 93 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:42:47.472058 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82be96d4-ad3d-47f6-9f7b-81dfd58c6d67 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:47.472415 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82be96d4-ad3d-47f6-9f7b-81dfd58c6d67 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:47.472822 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82be96d4-ad3d-47f6-9f7b-81dfd58c6d67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:47.492873 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-82be96d4-ad3d-47f6-9f7b-81dfd58c6d67 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:42:47.494384 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-82be96d4-ad3d-47f6-9f7b-81dfd58c6d67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:42:47.520409 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f14f718-2e7e-4940-8e7f-0b33294b2d44 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:47.561970 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02714bc4-9dce-45b2-89dc-939e5fb35836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:47.562575 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02714bc4-9dce-45b2-89dc-939e5fb35836 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:47.562856 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02714bc4-9dce-45b2-89dc-939e5fb35836 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:47.563132 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02714bc4-9dce-45b2-89dc-939e5fb35836 None admin] PATH_INFO: `/v3/services` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:47.564058 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02714bc4-9dce-45b2-89dc-939e5fb35836 None admin] RBAC: Adding query filter params (type=compute) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:47.564363 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02714bc4-9dce-45b2-89dc-939e5fb35836 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:47.565200 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 496/998] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:42:47 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 21:42:47.565791 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02714bc4-9dce-45b2-89dc-939e5fb35836 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:47.566041 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82be96d4-ad3d-47f6-9f7b-81dfd58c6d67 None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:47.577199 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 503/999] 10.222.0.27 () {56 vars in 1112 bytes} [Thu Aug 18 21:42:47 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 21:42:47.578427 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02714bc4-9dce-45b2-89dc-939e5fb35836 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:47.589594 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:47.669454 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:47.677118 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82be96d4-ad3d-47f6-9f7b-81dfd58c6d67 None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:47.691567 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02714bc4-9dce-45b2-89dc-939e5fb35836 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:47.713489 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5504a59-83aa-4233-a3b8-5a1180e542c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:47.713999 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5504a59-83aa-4233-a3b8-5a1180e542c0 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:47.714276 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5504a59-83aa-4233-a3b8-5a1180e542c0 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:47.714552 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5504a59-83aa-4233-a3b8-5a1180e542c0 None admin] PATH_INFO: `/v3/services` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:47.715179 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5504a59-83aa-4233-a3b8-5a1180e542c0 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:47.715474 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5504a59-83aa-4233-a3b8-5a1180e542c0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:47.716874 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5504a59-83aa-4233-a3b8-5a1180e542c0 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:47.722665 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 497/1000] 10.222.0.27 () {56 vars in 1122 bytes} [Thu Aug 18 21:42:47 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:42:47.729169 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5504a59-83aa-4233-a3b8-5a1180e542c0 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:47.737635 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52061ad8-3041-4942-a0c5-f5abb7f6d1c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:47.738254 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52061ad8-3041-4942-a0c5-f5abb7f6d1c8 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:47.738533 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52061ad8-3041-4942-a0c5-f5abb7f6d1c8 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:47.738813 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52061ad8-3041-4942-a0c5-f5abb7f6d1c8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:47.739515 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52061ad8-3041-4942-a0c5-f5abb7f6d1c8 None admin] RBAC: Adding query filter params (interface=public, service_id=42fab96374d84d05ae3d8facc5ace3f7, region_id=RegionOne) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:47.739823 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52061ad8-3041-4942-a0c5-f5abb7f6d1c8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:47.741247 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52061ad8-3041-4942-a0c5-f5abb7f6d1c8 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:47.746683 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 504/1001] 10.222.0.27 () {56 vars in 1251 bytes} [Thu Aug 18 21:42:47 2022] GET /identity/v3/endpoints?service_id=42fab96374d84d05ae3d8facc5ace3f7&interface=public®ion_id=RegionOne => generated 194 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 21:42:47.752758 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52061ad8-3041-4942-a0c5-f5abb7f6d1c8 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:47.824332 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:47.845778 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5504a59-83aa-4233-a3b8-5a1180e542c0 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:47.877317 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52061ad8-3041-4942-a0c5-f5abb7f6d1c8 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:47.879987 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd339751-0e37-420e-83b6-f758b13823da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:47.880615 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd339751-0e37-420e-83b6-f758b13823da None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:47.880890 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd339751-0e37-420e-83b6-f758b13823da None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:47.881157 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd339751-0e37-420e-83b6-f758b13823da None admin] PATH_INFO: `/v3/services` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:47.881775 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd339751-0e37-420e-83b6-f758b13823da None admin] RBAC: Adding query filter params (type=object-store) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:47.882072 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd339751-0e37-420e-83b6-f758b13823da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:47.883432 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd339751-0e37-420e-83b6-f758b13823da None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:47.888248 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 498/1002] 10.222.0.27 () {56 vars in 1122 bytes} [Thu Aug 18 21:42:47 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 21:42:47.889057 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd339751-0e37-420e-83b6-f758b13823da None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:47.915078 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfa5b83-919a-48b9-be3c-487451c6083a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:47.915689 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfa5b83-919a-48b9-be3c-487451c6083a None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:47.915964 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfa5b83-919a-48b9-be3c-487451c6083a None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:47.916235 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfa5b83-919a-48b9-be3c-487451c6083a None admin] PATH_INFO: `/v3/services` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:47.916873 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfa5b83-919a-48b9-be3c-487451c6083a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:47.918789 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfa5b83-919a-48b9-be3c-487451c6083a None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:47.926976 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 505/1003] 10.222.0.27 () {56 vars in 1087 bytes} [Thu Aug 18 21:42:47 2022] GET /identity/v3/services => generated 1727 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:42:47.927601 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfa5b83-919a-48b9-be3c-487451c6083a None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:47.941706 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:48.018800 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd339751-0e37-420e-83b6-f758b13823da None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:48.047132 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfa5b83-919a-48b9-be3c-487451c6083a None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:48.062539 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b96fb1-3a5b-4465-bab2-a73c6ea9ccc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:48.064444 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b96fb1-3a5b-4465-bab2-a73c6ea9ccc0 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:48.064755 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b96fb1-3a5b-4465-bab2-a73c6ea9ccc0 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:48.065351 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b96fb1-3a5b-4465-bab2-a73c6ea9ccc0 None admin] PATH_INFO: `/v3/services/image` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:48.066261 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b96fb1-3a5b-4465-bab2-a73c6ea9ccc0 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:48.067646 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b96fb1-3a5b-4465-bab2-a73c6ea9ccc0 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:48.077497 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application [None req-c9b96fb1-3a5b-4465-bab2-a73c6ea9ccc0 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 18 21:42:48.077497 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:48.077497 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 21:42:48.077497 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 21:42:48.077497 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 21:42:48.077497 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 21:42:48.077497 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 21:42:48.077497 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 21:42:48.077497 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 18 21:42:48.077497 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:42:48.077497 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 21:42:48.077497 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:42:48.077497 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:48.077497 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:42:48.077497 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:42:48.077497 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:42:48.077497 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:42:48.078590 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:42:48.078590 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:42:48.078590 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:42:48.078590 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:42:48.078590 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:42:48.078590 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:42:48.078590 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 21:42:48.078590 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 21:42:48.078590 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 21:42:48.078590 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 21:42:48.078590 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:42:48.078590 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:42:48.078590 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:42:48.078590 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:42:48.078590 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:42:48.078590 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:42:48.079723 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:42:48.079723 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application with Lock( Aug 18 21:42:48.079723 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:42:48.079723 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:42:48.079723 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:42:48.079723 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:42:48.079723 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:42:48.079723 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:42:48.079723 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:42:48.079723 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:42:48.079723 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 21:42:48.079723 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 21:42:48.079723 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 18 21:42:48.079723 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:42:48.079723 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 499/1004] 10.222.0.27 () {56 vars in 1105 bytes} [Thu Aug 18 21:42:47 2022] GET /identity/v3/services/image => generated 86 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:42:48.086675 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b96fb1-3a5b-4465-bab2-a73c6ea9ccc0 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:48.093187 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68afd622-125e-4393-82d6-d698284fcbab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:48.094220 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68afd622-125e-4393-82d6-d698284fcbab None admin] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:48.094220 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68afd622-125e-4393-82d6-d698284fcbab None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:48.094421 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68afd622-125e-4393-82d6-d698284fcbab None admin] PATH_INFO: `/v3/endpoints` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:48.095676 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68afd622-125e-4393-82d6-d698284fcbab None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:48.097232 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68afd622-125e-4393-82d6-d698284fcbab None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:48.103578 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:48.182505 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 506/1005] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 18 21:42:47 2022] POST /identity/v3/endpoints => generated 325 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:42:48.203222 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b96fb1-3a5b-4465-bab2-a73c6ea9ccc0 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:48.288786 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033eac0c-5dec-44d0-b7fa-9fc012277591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:48.289402 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033eac0c-5dec-44d0-b7fa-9fc012277591 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:48.289678 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033eac0c-5dec-44d0-b7fa-9fc012277591 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:48.289950 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033eac0c-5dec-44d0-b7fa-9fc012277591 None admin] PATH_INFO: `/v3/services` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:48.290640 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033eac0c-5dec-44d0-b7fa-9fc012277591 None admin] RBAC: Adding query filter params (name=image) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:48.290944 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033eac0c-5dec-44d0-b7fa-9fc012277591 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:48.292672 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033eac0c-5dec-44d0-b7fa-9fc012277591 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:48.298892 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 500/1006] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 18 21:42:48 2022] GET /identity/v3/services?name=image => generated 122 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 21:42:48.308699 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68afd622-125e-4393-82d6-d698284fcbab None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:48.400134 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:48.434947 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68afd622-125e-4393-82d6-d698284fcbab None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:48.472527 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b4b7f1-7775-424e-bb7f-cb6ff8798a3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:48.473179 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b4b7f1-7775-424e-bb7f-cb6ff8798a3e None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:48.473458 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b4b7f1-7775-424e-bb7f-cb6ff8798a3e None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:48.473727 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b4b7f1-7775-424e-bb7f-cb6ff8798a3e None admin] PATH_INFO: `/v3/services` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:48.474364 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b4b7f1-7775-424e-bb7f-cb6ff8798a3e None admin] RBAC: Adding query filter params (type=image) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:48.474662 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b4b7f1-7775-424e-bb7f-cb6ff8798a3e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:48.476051 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b4b7f1-7775-424e-bb7f-cb6ff8798a3e None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:48.481161 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 507/1007] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 18 21:42:48 2022] GET /identity/v3/services?type=image => generated 122 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:42:49.951081 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8da81cc-3567-4a55-bfd2-5cf999f8415e None None] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:49.951631 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8da81cc-3567-4a55-bfd2-5cf999f8415e None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:49.951631 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8da81cc-3567-4a55-bfd2-5cf999f8415e None None] PATH_INFO: `/` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:49.953013 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 501/1008] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:42:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:42:49.958699 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0349be-92dd-4870-9dfb-e2739442ce93 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:49.959132 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0349be-92dd-4870-9dfb-e2739442ce93 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:49.959224 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0349be-92dd-4870-9dfb-e2739442ce93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:49.977744 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-3a0349be-92dd-4870-9dfb-e2739442ce93 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:42:49.978925 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-3a0349be-92dd-4870-9dfb-e2739442ce93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:42:50.043680 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 508/1009] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:42:49 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 21:42:50.204571 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025d131b-ccd3-4ae9-a667-99a7555c23b5 None None] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:50.204990 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025d131b-ccd3-4ae9-a667-99a7555c23b5 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:50.205924 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025d131b-ccd3-4ae9-a667-99a7555c23b5 None None] PATH_INFO: `/` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:50.207810 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 502/1010] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:42:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:42:50.212796 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a90f607-05da-4460-80e0-dce535916824 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:50.213087 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a90f607-05da-4460-80e0-dce535916824 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:50.213365 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a90f607-05da-4460-80e0-dce535916824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:50.231240 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-5a90f607-05da-4460-80e0-dce535916824 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:42:50.232429 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-5a90f607-05da-4460-80e0-dce535916824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:42:50.301163 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:50.310251 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 509/1011] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:42:50 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 21:42:50.310639 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025d131b-ccd3-4ae9-a667-99a7555c23b5 None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:50.382655 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:50.414849 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025d131b-ccd3-4ae9-a667-99a7555c23b5 None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:50.449407 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3ac5ff-afa6-4634-93f8-46c13889f618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:50.450047 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3ac5ff-afa6-4634-93f8-46c13889f618 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:50.450326 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3ac5ff-afa6-4634-93f8-46c13889f618 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:50.450593 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3ac5ff-afa6-4634-93f8-46c13889f618 None admin] PATH_INFO: `/v3/services/compute` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:50.451159 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3ac5ff-afa6-4634-93f8-46c13889f618 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:50.452500 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3ac5ff-afa6-4634-93f8-46c13889f618 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:50.462046 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application [None req-8a3ac5ff-afa6-4634-93f8-46c13889f618 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 18 21:42:50.462046 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:50.462046 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 21:42:50.462046 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 21:42:50.462046 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 21:42:50.462046 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 21:42:50.462046 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 21:42:50.462046 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 21:42:50.462046 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 18 21:42:50.462046 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:42:50.462046 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 21:42:50.462046 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:42:50.462046 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:50.462046 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:42:50.462046 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:42:50.462046 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:42:50.462046 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:42:50.463096 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:42:50.463096 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:42:50.463096 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:42:50.463096 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:42:50.463096 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:42:50.463096 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:42:50.463096 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 21:42:50.463096 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 21:42:50.463096 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 21:42:50.463096 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 21:42:50.463096 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:42:50.463096 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:42:50.463096 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:42:50.463096 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:42:50.463096 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:42:50.463096 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:42:50.464478 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:42:50.464478 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application with Lock( Aug 18 21:42:50.464478 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:42:50.464478 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:42:50.464478 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:42:50.464478 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:42:50.464478 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:42:50.464478 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:42:50.464478 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:42:50.464478 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:42:50.464478 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 21:42:50.464478 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 21:42:50.464478 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 18 21:42:50.464478 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:42:50.467918 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 503/1012] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Aug 18 21:42:50 2022] GET /identity/v3/services/compute => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 21:42:50.468102 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bc6475-e68e-44fb-9b13-f12dcfbe7606 None None] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:50.468385 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bc6475-e68e-44fb-9b13-f12dcfbe7606 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:50.468543 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3ac5ff-afa6-4634-93f8-46c13889f618 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:50.468679 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bc6475-e68e-44fb-9b13-f12dcfbe7606 None None] PATH_INFO: `/` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:50.471106 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 510/1013] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:42:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 21:42:50.475820 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5e5952-e08a-4239-8e18-1e839ca5e56c None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:50.476104 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5e5952-e08a-4239-8e18-1e839ca5e56c None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:50.476375 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5e5952-e08a-4239-8e18-1e839ca5e56c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:50.494931 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-4f5e5952-e08a-4239-8e18-1e839ca5e56c None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:42:50.496111 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-4f5e5952-e08a-4239-8e18-1e839ca5e56c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:42:50.571339 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 511/1014] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:42:50 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 21:42:50.576650 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3ac5ff-afa6-4634-93f8-46c13889f618 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:50.578097 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5e5952-e08a-4239-8e18-1e839ca5e56c None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:50.613341 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa79245-0527-46c1-80f2-0d8dc08ad425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:50.613937 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa79245-0527-46c1-80f2-0d8dc08ad425 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:50.614217 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa79245-0527-46c1-80f2-0d8dc08ad425 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:50.614491 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa79245-0527-46c1-80f2-0d8dc08ad425 None admin] PATH_INFO: `/v3/services` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:50.615113 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa79245-0527-46c1-80f2-0d8dc08ad425 None admin] RBAC: Adding query filter params (name=compute) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:50.615414 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa79245-0527-46c1-80f2-0d8dc08ad425 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:50.616805 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa79245-0527-46c1-80f2-0d8dc08ad425 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:50.617996 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:50.622684 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 504/1015] 10.222.0.27 () {56 vars in 1112 bytes} [Thu Aug 18 21:42:50 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:42:50.628627 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa79245-0527-46c1-80f2-0d8dc08ad425 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:50.686806 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5e5952-e08a-4239-8e18-1e839ca5e56c None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:50.714748 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:50.726040 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b7a4dc-9761-4fcb-af7e-0dfd954617b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:50.726679 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b7a4dc-9761-4fcb-af7e-0dfd954617b2 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:50.726961 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b7a4dc-9761-4fcb-af7e-0dfd954617b2 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:50.727247 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b7a4dc-9761-4fcb-af7e-0dfd954617b2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:50.728355 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b7a4dc-9761-4fcb-af7e-0dfd954617b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:50.729828 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b7a4dc-9761-4fcb-af7e-0dfd954617b2 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:50.731405 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 512/1016] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 18 21:42:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 21:42:50.738035 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b7a4dc-9761-4fcb-af7e-0dfd954617b2 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:50.743767 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa79245-0527-46c1-80f2-0d8dc08ad425 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:50.785380 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f73742-6b61-42e5-ad4c-7a9b9977ba4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:50.786258 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f73742-6b61-42e5-ad4c-7a9b9977ba4c None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:50.786858 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f73742-6b61-42e5-ad4c-7a9b9977ba4c None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:50.787137 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f73742-6b61-42e5-ad4c-7a9b9977ba4c None admin] PATH_INFO: `/v3/services` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:50.787920 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f73742-6b61-42e5-ad4c-7a9b9977ba4c None admin] RBAC: Adding query filter params (type=compute) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:50.788224 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f73742-6b61-42e5-ad4c-7a9b9977ba4c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:50.789625 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f73742-6b61-42e5-ad4c-7a9b9977ba4c None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:50.799399 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 505/1017] 10.222.0.27 () {56 vars in 1112 bytes} [Thu Aug 18 21:42:50 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:42:50.800377 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f73742-6b61-42e5-ad4c-7a9b9977ba4c None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:50.851497 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b7a4dc-9761-4fcb-af7e-0dfd954617b2 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:50.864166 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:50.885520 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb2f7c6-aa83-4510-afb2-c1f1e5ee600e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:50.886119 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb2f7c6-aa83-4510-afb2-c1f1e5ee600e None admin] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:50.886398 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb2f7c6-aa83-4510-afb2-c1f1e5ee600e None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:50.886669 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb2f7c6-aa83-4510-afb2-c1f1e5ee600e None admin] PATH_INFO: `/v3/projects` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:50.887300 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb2f7c6-aa83-4510-afb2-c1f1e5ee600e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:50.888818 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb2f7c6-aa83-4510-afb2-c1f1e5ee600e None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:50.903156 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f73742-6b61-42e5-ad4c-7a9b9977ba4c None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:50.936268 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be71f68d-7d7c-432b-8de2-d2fa41531458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:50.936912 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be71f68d-7d7c-432b-8de2-d2fa41531458 None admin] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:50.937189 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be71f68d-7d7c-432b-8de2-d2fa41531458 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:50.937455 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be71f68d-7d7c-432b-8de2-d2fa41531458 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:50.938096 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be71f68d-7d7c-432b-8de2-d2fa41531458 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:50.939592 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be71f68d-7d7c-432b-8de2-d2fa41531458 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:50.983054 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 513/1018] 10.222.0.27 () {60 vars in 1141 bytes} [Thu Aug 18 21:42:50 2022] POST /identity/v3/projects => generated 311 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 21:42:50.983796 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb2f7c6-aa83-4510-afb2-c1f1e5ee600e None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:51.011122 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 506/1019] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 18 21:42:50 2022] POST /identity/v3/endpoints => generated 334 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:42:51.054673 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:51.154388 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb2f7c6-aa83-4510-afb2-c1f1e5ee600e None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:51.214863 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfae43a6-469d-4067-bde1-ef23c4c801b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:51.215477 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfae43a6-469d-4067-bde1-ef23c4c801b4 None admin] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:51.215752 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfae43a6-469d-4067-bde1-ef23c4c801b4 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:51.216031 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfae43a6-469d-4067-bde1-ef23c4c801b4 None admin] PATH_INFO: `/v3/services` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:51.216917 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfae43a6-469d-4067-bde1-ef23c4c801b4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:51.218393 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfae43a6-469d-4067-bde1-ef23c4c801b4 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:51.325817 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 514/1020] 10.222.0.27 () {60 vars in 1141 bytes} [Thu Aug 18 21:42:50 2022] POST /identity/v3/services => generated 242 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:42:53.009752 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972c84c5-a53a-479f-a4bb-d7d7997f1e4c None None] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:53.010281 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972c84c5-a53a-479f-a4bb-d7d7997f1e4c None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:53.010281 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972c84c5-a53a-479f-a4bb-d7d7997f1e4c None None] PATH_INFO: `/` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:53.011779 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 507/1021] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:42:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:42:53.017549 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d747b9-4ca4-4592-bbf2-d754553e5c5e None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:53.018218 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d747b9-4ca4-4592-bbf2-d754553e5c5e None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:53.018218 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d747b9-4ca4-4592-bbf2-d754553e5c5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:53.036655 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-c5d747b9-4ca4-4592-bbf2-d754553e5c5e None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:42:53.037842 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-c5d747b9-4ca4-4592-bbf2-d754553e5c5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:42:53.080577 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c8ee56-6655-4ce9-ae1d-3aca2f9e27f6 None None] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:53.080902 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c8ee56-6655-4ce9-ae1d-3aca2f9e27f6 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:53.081177 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c8ee56-6655-4ce9-ae1d-3aca2f9e27f6 None None] PATH_INFO: `/` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:53.082664 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 508/1022] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:42:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 21:42:53.087355 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c73a72-a12d-45ed-99f5-f775f594a400 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:53.087639 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c73a72-a12d-45ed-99f5-f775f594a400 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:53.087918 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c73a72-a12d-45ed-99f5-f775f594a400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:53.106233 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-a2c73a72-a12d-45ed-99f5-f775f594a400 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:42:53.107418 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-a2c73a72-a12d-45ed-99f5-f775f594a400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:42:53.116186 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 515/1023] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:42:53 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 21:42:53.180201 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 509/1024] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:42:53 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 21:42:53.264959 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf19d17-ac3d-48f8-91b5-fc451da451c4 None None] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:53.265152 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf19d17-ac3d-48f8-91b5-fc451da451c4 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:53.265426 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf19d17-ac3d-48f8-91b5-fc451da451c4 None None] PATH_INFO: `/` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:53.268641 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 516/1025] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:42:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:42:53.272873 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d81975c-cccf-4c16-a42a-82ae0184f436 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:53.273160 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d81975c-cccf-4c16-a42a-82ae0184f436 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:53.273499 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d81975c-cccf-4c16-a42a-82ae0184f436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:53.292091 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-3d81975c-cccf-4c16-a42a-82ae0184f436 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:42:53.293313 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-3d81975c-cccf-4c16-a42a-82ae0184f436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:42:53.338115 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:53.367205 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 510/1026] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:42:53 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 21:42:53.399822 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf19d17-ac3d-48f8-91b5-fc451da451c4 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:53.428502 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:53.459873 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d81975c-cccf-4c16-a42a-82ae0184f436 None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:53.505155 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf19d17-ac3d-48f8-91b5-fc451da451c4 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:53.539302 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c1b2a3-0c07-4215-8992-31af0e4184af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:53.539841 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c1b2a3-0c07-4215-8992-31af0e4184af None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:53.540125 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c1b2a3-0c07-4215-8992-31af0e4184af None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:53.540395 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c1b2a3-0c07-4215-8992-31af0e4184af None admin] PATH_INFO: `/v3/domains/default` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:53.542319 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c1b2a3-0c07-4215-8992-31af0e4184af None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:53.543646 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c1b2a3-0c07-4215-8992-31af0e4184af None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:53.545275 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 517/1027] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 18 21:42:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:42:53.550974 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c1b2a3-0c07-4215-8992-31af0e4184af None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:53.576162 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d81975c-cccf-4c16-a42a-82ae0184f436 None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:53.613546 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a51f997-43b4-4504-b008-7d5c84261af4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:53.614183 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a51f997-43b4-4504-b008-7d5c84261af4 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:53.614459 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a51f997-43b4-4504-b008-7d5c84261af4 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:53.614730 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a51f997-43b4-4504-b008-7d5c84261af4 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:53.626443 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a51f997-43b4-4504-b008-7d5c84261af4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:42:53.631295 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application [None req-2a51f997-43b4-4504-b008-7d5c84261af4 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 18 21:42:53.631295 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:53.631295 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:42:53.631295 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:42:53.631295 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:42:53.631295 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:42:53.631295 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:42:53.631295 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:42:53.631295 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:42:53.631295 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:42:53.631295 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:42:53.631295 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:42:53.631295 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:42:53.631295 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:42:53.631295 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:42:53.631295 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:42:53.632245 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:42:53.632245 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:42:53.632245 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:42:53.632245 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:42:53.632245 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:42:53.632245 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:42:53.632245 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:42:53.632245 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:42:53.632245 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:42:53.632245 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:42:53.632245 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:42:53.632245 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application with Lock( Aug 18 21:42:53.632245 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:42:53.632245 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:42:53.632245 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:42:53.632245 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:42:53.633343 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:42:53.633343 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:42:53.633343 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:42:53.633343 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:42:53.633343 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:42:53.633343 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:42:53.633343 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:42:53.633343 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:42:53.633343 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:42:53.633343 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:42:53.633343 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 18 21:42:53.633343 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:42:53.637410 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 511/1028] 10.222.0.27 () {56 vars in 1120 bytes} [Thu Aug 18 21:42:53 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:42:53.638110 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a51f997-43b4-4504-b008-7d5c84261af4 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:53.653797 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:53.660742 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c1b2a3-0c07-4215-8992-31af0e4184af None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:53.679889 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:53.695783 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2b96f1-84c5-49a4-9190-501a374a878a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:53.696390 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2b96f1-84c5-49a4-9190-501a374a878a None admin] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:53.696721 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2b96f1-84c5-49a4-9190-501a374a878a None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:53.696956 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2b96f1-84c5-49a4-9190-501a374a878a None admin] PATH_INFO: `/v3/users` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:53.697592 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2b96f1-84c5-49a4-9190-501a374a878a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:53.699011 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2b96f1-84c5-49a4-9190-501a374a878a None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:53.739563 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a51f997-43b4-4504-b008-7d5c84261af4 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:53.773369 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213eab78-200a-416d-a63a-42dddbb0d14f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:53.773966 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213eab78-200a-416d-a63a-42dddbb0d14f None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:53.774240 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213eab78-200a-416d-a63a-42dddbb0d14f None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:53.774513 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213eab78-200a-416d-a63a-42dddbb0d14f None admin] PATH_INFO: `/v3/roles` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:53.775240 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213eab78-200a-416d-a63a-42dddbb0d14f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:53.775467 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213eab78-200a-416d-a63a-42dddbb0d14f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:53.776844 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213eab78-200a-416d-a63a-42dddbb0d14f None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:53.784876 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 512/1029] 10.222.0.27 () {56 vars in 1115 bytes} [Thu Aug 18 21:42:53 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:42:53.785757 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213eab78-200a-416d-a63a-42dddbb0d14f None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:53.787586 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 518/1030] 10.222.0.27 () {60 vars in 1132 bytes} [Thu Aug 18 21:42:53 2022] POST /identity/v3/users => generated 285 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 21:42:53.790793 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2b96f1-84c5-49a4-9190-501a374a878a None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:53.905335 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:53.908217 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2b96f1-84c5-49a4-9190-501a374a878a None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:53.910845 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213eab78-200a-416d-a63a-42dddbb0d14f None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:53.951245 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bda4b5f-94ca-4c75-907f-857e5040ff65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:53.951887 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bda4b5f-94ca-4c75-907f-857e5040ff65 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:53.952230 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bda4b5f-94ca-4c75-907f-857e5040ff65 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:53.952438 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bda4b5f-94ca-4c75-907f-857e5040ff65 None admin] PATH_INFO: `/v3/services/image` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:53.952896 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b715c56f-9c23-4a8e-885b-8b02f37a8ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:53.953107 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bda4b5f-94ca-4c75-907f-857e5040ff65 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:53.953535 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b715c56f-9c23-4a8e-885b-8b02f37a8ee2 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:53.953814 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b715c56f-9c23-4a8e-885b-8b02f37a8ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:53.954616 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b715c56f-9c23-4a8e-885b-8b02f37a8ee2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:53.954987 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bda4b5f-94ca-4c75-907f-857e5040ff65 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:53.965658 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application [None req-8bda4b5f-94ca-4c75-907f-857e5040ff65 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 18 21:42:53.965658 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:53.965658 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 21:42:53.965658 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 21:42:53.965658 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 21:42:53.965658 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 21:42:53.965658 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 21:42:53.965658 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 21:42:53.965658 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 18 21:42:53.965658 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:42:53.965658 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 21:42:53.965658 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:42:53.965658 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:53.965658 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:42:53.965658 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:42:53.965658 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:42:53.965658 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:42:53.966734 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:42:53.966734 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:42:53.966734 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:42:53.966734 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:42:53.966734 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:42:53.966734 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:42:53.966734 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 21:42:53.966734 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 21:42:53.966734 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 21:42:53.966734 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 21:42:53.966734 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:42:53.966734 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:42:53.966734 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:42:53.966734 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:42:53.966734 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:42:53.966734 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:42:53.967589 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:42:53.967589 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application with Lock( Aug 18 21:42:53.967589 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:42:53.967589 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:42:53.967589 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:42:53.967589 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:42:53.967589 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:42:53.967589 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:42:53.967589 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:42:53.967589 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:42:53.967589 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 21:42:53.967589 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 21:42:53.967589 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 18 21:42:53.967589 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:42:53.967589 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 513/1031] 10.222.0.27 () {56 vars in 1105 bytes} [Thu Aug 18 21:42:53 2022] GET /identity/v3/services/image => generated 86 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:42:53.968387 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b715c56f-9c23-4a8e-885b-8b02f37a8ee2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:53.968461 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b715c56f-9c23-4a8e-885b-8b02f37a8ee2 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:53.973570 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bda4b5f-94ca-4c75-907f-857e5040ff65 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:53.984634 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application [None req-b715c56f-9c23-4a8e-885b-8b02f37a8ee2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:42:53.984634 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:53.984634 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:42:53.984634 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:42:53.984634 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:42:53.984634 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:42:53.984634 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:42:53.984634 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:42:53.984634 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:42:53.984634 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:42:53.984634 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:42:53.984634 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:42:53.984634 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 21:42:53.984634 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 21:42:53.984634 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 21:42:53.984634 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 21:42:53.986067 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:42:53.986067 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:42:53.986067 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:42:53.986067 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:42:53.986067 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:42:53.986067 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:42:53.986067 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:42:53.986067 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application with Lock( Aug 18 21:42:53.986067 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:42:53.986067 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:42:53.986067 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:42:53.986067 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:42:53.986067 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:42:53.986067 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:42:53.986067 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:42:53.986067 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:42:53.986067 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 21:42:53.987351 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 21:42:53.987351 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:42:53.987351 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:42:53.988996 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 519/1032] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 18 21:42:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 21:42:53.995071 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b715c56f-9c23-4a8e-885b-8b02f37a8ee2 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:53.998963 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:54.092635 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bda4b5f-94ca-4c75-907f-857e5040ff65 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:54.106081 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b715c56f-9c23-4a8e-885b-8b02f37a8ee2 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:54.133031 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ce843b-13cc-4f0c-97a7-138900f7cdf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:54.133728 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ce843b-13cc-4f0c-97a7-138900f7cdf7 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:54.134078 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ce843b-13cc-4f0c-97a7-138900f7cdf7 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:54.134422 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ce843b-13cc-4f0c-97a7-138900f7cdf7 None admin] PATH_INFO: `/v3/services` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:54.135122 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ce843b-13cc-4f0c-97a7-138900f7cdf7 None admin] RBAC: Adding query filter params (name=image) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:54.135647 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ce843b-13cc-4f0c-97a7-138900f7cdf7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:54.136972 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ce843b-13cc-4f0c-97a7-138900f7cdf7 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:54.142437 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 514/1033] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 18 21:42:53 2022] GET /identity/v3/services?name=image => generated 122 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 21:42:54.144416 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab07c3e5-346b-4dc1-8366-c112986daed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:54.145229 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab07c3e5-346b-4dc1-8366-c112986daed0 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:54.145769 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab07c3e5-346b-4dc1-8366-c112986daed0 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:54.146205 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab07c3e5-346b-4dc1-8366-c112986daed0 None admin] PATH_INFO: `/v3/domains` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:54.147086 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab07c3e5-346b-4dc1-8366-c112986daed0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:54.147582 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab07c3e5-346b-4dc1-8366-c112986daed0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:54.148210 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ce843b-13cc-4f0c-97a7-138900f7cdf7 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:54.148991 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab07c3e5-346b-4dc1-8366-c112986daed0 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:54.164659 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 520/1034] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 18 21:42:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 21:42:54.168498 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab07c3e5-346b-4dc1-8366-c112986daed0 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:54.181607 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:54.235198 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:54.263308 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ce843b-13cc-4f0c-97a7-138900f7cdf7 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:54.279974 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab07c3e5-346b-4dc1-8366-c112986daed0 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:54.304108 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52fad19-f3a2-4cb2-b1b4-af9d95d59570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:54.304737 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52fad19-f3a2-4cb2-b1b4-af9d95d59570 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:54.305014 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52fad19-f3a2-4cb2-b1b4-af9d95d59570 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:54.305280 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52fad19-f3a2-4cb2-b1b4-af9d95d59570 None admin] PATH_INFO: `/v3/services` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:54.305906 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52fad19-f3a2-4cb2-b1b4-af9d95d59570 None admin] RBAC: Adding query filter params (type=image) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:54.306206 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52fad19-f3a2-4cb2-b1b4-af9d95d59570 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:54.308060 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52fad19-f3a2-4cb2-b1b4-af9d95d59570 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:54.313157 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 515/1035] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 18 21:42:54 2022] GET /identity/v3/services?type=image => generated 350 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:42:54.319652 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52fad19-f3a2-4cb2-b1b4-af9d95d59570 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:54.327840 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c5ebd1-275d-4eea-93fa-9d64be105e71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:54.328757 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c5ebd1-275d-4eea-93fa-9d64be105e71 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:54.329662 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c5ebd1-275d-4eea-93fa-9d64be105e71 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:54.329993 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c5ebd1-275d-4eea-93fa-9d64be105e71 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:54.337294 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c5ebd1-275d-4eea-93fa-9d64be105e71 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:54.338749 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c5ebd1-275d-4eea-93fa-9d64be105e71 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:54.350893 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application [None req-d5c5ebd1-275d-4eea-93fa-9d64be105e71 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 18 21:42:54.350893 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:54.350893 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:42:54.350893 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:42:54.350893 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:42:54.350893 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:42:54.350893 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:42:54.350893 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:42:54.350893 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:42:54.350893 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:42:54.350893 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:42:54.350893 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:42:54.350893 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 21:42:54.350893 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 21:42:54.350893 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 21:42:54.350893 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 21:42:54.351818 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:42:54.351818 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:42:54.351818 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 21:42:54.351818 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 21:42:54.351818 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 21:42:54.351818 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 21:42:54.351818 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:42:54.351818 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:42:54.351818 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:42:54.351818 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:42:54.351818 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:42:54.351818 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application with Lock( Aug 18 21:42:54.351818 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:42:54.351818 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:42:54.351818 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:42:54.351818 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:42:54.351818 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:42:54.351818 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:42:54.353236 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:42:54.353236 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:42:54.353236 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 21:42:54.353236 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 21:42:54.353236 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 21:42:54.353236 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 21:42:54.353236 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 21:42:54.353236 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 21:42:54.353236 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 18 21:42:54.353236 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:42:54.353236 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 521/1036] 10.222.0.27 () {56 vars in 1093 bytes} [Thu Aug 18 21:42:54 2022] GET /identity/v3/users/nova => generated 82 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 21:42:54.357500 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c5ebd1-275d-4eea-93fa-9d64be105e71 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:54.422499 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:54.431539 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52fad19-f3a2-4cb2-b1b4-af9d95d59570 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:54.464125 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c5ebd1-275d-4eea-93fa-9d64be105e71 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:54.465292 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eac9e18-592c-4a4e-8a41-11c361c70c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:54.465899 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eac9e18-592c-4a4e-8a41-11c361c70c18 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:54.466177 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eac9e18-592c-4a4e-8a41-11c361c70c18 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:54.466510 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eac9e18-592c-4a4e-8a41-11c361c70c18 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:54.467206 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eac9e18-592c-4a4e-8a41-11c361c70c18 None admin] RBAC: Adding query filter params (interface=public, service_id=0d16c3b5fe7e44f5be8c591227a171dd, region_id=RegionOne) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:54.467511 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eac9e18-592c-4a4e-8a41-11c361c70c18 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:54.468884 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eac9e18-592c-4a4e-8a41-11c361c70c18 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:54.474535 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 516/1037] 10.222.0.27 () {56 vars in 1251 bytes} [Thu Aug 18 21:42:54 2022] GET /identity/v3/endpoints?service_id=0d16c3b5fe7e44f5be8c591227a171dd&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:42:54.479829 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eac9e18-592c-4a4e-8a41-11c361c70c18 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:54.489158 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:54.502608 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a05a6c-7e83-459b-95cf-05d311bd2c3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:54.503216 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a05a6c-7e83-459b-95cf-05d311bd2c3f None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:54.503936 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a05a6c-7e83-459b-95cf-05d311bd2c3f None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:54.504216 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a05a6c-7e83-459b-95cf-05d311bd2c3f None admin] PATH_INFO: `/v3/users` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:54.505264 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a05a6c-7e83-459b-95cf-05d311bd2c3f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:54.505572 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a05a6c-7e83-459b-95cf-05d311bd2c3f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:54.507492 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a05a6c-7e83-459b-95cf-05d311bd2c3f None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:54.531102 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 522/1038] 10.222.0.27 () {56 vars in 1133 bytes} [Thu Aug 18 21:42:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 21:42:54.535332 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a05a6c-7e83-459b-95cf-05d311bd2c3f None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:54.590810 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eac9e18-592c-4a4e-8a41-11c361c70c18 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:54.627028 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ddd5e4-45f7-4392-a919-d2678e665ecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:54.627667 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ddd5e4-45f7-4392-a919-d2678e665ecf None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:54.627950 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ddd5e4-45f7-4392-a919-d2678e665ecf None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:54.628214 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ddd5e4-45f7-4392-a919-d2678e665ecf None admin] PATH_INFO: `/v3/services` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:54.628833 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ddd5e4-45f7-4392-a919-d2678e665ecf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:54.630181 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ddd5e4-45f7-4392-a919-d2678e665ecf None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:54.644640 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 517/1039] 10.222.0.27 () {56 vars in 1087 bytes} [Thu Aug 18 21:42:54 2022] GET /identity/v3/services => generated 1957 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 21:42:54.649479 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a05a6c-7e83-459b-95cf-05d311bd2c3f None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:54.689637 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35391178-b759-422e-89b7-0da9ff95b178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:54.690439 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35391178-b759-422e-89b7-0da9ff95b178 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:54.690725 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35391178-b759-422e-89b7-0da9ff95b178 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:54.691001 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35391178-b759-422e-89b7-0da9ff95b178 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:54.745817 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:54.768349 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35391178-b759-422e-89b7-0da9ff95b178 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:54.769873 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35391178-b759-422e-89b7-0da9ff95b178 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:54.879681 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 523/1040] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Aug 18 21:42:54 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 18 21:42:54.881482 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ddd5e4-45f7-4392-a919-d2678e665ecf None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:54.904688 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:54.985294 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ddd5e4-45f7-4392-a919-d2678e665ecf None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:55.019891 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4ff5c5-40b8-4412-86fb-91cb216afe87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:55.020573 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4ff5c5-40b8-4412-86fb-91cb216afe87 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:55.020878 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4ff5c5-40b8-4412-86fb-91cb216afe87 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:55.021143 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4ff5c5-40b8-4412-86fb-91cb216afe87 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:55.031364 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4ff5c5-40b8-4412-86fb-91cb216afe87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:55.033507 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4ff5c5-40b8-4412-86fb-91cb216afe87 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:55.047311 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application [None req-6b4ff5c5-40b8-4412-86fb-91cb216afe87 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:42:55.047311 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:55.047311 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:42:55.047311 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:42:55.047311 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:42:55.047311 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:42:55.047311 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:42:55.047311 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:42:55.047311 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:42:55.047311 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:42:55.047311 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:42:55.047311 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:42:55.047311 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 21:42:55.047311 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 21:42:55.047311 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 21:42:55.047311 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 21:42:55.049697 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:42:55.049697 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:42:55.049697 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:42:55.049697 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:42:55.049697 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:42:55.049697 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:42:55.049697 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:42:55.049697 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application with Lock( Aug 18 21:42:55.049697 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:42:55.049697 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:42:55.049697 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:42:55.049697 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:42:55.049697 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:42:55.049697 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:42:55.049697 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:42:55.049697 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:42:55.049697 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 21:42:55.050634 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 21:42:55.050634 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:42:55.050634 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:42:55.051187 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 518/1041] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 18 21:42:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:42:55.055365 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35391178-b759-422e-89b7-0da9ff95b178 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:55.139352 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:55.160628 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35391178-b759-422e-89b7-0da9ff95b178 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:55.196110 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f28013-3cae-4327-ac77-4f3766980c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:55.197283 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f28013-3cae-4327-ac77-4f3766980c40 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:55.197749 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f28013-3cae-4327-ac77-4f3766980c40 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:55.198185 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f28013-3cae-4327-ac77-4f3766980c40 None admin] PATH_INFO: `/v3/domains` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:55.198988 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f28013-3cae-4327-ac77-4f3766980c40 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:55.199461 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f28013-3cae-4327-ac77-4f3766980c40 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:55.201030 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f28013-3cae-4327-ac77-4f3766980c40 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:55.217457 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 524/1042] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 18 21:42:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:42:55.224236 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4ff5c5-40b8-4412-86fb-91cb216afe87 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:55.304315 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:55.333990 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4ff5c5-40b8-4412-86fb-91cb216afe87 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:55.369685 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45180ef-fc73-4e57-adb9-decfced6a706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:55.370334 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45180ef-fc73-4e57-adb9-decfced6a706 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:55.370612 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45180ef-fc73-4e57-adb9-decfced6a706 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:55.370882 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45180ef-fc73-4e57-adb9-decfced6a706 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:55.378374 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45180ef-fc73-4e57-adb9-decfced6a706 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:55.379803 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45180ef-fc73-4e57-adb9-decfced6a706 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:55.392156 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application [None req-f45180ef-fc73-4e57-adb9-decfced6a706 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 21:42:55.392156 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:55.392156 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:42:55.392156 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:42:55.392156 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:42:55.392156 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:42:55.392156 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:42:55.392156 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:42:55.392156 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:42:55.392156 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:42:55.392156 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:42:55.392156 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:42:55.392156 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 21:42:55.392156 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 21:42:55.392156 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 21:42:55.393320 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 21:42:55.393320 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:42:55.393320 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:42:55.393320 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:42:55.393320 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:42:55.393320 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:42:55.393320 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:42:55.393320 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:42:55.393320 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application with Lock( Aug 18 21:42:55.393320 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:42:55.393320 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:42:55.393320 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:42:55.393320 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:42:55.393320 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:42:55.393320 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:42:55.393320 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:42:55.393320 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:42:55.394673 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 21:42:55.394673 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 21:42:55.394673 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 21:42:55.394673 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 21:42:55.394673 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 21:42:55.394673 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 21:42:55.394673 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 21:42:55.394673 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:42:55.395409 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 519/1043] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Aug 18 21:42:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:42:55.399063 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f28013-3cae-4327-ac77-4f3766980c40 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:55.505201 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f28013-3cae-4327-ac77-4f3766980c40 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:55.539292 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e169451-1d2f-4d65-8ffd-371bc48b3250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:55.539901 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e169451-1d2f-4d65-8ffd-371bc48b3250 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:55.540182 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e169451-1d2f-4d65-8ffd-371bc48b3250 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:55.540455 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e169451-1d2f-4d65-8ffd-371bc48b3250 None admin] PATH_INFO: `/v3/projects` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:55.541174 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e169451-1d2f-4d65-8ffd-371bc48b3250 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:55.541479 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e169451-1d2f-4d65-8ffd-371bc48b3250 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:55.542912 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e169451-1d2f-4d65-8ffd-371bc48b3250 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:55.552960 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:55.556969 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 525/1044] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Aug 18 21:42:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 21:42:55.563253 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45180ef-fc73-4e57-adb9-decfced6a706 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:55.674629 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45180ef-fc73-4e57-adb9-decfced6a706 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:55.705563 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:55.710826 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f9dc45-5de6-41d8-b5f0-5066a6ccbb4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:55.717882 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f9dc45-5de6-41d8-b5f0-5066a6ccbb4d None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:55.717882 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f9dc45-5de6-41d8-b5f0-5066a6ccbb4d None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:55.717882 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f9dc45-5de6-41d8-b5f0-5066a6ccbb4d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:55.717882 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f9dc45-5de6-41d8-b5f0-5066a6ccbb4d None admin] RBAC: Adding query filter params (role.id=ac9ba398413d4794800e1f777b75c1df, scope.project.id=4b54801b90484d689034f838f85fc0a4, user.id=a39cd50340184779ac589bbcb7cac9aa) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:55.717882 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f9dc45-5de6-41d8-b5f0-5066a6ccbb4d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:55.717882 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f9dc45-5de6-41d8-b5f0-5066a6ccbb4d None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:55.722036 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 520/1045] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Aug 18 21:42:55 2022] GET /identity/v3/role_assignments?user.id=a39cd50340184779ac589bbcb7cac9aa&scope.project.id=4b54801b90484d689034f838f85fc0a4&role.id=ac9ba398413d4794800e1f777b75c1df => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:42:55.798444 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe6fe40-7394-4bae-84c0-b40aa4b1ebe9 None None] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:55.798830 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe6fe40-7394-4bae-84c0-b40aa4b1ebe9 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:55.799111 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe6fe40-7394-4bae-84c0-b40aa4b1ebe9 None None] PATH_INFO: `/` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:55.800653 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 526/1046] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:42:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:42:55.806100 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577e0aa9-75d0-4c22-bafa-23b3139877f2 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:55.806392 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577e0aa9-75d0-4c22-bafa-23b3139877f2 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:55.806668 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577e0aa9-75d0-4c22-bafa-23b3139877f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:55.825315 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-577e0aa9-75d0-4c22-bafa-23b3139877f2 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:42:55.826550 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-577e0aa9-75d0-4c22-bafa-23b3139877f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:42:55.900784 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 521/1047] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:42:55 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 21:42:56.171661 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe6fe40-7394-4bae-84c0-b40aa4b1ebe9 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:56.278347 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe6fe40-7394-4bae-84c0-b40aa4b1ebe9 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:56.316473 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecb4786-f69f-413a-bf51-a75e9d42646d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:56.317111 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecb4786-f69f-413a-bf51-a75e9d42646d None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:56.317445 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecb4786-f69f-413a-bf51-a75e9d42646d None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:56.317721 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecb4786-f69f-413a-bf51-a75e9d42646d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:56.327994 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecb4786-f69f-413a-bf51-a75e9d42646d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:42:56.332740 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application [None req-5ecb4786-f69f-413a-bf51-a75e9d42646d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 21:42:56.332740 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:56.332740 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:42:56.332740 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:42:56.332740 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:42:56.332740 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:42:56.332740 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:42:56.332740 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:42:56.332740 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:42:56.332740 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:42:56.332740 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:42:56.332740 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:42:56.332740 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:42:56.332740 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:42:56.332740 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:42:56.332740 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:42:56.333658 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:42:56.333658 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:42:56.333658 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:42:56.333658 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:42:56.333658 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:42:56.333658 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:42:56.333658 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:42:56.333658 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:42:56.333658 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:42:56.333658 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:42:56.333658 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:42:56.333658 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application with Lock( Aug 18 21:42:56.333658 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:42:56.333658 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:42:56.333658 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:42:56.333658 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:42:56.334512 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:42:56.334512 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:42:56.334512 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:42:56.334512 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:42:56.334512 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:42:56.334512 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:42:56.334512 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:42:56.334512 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:42:56.334512 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:42:56.334512 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:42:56.334512 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 21:42:56.334512 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:42:56.334512 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 527/1048] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Aug 18 21:42:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:42:56.341303 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577e0aa9-75d0-4c22-bafa-23b3139877f2 None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:56.441246 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577e0aa9-75d0-4c22-bafa-23b3139877f2 None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:56.466319 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:56.475956 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09d0cb0-34c0-4b26-9d53-6fe2c5fcd836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:56.476553 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09d0cb0-34c0-4b26-9d53-6fe2c5fcd836 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:56.476852 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09d0cb0-34c0-4b26-9d53-6fe2c5fcd836 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:56.481157 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09d0cb0-34c0-4b26-9d53-6fe2c5fcd836 None admin] PATH_INFO: `/v3/roles` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:56.481157 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09d0cb0-34c0-4b26-9d53-6fe2c5fcd836 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:56.481157 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09d0cb0-34c0-4b26-9d53-6fe2c5fcd836 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:56.481157 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09d0cb0-34c0-4b26-9d53-6fe2c5fcd836 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:56.492854 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 522/1049] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Aug 18 21:42:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 21:42:56.494124 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecb4786-f69f-413a-bf51-a75e9d42646d None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:56.556791 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:56.598397 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e325743a-fedf-46b9-8818-9abfa40f5336 None None] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:56.598684 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e325743a-fedf-46b9-8818-9abfa40f5336 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:56.599133 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e325743a-fedf-46b9-8818-9abfa40f5336 None None] PATH_INFO: `/` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:56.600667 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 523/1050] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:42:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 21:42:56.601803 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecb4786-f69f-413a-bf51-a75e9d42646d None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:56.606040 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725d93c0-8b12-4403-8dc7-a7ed166642a9 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:56.606525 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725d93c0-8b12-4403-8dc7-a7ed166642a9 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:56.606985 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725d93c0-8b12-4403-8dc7-a7ed166642a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:56.625122 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-725d93c0-8b12-4403-8dc7-a7ed166642a9 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:42:56.627547 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-725d93c0-8b12-4403-8dc7-a7ed166642a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:42:56.639515 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a505fd40-1550-4cae-9475-4ad2bf40504c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:56.640152 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a505fd40-1550-4cae-9475-4ad2bf40504c None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:56.640431 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a505fd40-1550-4cae-9475-4ad2bf40504c None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:56.640736 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a505fd40-1550-4cae-9475-4ad2bf40504c None admin] PATH_INFO: `/v3/users/e3d441fcdfd64c118dec164a6c8951d2` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:56.655140 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a505fd40-1550-4cae-9475-4ad2bf40504c None admin] RBAC: Authorizing `identity:get_user(user_id=e3d441fcdfd64c118dec164a6c8951d2)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:56.656626 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a505fd40-1550-4cae-9475-4ad2bf40504c None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:56.658294 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 528/1051] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Aug 18 21:42:56 2022] GET /identity/v3/users/e3d441fcdfd64c118dec164a6c8951d2 => generated 285 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:42:56.664016 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a505fd40-1550-4cae-9475-4ad2bf40504c None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:56.707861 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 524/1052] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:42:56 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 21:42:56.768334 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a505fd40-1550-4cae-9475-4ad2bf40504c None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:56.786299 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:56.804725 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62029f3-81a0-4c4f-897a-2c154e11e575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:56.805334 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62029f3-81a0-4c4f-897a-2c154e11e575 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:56.805612 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62029f3-81a0-4c4f-897a-2c154e11e575 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:56.805882 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62029f3-81a0-4c4f-897a-2c154e11e575 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:56.872950 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62029f3-81a0-4c4f-897a-2c154e11e575 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:56.874403 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62029f3-81a0-4c4f-897a-2c154e11e575 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:56.976664 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 529/1053] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Aug 18 21:42:56 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 18 21:42:57.013547 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725d93c0-8b12-4403-8dc7-a7ed166642a9 None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:57.014237 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62029f3-81a0-4c4f-897a-2c154e11e575 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:57.014237 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:57.100371 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62029f3-81a0-4c4f-897a-2c154e11e575 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:57.109400 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725d93c0-8b12-4403-8dc7-a7ed166642a9 None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:57.128337 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:57.137908 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb7dc01-f7ba-4b8e-b763-0e83d1c2359f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:57.138542 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb7dc01-f7ba-4b8e-b763-0e83d1c2359f None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:57.138824 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb7dc01-f7ba-4b8e-b763-0e83d1c2359f None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:57.139096 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb7dc01-f7ba-4b8e-b763-0e83d1c2359f None admin] PATH_INFO: `/v3/services/image` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:57.139673 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb7dc01-f7ba-4b8e-b763-0e83d1c2359f None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:57.141178 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb7dc01-f7ba-4b8e-b763-0e83d1c2359f None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:57.146817 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f19d1fa-6e97-4c01-b19d-65be6fc94f96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:57.147447 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f19d1fa-6e97-4c01-b19d-65be6fc94f96 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:57.147724 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f19d1fa-6e97-4c01-b19d-65be6fc94f96 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:57.147993 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f19d1fa-6e97-4c01-b19d-65be6fc94f96 None admin] PATH_INFO: `/v3/projects/3f45e8ef37e14b2ca7e9ccc40ea2d906` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:57.149138 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f19d1fa-6e97-4c01-b19d-65be6fc94f96 None admin] RBAC: Authorizing `identity:get_project(project_id=3f45e8ef37e14b2ca7e9ccc40ea2d906)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:57.150548 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f19d1fa-6e97-4c01-b19d-65be6fc94f96 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:57.156257 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application [None req-3eb7dc01-f7ba-4b8e-b763-0e83d1c2359f None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 18 21:42:57.156257 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:57.156257 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 21:42:57.156257 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 21:42:57.156257 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 21:42:57.156257 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 21:42:57.156257 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 21:42:57.156257 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 21:42:57.156257 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 18 21:42:57.156257 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:42:57.156257 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 21:42:57.156257 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:42:57.156257 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:57.156257 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:42:57.156257 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:42:57.156257 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:42:57.156257 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:42:57.157854 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:42:57.157854 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:42:57.157854 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:42:57.157854 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:42:57.157854 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:42:57.157854 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:42:57.157854 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 21:42:57.157854 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 21:42:57.157854 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 21:42:57.157854 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 21:42:57.157854 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:42:57.157854 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:42:57.157854 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:42:57.157854 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:42:57.157854 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:42:57.157854 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:42:57.158878 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:42:57.158878 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application with Lock( Aug 18 21:42:57.158878 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:42:57.158878 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:42:57.158878 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:42:57.158878 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:42:57.158878 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:42:57.158878 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:42:57.158878 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:42:57.158878 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:42:57.158878 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 21:42:57.158878 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 21:42:57.158878 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 18 21:42:57.158878 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:42:57.159696 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 525/1054] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Aug 18 21:42:56 2022] GET /identity/v3/projects/3f45e8ef37e14b2ca7e9ccc40ea2d906 => generated 311 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:42:57.159768 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 530/1055] 10.222.0.27 () {56 vars in 1105 bytes} [Thu Aug 18 21:42:56 2022] GET /identity/v3/services/image => generated 86 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 21:42:57.159845 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f19d1fa-6e97-4c01-b19d-65be6fc94f96 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:57.161107 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb7dc01-f7ba-4b8e-b763-0e83d1c2359f None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:57.251398 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:57.275997 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f19d1fa-6e97-4c01-b19d-65be6fc94f96 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:57.276215 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb7dc01-f7ba-4b8e-b763-0e83d1c2359f None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:57.316016 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b53dfea-4839-4a8a-a2af-88bc552e36b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:57.316737 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b53dfea-4839-4a8a-a2af-88bc552e36b9 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:57.317017 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b53dfea-4839-4a8a-a2af-88bc552e36b9 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:57.317284 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b53dfea-4839-4a8a-a2af-88bc552e36b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:57.317552 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971f3e13-db14-4441-b2ad-a5c165537591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:57.317999 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b53dfea-4839-4a8a-a2af-88bc552e36b9 None admin] RBAC: Adding query filter params (role.id=0833202e2a3d47d1b6b3af57006641b1, scope.project.id=3f45e8ef37e14b2ca7e9ccc40ea2d906, user.id=e3d441fcdfd64c118dec164a6c8951d2) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:57.318216 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971f3e13-db14-4441-b2ad-a5c165537591 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:57.318314 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b53dfea-4839-4a8a-a2af-88bc552e36b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:57.318499 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971f3e13-db14-4441-b2ad-a5c165537591 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:57.318771 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971f3e13-db14-4441-b2ad-a5c165537591 None admin] PATH_INFO: `/v3/services` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:57.319403 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971f3e13-db14-4441-b2ad-a5c165537591 None admin] RBAC: Adding query filter params (name=image) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:57.319697 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b53dfea-4839-4a8a-a2af-88bc552e36b9 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:57.319790 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971f3e13-db14-4441-b2ad-a5c165537591 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:57.321087 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971f3e13-db14-4441-b2ad-a5c165537591 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:57.325520 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 526/1056] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Aug 18 21:42:57 2022] GET /identity/v3/role_assignments?user.id=e3d441fcdfd64c118dec164a6c8951d2&scope.project.id=3f45e8ef37e14b2ca7e9ccc40ea2d906&role.id=0833202e2a3d47d1b6b3af57006641b1 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:42:57.334092 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 531/1057] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 18 21:42:57 2022] GET /identity/v3/services?name=image => generated 122 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:42:57.340328 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b53dfea-4839-4a8a-a2af-88bc552e36b9 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:57.398797 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:57.455144 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b53dfea-4839-4a8a-a2af-88bc552e36b9 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:57.495406 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af8b40c-e492-419a-b306-dec0abd98c26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:57.496055 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af8b40c-e492-419a-b306-dec0abd98c26 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:57.496323 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af8b40c-e492-419a-b306-dec0abd98c26 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:57.496617 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af8b40c-e492-419a-b306-dec0abd98c26 None admin] PATH_INFO: `/v3/services` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:57.497245 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af8b40c-e492-419a-b306-dec0abd98c26 None admin] RBAC: Adding query filter params (type=image) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:57.497552 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af8b40c-e492-419a-b306-dec0abd98c26 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:57.498906 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af8b40c-e492-419a-b306-dec0abd98c26 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:57.504747 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 527/1058] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 18 21:42:57 2022] GET /identity/v3/services?type=image => generated 350 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:42:57.510612 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971f3e13-db14-4441-b2ad-a5c165537591 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:57.616981 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971f3e13-db14-4441-b2ad-a5c165537591 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:57.645989 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf4938c-acc8-4115-87f4-46638e6991b5 None None] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:57.646318 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf4938c-acc8-4115-87f4-46638e6991b5 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:57.646541 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf4938c-acc8-4115-87f4-46638e6991b5 None None] PATH_INFO: `/` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:57.648113 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 528/1059] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:42:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:42:57.652811 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dbe662-a635-4b0c-9193-b4c183fe4c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:57.653419 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dbe662-a635-4b0c-9193-b4c183fe4c11 None admin] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:57.653551 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40a0874-f2cc-48a7-99e9-246695238b0d None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:57.653720 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dbe662-a635-4b0c-9193-b4c183fe4c11 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:57.653818 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40a0874-f2cc-48a7-99e9-246695238b0d None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:57.653966 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dbe662-a635-4b0c-9193-b4c183fe4c11 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:57.654059 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40a0874-f2cc-48a7-99e9-246695238b0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:57.654627 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dbe662-a635-4b0c-9193-b4c183fe4c11 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:57.655987 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dbe662-a635-4b0c-9193-b4c183fe4c11 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:57.672617 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-b40a0874-f2cc-48a7-99e9-246695238b0d None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:42:57.674478 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-b40a0874-f2cc-48a7-99e9-246695238b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:42:57.744631 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 529/1060] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:42:57 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 21:42:57.758869 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 532/1061] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 18 21:42:57 2022] POST /identity/v3/endpoints => generated 327 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:42:58.014602 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40a0874-f2cc-48a7-99e9-246695238b0d None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:58.060136 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:58.115929 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40a0874-f2cc-48a7-99e9-246695238b0d None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:58.155654 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0b27d6-a975-4add-8c03-2ed8bf83302d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:58.156283 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0b27d6-a975-4add-8c03-2ed8bf83302d None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:58.156562 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0b27d6-a975-4add-8c03-2ed8bf83302d None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:58.156863 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0b27d6-a975-4add-8c03-2ed8bf83302d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:58.168027 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0b27d6-a975-4add-8c03-2ed8bf83302d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:42:58.172877 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application [None req-cf0b27d6-a975-4add-8c03-2ed8bf83302d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 18 21:42:58.172877 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:58.172877 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:42:58.172877 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:42:58.172877 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:42:58.172877 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:42:58.172877 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:42:58.172877 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:42:58.172877 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:42:58.172877 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:42:58.172877 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:42:58.172877 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:42:58.172877 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:42:58.172877 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:42:58.172877 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:42:58.172877 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:42:58.180382 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:42:58.180382 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:42:58.180382 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:42:58.180382 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:42:58.180382 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:42:58.180382 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:42:58.180382 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:42:58.180382 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:42:58.180382 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:42:58.180382 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:42:58.180382 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:42:58.180382 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application with Lock( Aug 18 21:42:58.180382 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:42:58.180382 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:42:58.180382 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:42:58.180382 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:42:58.181313 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:42:58.181313 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:42:58.181313 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:42:58.181313 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:42:58.181313 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:42:58.181313 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:42:58.181313 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:42:58.181313 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:42:58.181313 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:42:58.181313 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:42:58.181313 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 18 21:42:58.181313 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:42:58.181313 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 530/1062] 10.222.0.27 () {56 vars in 1120 bytes} [Thu Aug 18 21:42:58 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:42:58.182025 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dbe662-a635-4b0c-9193-b4c183fe4c11 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:58.184338 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:58.291314 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dbe662-a635-4b0c-9193-b4c183fe4c11 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:58.326479 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694b4811-ee8b-46fc-b46d-b34a73028814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:58.327089 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694b4811-ee8b-46fc-b46d-b34a73028814 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:58.327371 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694b4811-ee8b-46fc-b46d-b34a73028814 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:58.327642 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694b4811-ee8b-46fc-b46d-b34a73028814 None admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:58.328309 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694b4811-ee8b-46fc-b46d-b34a73028814 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:58.328623 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694b4811-ee8b-46fc-b46d-b34a73028814 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:58.330512 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694b4811-ee8b-46fc-b46d-b34a73028814 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:58.338922 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 533/1063] 10.222.0.27 () {56 vars in 1115 bytes} [Thu Aug 18 21:42:58 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:42:58.344335 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0b27d6-a975-4add-8c03-2ed8bf83302d None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:58.445733 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:58.449687 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0b27d6-a975-4add-8c03-2ed8bf83302d None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:58.483392 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249b4203-0049-475b-8fd1-2c84d12d0bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:58.484017 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249b4203-0049-475b-8fd1-2c84d12d0bee None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:58.484295 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249b4203-0049-475b-8fd1-2c84d12d0bee None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:58.484567 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249b4203-0049-475b-8fd1-2c84d12d0bee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:58.495448 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249b4203-0049-475b-8fd1-2c84d12d0bee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:58.496911 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249b4203-0049-475b-8fd1-2c84d12d0bee None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:58.511857 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application [None req-249b4203-0049-475b-8fd1-2c84d12d0bee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:42:58.511857 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:58.511857 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:42:58.511857 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:42:58.511857 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:42:58.511857 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:42:58.511857 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:42:58.511857 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:42:58.511857 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:42:58.511857 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:42:58.511857 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:42:58.511857 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:42:58.511857 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 21:42:58.511857 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 21:42:58.511857 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 21:42:58.511857 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 21:42:58.512846 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:42:58.512846 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:42:58.512846 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:42:58.512846 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:42:58.512846 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:42:58.512846 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:42:58.512846 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:42:58.512846 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application with Lock( Aug 18 21:42:58.512846 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:42:58.512846 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:42:58.512846 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:42:58.512846 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:42:58.512846 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:42:58.512846 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:42:58.512846 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:42:58.512846 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:42:58.512846 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 21:42:58.513743 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 21:42:58.513743 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:42:58.513743 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:42:58.513743 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 531/1064] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 18 21:42:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 21:42:58.520566 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694b4811-ee8b-46fc-b46d-b34a73028814 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:58.583167 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:58.621209 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694b4811-ee8b-46fc-b46d-b34a73028814 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:58.654474 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9a72a3-c3af-4c5f-b9d8-d8ed77c7528d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:58.655072 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9a72a3-c3af-4c5f-b9d8-d8ed77c7528d None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:58.655352 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9a72a3-c3af-4c5f-b9d8-d8ed77c7528d None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:58.655626 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9a72a3-c3af-4c5f-b9d8-d8ed77c7528d None admin] PATH_INFO: `/v3/domains` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:58.656263 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9a72a3-c3af-4c5f-b9d8-d8ed77c7528d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:58.656563 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9a72a3-c3af-4c5f-b9d8-d8ed77c7528d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:58.658731 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9a72a3-c3af-4c5f-b9d8-d8ed77c7528d None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:58.675807 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 534/1065] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 18 21:42:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:42:58.677320 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249b4203-0049-475b-8fd1-2c84d12d0bee None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:58.779350 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249b4203-0049-475b-8fd1-2c84d12d0bee None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:58.813601 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92f43bc-3d4f-4ced-ae22-5ab1e06f03ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:58.814214 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92f43bc-3d4f-4ced-ae22-5ab1e06f03ad None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:58.814489 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92f43bc-3d4f-4ced-ae22-5ab1e06f03ad None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:58.814764 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92f43bc-3d4f-4ced-ae22-5ab1e06f03ad None admin] PATH_INFO: `/v3/users/nova` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:58.822431 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92f43bc-3d4f-4ced-ae22-5ab1e06f03ad None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:58.823858 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92f43bc-3d4f-4ced-ae22-5ab1e06f03ad None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:58.834919 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application [None req-a92f43bc-3d4f-4ced-ae22-5ab1e06f03ad None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 18 21:42:58.834919 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:58.834919 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:42:58.834919 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:42:58.834919 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:42:58.834919 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:42:58.834919 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:42:58.834919 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:42:58.834919 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:42:58.834919 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:42:58.834919 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:42:58.834919 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:42:58.834919 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 21:42:58.834919 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 21:42:58.834919 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 21:42:58.834919 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 21:42:58.835860 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:42:58.835860 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:42:58.835860 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 21:42:58.835860 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 21:42:58.835860 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 21:42:58.835860 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 21:42:58.835860 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:42:58.835860 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:42:58.835860 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:42:58.835860 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:42:58.835860 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:42:58.835860 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application with Lock( Aug 18 21:42:58.835860 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:42:58.835860 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:42:58.835860 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:42:58.835860 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:42:58.835860 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:42:58.835860 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:42:58.842063 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:42:58.842063 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:42:58.842063 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 21:42:58.842063 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 21:42:58.842063 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 21:42:58.842063 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 21:42:58.842063 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 21:42:58.842063 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 21:42:58.842063 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 18 21:42:58.842063 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:42:58.842063 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 532/1066] 10.222.0.27 () {56 vars in 1093 bytes} [Thu Aug 18 21:42:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 21:42:58.844297 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9a72a3-c3af-4c5f-b9d8-d8ed77c7528d None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:58.947389 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9a72a3-c3af-4c5f-b9d8-d8ed77c7528d None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:58.972228 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:58.983055 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43239a02-068b-4361-a806-cdfa7e9f2b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:58.983658 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43239a02-068b-4361-a806-cdfa7e9f2b11 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:58.983937 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43239a02-068b-4361-a806-cdfa7e9f2b11 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:58.986077 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43239a02-068b-4361-a806-cdfa7e9f2b11 None admin] PATH_INFO: `/v3/users` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:58.986077 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43239a02-068b-4361-a806-cdfa7e9f2b11 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:58.986077 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43239a02-068b-4361-a806-cdfa7e9f2b11 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:58.986904 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43239a02-068b-4361-a806-cdfa7e9f2b11 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:59.004954 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 535/1067] 10.222.0.27 () {56 vars in 1133 bytes} [Thu Aug 18 21:42:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:42:59.009522 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92f43bc-3d4f-4ced-ae22-5ab1e06f03ad None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:59.026030 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:59.113444 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92f43bc-3d4f-4ced-ae22-5ab1e06f03ad None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:59.148271 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5882ba20-2018-4866-b4de-8678f218a935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:59.149088 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5882ba20-2018-4866-b4de-8678f218a935 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:59.149469 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5882ba20-2018-4866-b4de-8678f218a935 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:59.149844 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5882ba20-2018-4866-b4de-8678f218a935 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:59.161249 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5882ba20-2018-4866-b4de-8678f218a935 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:59.163757 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5882ba20-2018-4866-b4de-8678f218a935 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:59.177624 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application [None req-5882ba20-2018-4866-b4de-8678f218a935 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:42:59.177624 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:59.177624 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:42:59.177624 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:42:59.177624 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:42:59.177624 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:42:59.177624 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:42:59.177624 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:42:59.177624 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:42:59.177624 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:42:59.177624 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:42:59.177624 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:42:59.177624 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 21:42:59.177624 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 21:42:59.177624 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 21:42:59.177624 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 21:42:59.178796 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:42:59.178796 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:42:59.178796 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:42:59.178796 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:42:59.178796 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:42:59.178796 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:42:59.178796 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:42:59.178796 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application with Lock( Aug 18 21:42:59.178796 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:42:59.178796 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:42:59.178796 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:42:59.178796 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:42:59.178796 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:42:59.178796 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:42:59.178796 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:42:59.178796 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:42:59.178796 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 21:42:59.179941 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 21:42:59.179941 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:42:59.179941 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:42:59.185081 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 533/1068] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 18 21:42:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 21:42:59.186651 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43239a02-068b-4361-a806-cdfa7e9f2b11 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:59.271825 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1f5a94-87ca-44c2-bbe5-c06ddd5ef8bd None None] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:59.272182 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1f5a94-87ca-44c2-bbe5-c06ddd5ef8bd None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:59.272391 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1f5a94-87ca-44c2-bbe5-c06ddd5ef8bd None None] PATH_INFO: `/` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:59.273925 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 534/1069] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:42:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 21:42:59.287830 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fecf298-7ba3-48d6-bcb4-c48ea50cd88c None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:59.288111 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fecf298-7ba3-48d6-bcb4-c48ea50cd88c None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:59.288441 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fecf298-7ba3-48d6-bcb4-c48ea50cd88c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:59.302765 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43239a02-068b-4361-a806-cdfa7e9f2b11 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:59.309635 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-9fecf298-7ba3-48d6-bcb4-c48ea50cd88c None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:42:59.311408 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-9fecf298-7ba3-48d6-bcb4-c48ea50cd88c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:42:59.339836 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21411df7-2c34-42a6-a737-0373a7aacf1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:59.340440 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21411df7-2c34-42a6-a737-0373a7aacf1a None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:59.340772 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21411df7-2c34-42a6-a737-0373a7aacf1a None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:59.341045 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21411df7-2c34-42a6-a737-0373a7aacf1a None admin] PATH_INFO: `/v3/domains` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:59.341687 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21411df7-2c34-42a6-a737-0373a7aacf1a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:59.341989 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21411df7-2c34-42a6-a737-0373a7aacf1a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:59.343361 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21411df7-2c34-42a6-a737-0373a7aacf1a None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:59.360637 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 536/1070] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 18 21:42:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:42:59.363022 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21411df7-2c34-42a6-a737-0373a7aacf1a None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:59.377522 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:59.386892 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 535/1071] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:42:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 21:42:59.409787 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:59.468265 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21411df7-2c34-42a6-a737-0373a7aacf1a None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:59.503093 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95c0e11-dacf-48d6-abf7-512c14b9c864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:59.503770 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95c0e11-dacf-48d6-abf7-512c14b9c864 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:59.504048 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95c0e11-dacf-48d6-abf7-512c14b9c864 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:59.504315 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95c0e11-dacf-48d6-abf7-512c14b9c864 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:59.511009 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95c0e11-dacf-48d6-abf7-512c14b9c864 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:59.512440 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95c0e11-dacf-48d6-abf7-512c14b9c864 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:59.524349 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application [None req-f95c0e11-dacf-48d6-abf7-512c14b9c864 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 21:42:59.524349 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:59.524349 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:42:59.524349 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:42:59.524349 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:42:59.524349 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:42:59.524349 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:42:59.524349 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:42:59.524349 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:42:59.524349 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:42:59.524349 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:42:59.524349 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:42:59.524349 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 21:42:59.524349 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 21:42:59.524349 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 21:42:59.525261 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 21:42:59.525261 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:42:59.525261 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:42:59.525261 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:42:59.525261 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:42:59.525261 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:42:59.525261 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:42:59.525261 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:42:59.525261 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application with Lock( Aug 18 21:42:59.525261 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:42:59.525261 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:42:59.525261 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:42:59.525261 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:42:59.525261 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:42:59.525261 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:42:59.525261 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:42:59.525261 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:42:59.526165 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 21:42:59.526165 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 21:42:59.526165 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 21:42:59.526165 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 21:42:59.526165 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 21:42:59.526165 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 21:42:59.526165 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 21:42:59.526165 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:42:59.528895 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 537/1072] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Aug 18 21:42:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 21:42:59.531290 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fecf298-7ba3-48d6-bcb4-c48ea50cd88c None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:59.632537 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fecf298-7ba3-48d6-bcb4-c48ea50cd88c None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:59.656308 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95c0e11-dacf-48d6-abf7-512c14b9c864 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:59.668369 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f4b7fe-25f5-4aa1-97fd-24872cf8bb16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:59.669046 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f4b7fe-25f5-4aa1-97fd-24872cf8bb16 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:59.669330 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f4b7fe-25f5-4aa1-97fd-24872cf8bb16 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:59.669669 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f4b7fe-25f5-4aa1-97fd-24872cf8bb16 None admin] PATH_INFO: `/v3/projects` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:59.670403 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f4b7fe-25f5-4aa1-97fd-24872cf8bb16 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:42:59.670688 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f4b7fe-25f5-4aa1-97fd-24872cf8bb16 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:59.672107 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f4b7fe-25f5-4aa1-97fd-24872cf8bb16 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:59.685190 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 536/1073] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Aug 18 21:42:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:42:59.687978 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d19138-c8fb-4c93-81c2-4533c3e46d61 None None] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:59.688260 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d19138-c8fb-4c93-81c2-4533c3e46d61 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:59.689224 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d19138-c8fb-4c93-81c2-4533c3e46d61 None None] PATH_INFO: `/` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:59.690708 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 537/1074] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:42:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 21:42:59.691463 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d19138-c8fb-4c93-81c2-4533c3e46d61 None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:59.751738 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:59.770314 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95c0e11-dacf-48d6-abf7-512c14b9c864 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:59.771912 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:42:59.796657 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d19138-c8fb-4c93-81c2-4533c3e46d61 None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:42:59.803612 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a69bd90-4112-4f55-a223-66c2c19a236b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:59.804238 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a69bd90-4112-4f55-a223-66c2c19a236b None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:59.804536 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a69bd90-4112-4f55-a223-66c2c19a236b None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:59.804837 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a69bd90-4112-4f55-a223-66c2c19a236b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:59.815733 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a69bd90-4112-4f55-a223-66c2c19a236b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:42:59.820421 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application [None req-3a69bd90-4112-4f55-a223-66c2c19a236b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 21:42:59.820421 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:42:59.820421 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:42:59.820421 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:42:59.820421 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:42:59.820421 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:42:59.820421 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:42:59.820421 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:42:59.820421 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:42:59.820421 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:42:59.820421 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:42:59.820421 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:42:59.820421 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:42:59.820421 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:42:59.820421 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:42:59.820421 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:42:59.821906 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:42:59.821906 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:42:59.821906 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:42:59.821906 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:42:59.821906 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:42:59.821906 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:42:59.821906 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:42:59.821906 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:42:59.821906 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:42:59.821906 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:42:59.821906 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:42:59.821906 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application with Lock( Aug 18 21:42:59.821906 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:42:59.821906 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:42:59.821906 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:42:59.821906 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:42:59.822758 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:42:59.822758 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:42:59.822758 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:42:59.822758 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:42:59.822758 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:42:59.822758 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:42:59.822758 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:42:59.822758 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:42:59.822758 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:42:59.822758 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:42:59.822758 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 21:42:59.822758 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:42:59.822758 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 538/1075] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Aug 18 21:42:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 21:42:59.825916 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e12e9a2-e885-479f-92c8-7b3e2165ba7e None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:59.826204 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e12e9a2-e885-479f-92c8-7b3e2165ba7e None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:59.826485 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e12e9a2-e885-479f-92c8-7b3e2165ba7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:59.831803 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dc33a4-b7ff-473f-a6c1-76b60ce96acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:42:59.832465 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dc33a4-b7ff-473f-a6c1-76b60ce96acd None admin] REQUEST_METHOD: `PUT` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:42:59.832769 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dc33a4-b7ff-473f-a6c1-76b60ce96acd None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:42:59.833044 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dc33a4-b7ff-473f-a6c1-76b60ce96acd None admin] PATH_INFO: `/v3/projects/4b54801b90484d689034f838f85fc0a4/users/a39cd50340184779ac589bbcb7cac9aa/roles/ac9ba398413d4794800e1f777b75c1df` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:42:59.835344 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dc33a4-b7ff-473f-a6c1-76b60ce96acd None admin] RBAC: Authorizing `identity:create_grant(project_id=4b54801b90484d689034f838f85fc0a4, user_id=a39cd50340184779ac589bbcb7cac9aa, role_id=ac9ba398413d4794800e1f777b75c1df)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:42:59.836795 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dc33a4-b7ff-473f-a6c1-76b60ce96acd None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:42:59.846542 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-2e12e9a2-e885-479f-92c8-7b3e2165ba7e None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:42:59.847750 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-2e12e9a2-e885-479f-92c8-7b3e2165ba7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:42:59.901976 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 538/1076] 10.222.0.27 () {58 vars in 1439 bytes} [Thu Aug 18 21:42:59 2022] PUT /identity/v3/projects/4b54801b90484d689034f838f85fc0a4/users/a39cd50340184779ac589bbcb7cac9aa/roles/ac9ba398413d4794800e1f777b75c1df => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:42:59.903053 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dc33a4-b7ff-473f-a6c1-76b60ce96acd None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:42:59.937593 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 539/1077] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:42:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 21:43:00.032853 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dc33a4-b7ff-473f-a6c1-76b60ce96acd None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:43:00.050781 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:43:00.079073 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd07ed25-5fd5-46cf-a5a1-5c498549ca61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:43:00.080460 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd07ed25-5fd5-46cf-a5a1-5c498549ca61 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:43:00.081262 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd07ed25-5fd5-46cf-a5a1-5c498549ca61 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:43:00.081262 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd07ed25-5fd5-46cf-a5a1-5c498549ca61 None admin] PATH_INFO: `/v3/roles` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:43:00.081718 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd07ed25-5fd5-46cf-a5a1-5c498549ca61 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:43:00.082020 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd07ed25-5fd5-46cf-a5a1-5c498549ca61 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:43:00.083405 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd07ed25-5fd5-46cf-a5a1-5c498549ca61 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:43:00.096002 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 539/1078] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Aug 18 21:42:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:43:00.108408 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e12e9a2-e885-479f-92c8-7b3e2165ba7e None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:43:00.215883 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:43:00.218113 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd07ed25-5fd5-46cf-a5a1-5c498549ca61 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:43:00.228919 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e12e9a2-e885-479f-92c8-7b3e2165ba7e None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:43:00.269357 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aedf615-c912-46f5-8c44-5d92940ea17c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:43:00.271198 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aedf615-c912-46f5-8c44-5d92940ea17c None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:43:00.271481 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aedf615-c912-46f5-8c44-5d92940ea17c None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:43:00.271909 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aedf615-c912-46f5-8c44-5d92940ea17c None admin] PATH_INFO: `/v3/users/e3d441fcdfd64c118dec164a6c8951d2` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:43:00.273135 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aedf615-c912-46f5-8c44-5d92940ea17c None admin] RBAC: Authorizing `identity:get_user(user_id=e3d441fcdfd64c118dec164a6c8951d2)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:43:00.274581 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aedf615-c912-46f5-8c44-5d92940ea17c None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:43:00.277018 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 540/1079] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Aug 18 21:43:00 2022] GET /identity/v3/users/e3d441fcdfd64c118dec164a6c8951d2 => generated 285 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:43:00.283226 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aedf615-c912-46f5-8c44-5d92940ea17c None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:43:00.343686 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd07ed25-5fd5-46cf-a5a1-5c498549ca61 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:43:00.397599 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1655622-f0c1-4de5-b2eb-d729dff9837e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:43:00.398223 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1655622-f0c1-4de5-b2eb-d729dff9837e None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:43:00.398501 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1655622-f0c1-4de5-b2eb-d729dff9837e None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:43:00.398772 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1655622-f0c1-4de5-b2eb-d729dff9837e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:43:00.410881 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aedf615-c912-46f5-8c44-5d92940ea17c None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:43:00.451312 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6628e8-8ada-4e23-8cdf-7e3ee887e17b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:43:00.452005 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6628e8-8ada-4e23-8cdf-7e3ee887e17b None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:43:00.452292 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6628e8-8ada-4e23-8cdf-7e3ee887e17b None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:43:00.452568 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6628e8-8ada-4e23-8cdf-7e3ee887e17b None admin] PATH_INFO: `/v3/projects/3f45e8ef37e14b2ca7e9ccc40ea2d906` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:43:00.453769 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6628e8-8ada-4e23-8cdf-7e3ee887e17b None admin] RBAC: Authorizing `identity:get_project(project_id=3f45e8ef37e14b2ca7e9ccc40ea2d906)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:43:00.455852 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6628e8-8ada-4e23-8cdf-7e3ee887e17b None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:43:00.456675 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:43:00.462938 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 541/1080] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Aug 18 21:43:00 2022] GET /identity/v3/projects/3f45e8ef37e14b2ca7e9ccc40ea2d906 => generated 311 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 21:43:00.464582 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6628e8-8ada-4e23-8cdf-7e3ee887e17b None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:43:00.482412 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1655622-f0c1-4de5-b2eb-d729dff9837e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:43:00.483802 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1655622-f0c1-4de5-b2eb-d729dff9837e None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:43:00.506890 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:43:00.602397 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6628e8-8ada-4e23-8cdf-7e3ee887e17b None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:43:00.616994 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 540/1081] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Aug 18 21:43:00 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 18 21:43:00.623379 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1655622-f0c1-4de5-b2eb-d729dff9837e None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:43:00.649187 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ca1b09-9c1d-486a-acf0-392eda0f74a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:43:00.649859 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ca1b09-9c1d-486a-acf0-392eda0f74a1 None admin] REQUEST_METHOD: `PUT` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:43:00.650142 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ca1b09-9c1d-486a-acf0-392eda0f74a1 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:43:00.650418 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ca1b09-9c1d-486a-acf0-392eda0f74a1 None admin] PATH_INFO: `/v3/projects/3f45e8ef37e14b2ca7e9ccc40ea2d906/users/e3d441fcdfd64c118dec164a6c8951d2/roles/0833202e2a3d47d1b6b3af57006641b1` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:43:00.652417 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ca1b09-9c1d-486a-acf0-392eda0f74a1 None admin] RBAC: Authorizing `identity:create_grant(project_id=3f45e8ef37e14b2ca7e9ccc40ea2d906, user_id=e3d441fcdfd64c118dec164a6c8951d2, role_id=0833202e2a3d47d1b6b3af57006641b1)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:43:00.653950 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ca1b09-9c1d-486a-acf0-392eda0f74a1 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:43:00.705284 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:43:00.730138 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1655622-f0c1-4de5-b2eb-d729dff9837e None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:43:00.761984 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 542/1082] 10.222.0.27 () {58 vars in 1439 bytes} [Thu Aug 18 21:43:00 2022] PUT /identity/v3/projects/3f45e8ef37e14b2ca7e9ccc40ea2d906/users/e3d441fcdfd64c118dec164a6c8951d2/roles/0833202e2a3d47d1b6b3af57006641b1 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 21:43:00.764796 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d4e196-9ae8-4e3f-b74e-64eed85e1e09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:43:00.765451 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d4e196-9ae8-4e3f-b74e-64eed85e1e09 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:43:00.765730 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d4e196-9ae8-4e3f-b74e-64eed85e1e09 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:43:00.766002 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d4e196-9ae8-4e3f-b74e-64eed85e1e09 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:43:00.778807 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d4e196-9ae8-4e3f-b74e-64eed85e1e09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:43:00.780281 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d4e196-9ae8-4e3f-b74e-64eed85e1e09 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:43:00.796844 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application [None req-67d4e196-9ae8-4e3f-b74e-64eed85e1e09 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:43:00.796844 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:43:00.796844 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:43:00.796844 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:43:00.796844 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:43:00.796844 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:43:00.796844 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:43:00.796844 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:43:00.796844 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:43:00.796844 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:43:00.796844 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:43:00.796844 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:43:00.796844 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 21:43:00.796844 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 21:43:00.796844 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 21:43:00.796844 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 21:43:00.798468 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:43:00.798468 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:43:00.798468 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:43:00.798468 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:43:00.798468 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:43:00.798468 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:43:00.798468 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:43:00.798468 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application with Lock( Aug 18 21:43:00.798468 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:43:00.798468 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:43:00.798468 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:43:00.798468 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:43:00.798468 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:43:00.798468 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:43:00.798468 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:43:00.798468 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:43:00.798468 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 21:43:00.805077 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 21:43:00.805077 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:43:00.805077 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:43:00.805077 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 541/1083] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 18 21:43:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 21:43:00.806541 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ca1b09-9c1d-486a-acf0-392eda0f74a1 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:43:00.902340 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:43:00.916676 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ca1b09-9c1d-486a-acf0-392eda0f74a1 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:43:00.953105 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8aa137-4348-4e29-8c3a-4a4d5a8d848b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:43:00.953721 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8aa137-4348-4e29-8c3a-4a4d5a8d848b None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:43:00.953999 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8aa137-4348-4e29-8c3a-4a4d5a8d848b None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:43:00.954811 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8aa137-4348-4e29-8c3a-4a4d5a8d848b None admin] PATH_INFO: `/v3/domains` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:43:00.955464 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8aa137-4348-4e29-8c3a-4a4d5a8d848b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:43:00.955763 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8aa137-4348-4e29-8c3a-4a4d5a8d848b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:43:00.957160 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8aa137-4348-4e29-8c3a-4a4d5a8d848b None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:43:00.972635 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 543/1084] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 18 21:43:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:43:01.950525 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440979cd-d60e-47eb-84cd-8f779e2451e9 None None] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:43:01.951058 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440979cd-d60e-47eb-84cd-8f779e2451e9 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:43:01.951058 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440979cd-d60e-47eb-84cd-8f779e2451e9 None None] PATH_INFO: `/` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:43:01.952387 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 542/1085] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:43:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:43:01.957662 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a9a606-a693-45cd-b8cb-c3a5adfcde0d None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:43:01.958086 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a9a606-a693-45cd-b8cb-c3a5adfcde0d None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:43:01.958349 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a9a606-a693-45cd-b8cb-c3a5adfcde0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:43:01.976490 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-65a9a606-a693-45cd-b8cb-c3a5adfcde0d None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:43:01.977697 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-65a9a606-a693-45cd-b8cb-c3a5adfcde0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:43:02.053371 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 544/1086] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:43:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 21:43:02.335621 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440979cd-d60e-47eb-84cd-8f779e2451e9 None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:43:02.436069 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440979cd-d60e-47eb-84cd-8f779e2451e9 None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:43:02.462634 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:43:02.470952 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb772b34-6947-4368-9798-e16296e0954c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:43:02.471447 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb772b34-6947-4368-9798-e16296e0954c None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:43:02.476710 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb772b34-6947-4368-9798-e16296e0954c None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:43:02.476710 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb772b34-6947-4368-9798-e16296e0954c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:43:02.484184 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb772b34-6947-4368-9798-e16296e0954c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:43:02.491092 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application [None req-cb772b34-6947-4368-9798-e16296e0954c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 18 21:43:02.491092 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:43:02.491092 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:43:02.491092 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:43:02.491092 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:43:02.491092 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:43:02.491092 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:43:02.491092 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:43:02.491092 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:43:02.491092 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:43:02.491092 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:43:02.491092 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:43:02.491092 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:43:02.491092 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:43:02.491092 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:43:02.491092 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:43:02.492365 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:43:02.492365 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:43:02.492365 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:43:02.492365 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:43:02.492365 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:43:02.492365 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:43:02.492365 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:43:02.492365 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:43:02.492365 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:43:02.492365 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:43:02.492365 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:43:02.492365 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application with Lock( Aug 18 21:43:02.492365 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:43:02.492365 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:43:02.492365 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:43:02.492365 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:43:02.493345 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:43:02.493345 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:43:02.493345 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:43:02.493345 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:43:02.493345 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:43:02.493345 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:43:02.493345 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:43:02.493345 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:43:02.493345 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:43:02.493345 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:43:02.493345 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 18 21:43:02.493345 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:43:02.493345 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 543/1087] 10.222.0.27 () {56 vars in 1120 bytes} [Thu Aug 18 21:43:02 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:43:02.498443 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a9a606-a693-45cd-b8cb-c3a5adfcde0d None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:43:02.578674 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:43:02.600344 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a9a606-a693-45cd-b8cb-c3a5adfcde0d None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:43:02.634502 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4ec25e-73df-40e1-9944-f6d19f0ba049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:43:02.635102 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4ec25e-73df-40e1-9944-f6d19f0ba049 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:43:02.635378 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4ec25e-73df-40e1-9944-f6d19f0ba049 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:43:02.635646 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4ec25e-73df-40e1-9944-f6d19f0ba049 None admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:43:02.636295 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4ec25e-73df-40e1-9944-f6d19f0ba049 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:43:02.636587 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4ec25e-73df-40e1-9944-f6d19f0ba049 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:43:02.638025 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4ec25e-73df-40e1-9944-f6d19f0ba049 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:43:02.647036 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 545/1088] 10.222.0.27 () {56 vars in 1115 bytes} [Thu Aug 18 21:43:02 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:43:02.652612 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb772b34-6947-4368-9798-e16296e0954c None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:43:02.769557 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6fa1ea-d063-4db8-8963-8a83bdebe302 None None] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:43:02.769846 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6fa1ea-d063-4db8-8963-8a83bdebe302 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:43:02.770128 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6fa1ea-d063-4db8-8963-8a83bdebe302 None None] PATH_INFO: `/` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:43:02.771577 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 546/1089] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:43:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:43:02.773210 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb772b34-6947-4368-9798-e16296e0954c None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:43:02.776356 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c83d0e5-4f2e-4b54-9bfb-441ba9499897 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:43:02.776662 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c83d0e5-4f2e-4b54-9bfb-441ba9499897 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:43:02.776941 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c83d0e5-4f2e-4b54-9bfb-441ba9499897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:43:02.795194 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-8c83d0e5-4f2e-4b54-9bfb-441ba9499897 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:43:02.796409 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-8c83d0e5-4f2e-4b54-9bfb-441ba9499897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:43:02.807837 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e014d11d-0b8c-4ef9-b49e-7facc0d5e2c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:43:02.808466 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e014d11d-0b8c-4ef9-b49e-7facc0d5e2c6 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:43:02.808773 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e014d11d-0b8c-4ef9-b49e-7facc0d5e2c6 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:43:02.809044 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e014d11d-0b8c-4ef9-b49e-7facc0d5e2c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:43:02.819995 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e014d11d-0b8c-4ef9-b49e-7facc0d5e2c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:43:02.821466 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e014d11d-0b8c-4ef9-b49e-7facc0d5e2c6 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:43:02.835925 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application [None req-e014d11d-0b8c-4ef9-b49e-7facc0d5e2c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:43:02.835925 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:43:02.835925 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:43:02.835925 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:43:02.835925 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:43:02.835925 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:43:02.835925 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:43:02.835925 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:43:02.835925 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:43:02.835925 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:43:02.835925 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:43:02.835925 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:43:02.835925 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 21:43:02.835925 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 21:43:02.835925 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 21:43:02.835925 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 21:43:02.837388 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:43:02.837388 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:43:02.837388 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:43:02.837388 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:43:02.837388 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:43:02.837388 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:43:02.837388 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:43:02.837388 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application with Lock( Aug 18 21:43:02.837388 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:43:02.837388 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:43:02.837388 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:43:02.837388 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:43:02.837388 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:43:02.837388 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:43:02.837388 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:43:02.837388 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:43:02.837388 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 21:43:02.838587 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 21:43:02.838587 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:43:02.838587 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:43:02.838587 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 544/1090] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 18 21:43:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:43:02.842850 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e014d11d-0b8c-4ef9-b49e-7facc0d5e2c6 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:43:02.867366 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 547/1091] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:43:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 21:43:02.890923 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:43:02.950613 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e014d11d-0b8c-4ef9-b49e-7facc0d5e2c6 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:43:02.984437 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632b7754-ccab-4c5d-9f4b-c6e8266d5dc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:43:02.985065 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632b7754-ccab-4c5d-9f4b-c6e8266d5dc6 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:43:02.985869 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632b7754-ccab-4c5d-9f4b-c6e8266d5dc6 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:43:02.986154 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632b7754-ccab-4c5d-9f4b-c6e8266d5dc6 None admin] PATH_INFO: `/v3/domains` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:43:02.986900 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632b7754-ccab-4c5d-9f4b-c6e8266d5dc6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:43:02.987204 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632b7754-ccab-4c5d-9f4b-c6e8266d5dc6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:43:02.988562 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632b7754-ccab-4c5d-9f4b-c6e8266d5dc6 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:43:03.000106 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 545/1092] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 18 21:43:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 21:43:03.006320 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c83d0e5-4f2e-4b54-9bfb-441ba9499897 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:43:03.073713 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:43:03.103189 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c83d0e5-4f2e-4b54-9bfb-441ba9499897 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:43:03.137047 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807c85df-e5c7-4e0f-bd8c-1226c6755690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:43:03.149646 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807c85df-e5c7-4e0f-bd8c-1226c6755690 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:43:03.149646 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807c85df-e5c7-4e0f-bd8c-1226c6755690 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:43:03.149646 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807c85df-e5c7-4e0f-bd8c-1226c6755690 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:43:03.149956 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632b7754-ccab-4c5d-9f4b-c6e8266d5dc6 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:43:03.150057 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807c85df-e5c7-4e0f-bd8c-1226c6755690 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:43:03.150057 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807c85df-e5c7-4e0f-bd8c-1226c6755690 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:43:03.160309 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application [None req-807c85df-e5c7-4e0f-bd8c-1226c6755690 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 18 21:43:03.160309 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:43:03.160309 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:43:03.160309 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:43:03.160309 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:43:03.160309 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:43:03.160309 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:43:03.160309 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:43:03.160309 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:43:03.160309 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:43:03.160309 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:43:03.160309 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:43:03.160309 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 21:43:03.160309 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 21:43:03.160309 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 21:43:03.160309 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 21:43:03.161382 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:43:03.161382 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:43:03.161382 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 21:43:03.161382 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 21:43:03.161382 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 21:43:03.161382 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 21:43:03.161382 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:43:03.161382 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:43:03.161382 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:43:03.161382 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:43:03.161382 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:43:03.161382 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application with Lock( Aug 18 21:43:03.161382 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:43:03.161382 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:43:03.161382 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:43:03.161382 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:43:03.161382 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:43:03.161382 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:43:03.162859 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:43:03.162859 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:43:03.162859 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 21:43:03.162859 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 21:43:03.162859 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 21:43:03.162859 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 21:43:03.162859 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 21:43:03.162859 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 21:43:03.162859 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 18 21:43:03.162859 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:43:03.162859 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 548/1093] 10.222.0.27 () {56 vars in 1093 bytes} [Thu Aug 18 21:43:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 21:43:03.167206 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807c85df-e5c7-4e0f-bd8c-1226c6755690 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:43:03.243669 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:43:03.246747 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632b7754-ccab-4c5d-9f4b-c6e8266d5dc6 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:43:03.269737 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807c85df-e5c7-4e0f-bd8c-1226c6755690 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:43:03.281628 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b67096-f08e-444c-a152-31f247494874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:43:03.282257 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b67096-f08e-444c-a152-31f247494874 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:43:03.282802 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b67096-f08e-444c-a152-31f247494874 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:43:03.283083 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b67096-f08e-444c-a152-31f247494874 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:43:03.293276 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b67096-f08e-444c-a152-31f247494874 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:43:03.297112 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:43:03.297965 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application [None req-43b67096-f08e-444c-a152-31f247494874 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 21:43:03.297965 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:43:03.297965 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:43:03.297965 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:43:03.297965 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:43:03.297965 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:43:03.297965 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:43:03.297965 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:43:03.297965 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:43:03.297965 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:43:03.297965 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:43:03.297965 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:43:03.297965 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:43:03.297965 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:43:03.297965 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:43:03.297965 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:43:03.299227 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:43:03.299227 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:43:03.299227 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:43:03.299227 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:43:03.299227 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:43:03.299227 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:43:03.299227 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:43:03.299227 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:43:03.299227 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:43:03.299227 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:43:03.299227 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:43:03.299227 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application with Lock( Aug 18 21:43:03.299227 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:43:03.299227 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:43:03.299227 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:43:03.299227 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:43:03.300734 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:43:03.300734 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:43:03.300734 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:43:03.300734 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:43:03.300734 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:43:03.300734 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:43:03.300734 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:43:03.300734 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:43:03.300734 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:43:03.300734 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:43:03.300734 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 21:43:03.300734 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:43:03.300734 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 546/1094] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Aug 18 21:43:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 21:43:03.305383 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b67096-f08e-444c-a152-31f247494874 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:43:03.309923 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd56783-930f-47c2-9daa-2756220dc0e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:43:03.309923 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd56783-930f-47c2-9daa-2756220dc0e0 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:43:03.309923 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd56783-930f-47c2-9daa-2756220dc0e0 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:43:03.309923 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd56783-930f-47c2-9daa-2756220dc0e0 None admin] PATH_INFO: `/v3/users` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:43:03.310238 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd56783-930f-47c2-9daa-2756220dc0e0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:43:03.310238 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd56783-930f-47c2-9daa-2756220dc0e0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:43:03.310592 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd56783-930f-47c2-9daa-2756220dc0e0 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:43:03.338047 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 549/1095] 10.222.0.27 () {56 vars in 1133 bytes} [Thu Aug 18 21:43:03 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 21:43:03.343601 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd56783-930f-47c2-9daa-2756220dc0e0 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:43:03.408953 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b67096-f08e-444c-a152-31f247494874 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:43:03.442646 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439623a7-72b3-4596-92cf-82488295c233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:43:03.443228 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd56783-930f-47c2-9daa-2756220dc0e0 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:43:03.443345 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439623a7-72b3-4596-92cf-82488295c233 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:43:03.443510 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439623a7-72b3-4596-92cf-82488295c233 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:43:03.443782 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439623a7-72b3-4596-92cf-82488295c233 None admin] PATH_INFO: `/v3/roles` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:43:03.444440 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439623a7-72b3-4596-92cf-82488295c233 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:43:03.444772 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439623a7-72b3-4596-92cf-82488295c233 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:43:03.446123 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439623a7-72b3-4596-92cf-82488295c233 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:43:03.455392 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 547/1096] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Aug 18 21:43:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:43:03.460942 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439623a7-72b3-4596-92cf-82488295c233 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:43:03.478347 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6274cd25-35fe-40f0-be70-fb85b51ff70d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:43:03.478956 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6274cd25-35fe-40f0-be70-fb85b51ff70d None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:43:03.479236 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6274cd25-35fe-40f0-be70-fb85b51ff70d None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:43:03.479511 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6274cd25-35fe-40f0-be70-fb85b51ff70d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:43:03.485464 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:43:03.535155 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:43:03.546981 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6274cd25-35fe-40f0-be70-fb85b51ff70d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:43:03.548816 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6274cd25-35fe-40f0-be70-fb85b51ff70d None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:43:03.561474 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439623a7-72b3-4596-92cf-82488295c233 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:43:03.597269 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be70604-8787-40ca-8a6b-413167f5c1bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:43:03.597883 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be70604-8787-40ca-8a6b-413167f5c1bb None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:43:03.598160 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be70604-8787-40ca-8a6b-413167f5c1bb None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:43:03.598431 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be70604-8787-40ca-8a6b-413167f5c1bb None admin] PATH_INFO: `/v3/users/e3d441fcdfd64c118dec164a6c8951d2` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:43:03.599539 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be70604-8787-40ca-8a6b-413167f5c1bb None admin] RBAC: Authorizing `identity:get_user(user_id=e3d441fcdfd64c118dec164a6c8951d2)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:43:03.600981 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be70604-8787-40ca-8a6b-413167f5c1bb None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:43:03.602557 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 548/1097] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Aug 18 21:43:03 2022] GET /identity/v3/users/e3d441fcdfd64c118dec164a6c8951d2 => generated 285 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 21:43:03.608313 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be70604-8787-40ca-8a6b-413167f5c1bb None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:43:03.649034 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 550/1098] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Aug 18 21:43:03 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 18 21:43:03.654477 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6274cd25-35fe-40f0-be70-fb85b51ff70d None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:43:03.697783 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:43:03.707295 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be70604-8787-40ca-8a6b-413167f5c1bb None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:43:03.738222 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:43:03.741176 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7e122a-573b-4272-abfd-f4523ea853c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:43:03.741784 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7e122a-573b-4272-abfd-f4523ea853c6 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:43:03.742065 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7e122a-573b-4272-abfd-f4523ea853c6 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:43:03.742340 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7e122a-573b-4272-abfd-f4523ea853c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:43:03.749652 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6274cd25-35fe-40f0-be70-fb85b51ff70d None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:43:03.784108 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996e7046-03f9-4e15-8e58-4c71d26ca5a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:43:03.784769 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996e7046-03f9-4e15-8e58-4c71d26ca5a2 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:43:03.785052 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996e7046-03f9-4e15-8e58-4c71d26ca5a2 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:43:03.785325 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996e7046-03f9-4e15-8e58-4c71d26ca5a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:43:03.795251 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996e7046-03f9-4e15-8e58-4c71d26ca5a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:43:03.796717 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996e7046-03f9-4e15-8e58-4c71d26ca5a2 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:43:03.808982 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7e122a-573b-4272-abfd-f4523ea853c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:43:03.810406 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7e122a-573b-4272-abfd-f4523ea853c6 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:43:03.810712 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application [None req-996e7046-03f9-4e15-8e58-4c71d26ca5a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:43:03.810712 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:43:03.810712 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:43:03.810712 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:43:03.810712 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:43:03.810712 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:43:03.810712 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:43:03.810712 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:43:03.810712 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:43:03.810712 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:43:03.810712 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:43:03.810712 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:43:03.810712 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 21:43:03.810712 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 21:43:03.810712 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 21:43:03.810712 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 21:43:03.811708 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:43:03.811708 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:43:03.811708 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:43:03.811708 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:43:03.811708 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:43:03.811708 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:43:03.811708 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:43:03.811708 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application with Lock( Aug 18 21:43:03.811708 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:43:03.811708 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:43:03.811708 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:43:03.811708 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:43:03.811708 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:43:03.811708 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:43:03.811708 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:43:03.811708 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:43:03.811708 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 21:43:03.812715 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 21:43:03.812715 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:43:03.812715 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:43:03.812715 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 551/1099] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 18 21:43:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 21:43:03.818164 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996e7046-03f9-4e15-8e58-4c71d26ca5a2 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:43:03.899141 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:43:03.909579 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 549/1100] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Aug 18 21:43:03 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 18 21:43:03.915672 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7e122a-573b-4272-abfd-f4523ea853c6 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:43:03.918337 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996e7046-03f9-4e15-8e58-4c71d26ca5a2 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:43:03.952232 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6435c9be-bb28-45b7-90ac-5e7bbe24aac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:43:03.952804 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6435c9be-bb28-45b7-90ac-5e7bbe24aac3 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:43:03.953086 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6435c9be-bb28-45b7-90ac-5e7bbe24aac3 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:43:03.953359 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6435c9be-bb28-45b7-90ac-5e7bbe24aac3 None admin] PATH_INFO: `/v3/domains` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:43:03.954000 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6435c9be-bb28-45b7-90ac-5e7bbe24aac3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:43:03.954333 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6435c9be-bb28-45b7-90ac-5e7bbe24aac3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:43:03.955699 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6435c9be-bb28-45b7-90ac-5e7bbe24aac3 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:43:03.964250 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:43:03.967652 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 552/1101] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 18 21:43:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 21:43:03.973815 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6435c9be-bb28-45b7-90ac-5e7bbe24aac3 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:43:04.014629 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7e122a-573b-4272-abfd-f4523ea853c6 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:43:04.049602 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbad922-5b61-4a47-8ccc-7d44961c9499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:43:04.053640 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbad922-5b61-4a47-8ccc-7d44961c9499 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:43:04.053640 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbad922-5b61-4a47-8ccc-7d44961c9499 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:43:04.053640 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbad922-5b61-4a47-8ccc-7d44961c9499 None admin] PATH_INFO: `/v3/projects/3f45e8ef37e14b2ca7e9ccc40ea2d906` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:43:04.053640 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbad922-5b61-4a47-8ccc-7d44961c9499 None admin] RBAC: Authorizing `identity:get_project(project_id=3f45e8ef37e14b2ca7e9ccc40ea2d906)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:43:04.053640 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbad922-5b61-4a47-8ccc-7d44961c9499 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:43:04.054841 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 550/1102] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Aug 18 21:43:03 2022] GET /identity/v3/projects/3f45e8ef37e14b2ca7e9ccc40ea2d906 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:43:04.064411 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbad922-5b61-4a47-8ccc-7d44961c9499 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:43:04.080613 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6435c9be-bb28-45b7-90ac-5e7bbe24aac3 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:43:04.114547 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021223bd-7ef5-4afc-b2b0-2242323772c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:43:04.115166 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021223bd-7ef5-4afc-b2b0-2242323772c6 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:43:04.115440 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021223bd-7ef5-4afc-b2b0-2242323772c6 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:43:04.115708 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021223bd-7ef5-4afc-b2b0-2242323772c6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:43:04.122229 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021223bd-7ef5-4afc-b2b0-2242323772c6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:43:04.122600 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:43:04.123666 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021223bd-7ef5-4afc-b2b0-2242323772c6 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:43:04.135113 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application [None req-021223bd-7ef5-4afc-b2b0-2242323772c6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 21:43:04.135113 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:43:04.135113 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:43:04.135113 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:43:04.135113 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:43:04.135113 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:43:04.135113 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:43:04.135113 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:43:04.135113 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:43:04.135113 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:43:04.135113 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:43:04.135113 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:43:04.135113 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 21:43:04.135113 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 21:43:04.135113 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 21:43:04.136180 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 21:43:04.136180 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:43:04.136180 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:43:04.136180 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:43:04.136180 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:43:04.136180 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:43:04.136180 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:43:04.136180 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:43:04.136180 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application with Lock( Aug 18 21:43:04.136180 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:43:04.136180 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:43:04.136180 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:43:04.136180 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:43:04.136180 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:43:04.136180 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:43:04.136180 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:43:04.136180 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:43:04.137141 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 21:43:04.137141 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 21:43:04.137141 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 21:43:04.137141 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 21:43:04.137141 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 21:43:04.137141 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 21:43:04.137141 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 21:43:04.137141 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:43:04.137141 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 553/1103] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Aug 18 21:43:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 21:43:04.142780 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021223bd-7ef5-4afc-b2b0-2242323772c6 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:43:04.163800 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbad922-5b61-4a47-8ccc-7d44961c9499 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:43:04.198769 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2669b4d-18f5-4c5f-9828-c6e80e1329ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:43:04.199365 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2669b4d-18f5-4c5f-9828-c6e80e1329ff None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:43:04.199639 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2669b4d-18f5-4c5f-9828-c6e80e1329ff None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:43:04.199905 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2669b4d-18f5-4c5f-9828-c6e80e1329ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:43:04.200352 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:43:04.200638 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2669b4d-18f5-4c5f-9828-c6e80e1329ff None admin] RBAC: Adding query filter params (role.id=0833202e2a3d47d1b6b3af57006641b1, scope.project.id=3f45e8ef37e14b2ca7e9ccc40ea2d906, user.id=e3d441fcdfd64c118dec164a6c8951d2) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:43:04.201285 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2669b4d-18f5-4c5f-9828-c6e80e1329ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:43:04.202758 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2669b4d-18f5-4c5f-9828-c6e80e1329ff None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:43:04.217553 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 551/1104] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Aug 18 21:43:04 2022] GET /identity/v3/role_assignments?user.id=e3d441fcdfd64c118dec164a6c8951d2&scope.project.id=3f45e8ef37e14b2ca7e9ccc40ea2d906&role.id=0833202e2a3d47d1b6b3af57006641b1 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 21:43:04.242468 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021223bd-7ef5-4afc-b2b0-2242323772c6 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:43:04.282654 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0457f77b-5ced-455d-8891-e9d2db870254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:43:04.283239 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0457f77b-5ced-455d-8891-e9d2db870254 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:43:04.283524 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0457f77b-5ced-455d-8891-e9d2db870254 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:43:04.283795 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0457f77b-5ced-455d-8891-e9d2db870254 None admin] PATH_INFO: `/v3/projects` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:43:04.284495 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0457f77b-5ced-455d-8891-e9d2db870254 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:43:04.284835 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0457f77b-5ced-455d-8891-e9d2db870254 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:43:04.286314 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0457f77b-5ced-455d-8891-e9d2db870254 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:43:04.300227 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 554/1105] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Aug 18 21:43:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 21:43:04.306592 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2669b4d-18f5-4c5f-9828-c6e80e1329ff None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:43:04.413185 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2669b4d-18f5-4c5f-9828-c6e80e1329ff None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:43:04.435434 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:43:04.447121 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3199fa1d-3c81-4d51-ad76-ea47a9135fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:43:04.451894 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3199fa1d-3c81-4d51-ad76-ea47a9135fa4 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:43:04.451894 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3199fa1d-3c81-4d51-ad76-ea47a9135fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:43:04.451894 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3199fa1d-3c81-4d51-ad76-ea47a9135fa4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:43:04.451894 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3199fa1d-3c81-4d51-ad76-ea47a9135fa4 None admin] RBAC: Adding query filter params (role.id=ac9ba398413d4794800e1f777b75c1df, scope.project.id=4b54801b90484d689034f838f85fc0a4, user.id=a39cd50340184779ac589bbcb7cac9aa) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:43:04.451894 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3199fa1d-3c81-4d51-ad76-ea47a9135fa4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:43:04.451894 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3199fa1d-3c81-4d51-ad76-ea47a9135fa4 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:43:04.456731 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 552/1106] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Aug 18 21:43:04 2022] GET /identity/v3/role_assignments?user.id=a39cd50340184779ac589bbcb7cac9aa&scope.project.id=4b54801b90484d689034f838f85fc0a4&role.id=ac9ba398413d4794800e1f777b75c1df => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:43:06.145620 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46e2ff9-2d85-45ab-b339-339ecf496049 None None] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:43:06.146222 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46e2ff9-2d85-45ab-b339-339ecf496049 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:43:06.146222 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46e2ff9-2d85-45ab-b339-339ecf496049 None None] PATH_INFO: `/` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:43:06.147546 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 555/1107] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:43:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:43:06.152866 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbff9146-aa56-4100-8197-e525510ef361 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:43:06.153283 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbff9146-aa56-4100-8197-e525510ef361 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:43:06.153404 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbff9146-aa56-4100-8197-e525510ef361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:43:06.171178 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-fbff9146-aa56-4100-8197-e525510ef361 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:43:06.172366 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-fbff9146-aa56-4100-8197-e525510ef361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:43:06.238350 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 553/1108] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:43:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 21:43:06.512471 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46e2ff9-2d85-45ab-b339-339ecf496049 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:43:06.611350 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46e2ff9-2d85-45ab-b339-339ecf496049 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:43:06.630442 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:43:06.644260 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c70edf-373e-42b4-9f9c-1b3fba849daa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:43:06.644909 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c70edf-373e-42b4-9f9c-1b3fba849daa None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:43:06.645188 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c70edf-373e-42b4-9f9c-1b3fba849daa None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:43:06.645467 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c70edf-373e-42b4-9f9c-1b3fba849daa None admin] PATH_INFO: `/v3/domains/default` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:43:06.647139 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c70edf-373e-42b4-9f9c-1b3fba849daa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:43:06.648267 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c70edf-373e-42b4-9f9c-1b3fba849daa None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:43:06.649846 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 556/1109] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 18 21:43:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:43:06.655798 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbff9146-aa56-4100-8197-e525510ef361 None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:43:06.752018 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbff9146-aa56-4100-8197-e525510ef361 None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:43:06.767955 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:43:06.784919 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67e0fca-b4d2-4d54-8c9b-7450787050df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:43:06.786507 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67e0fca-b4d2-4d54-8c9b-7450787050df None admin] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:43:06.786507 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67e0fca-b4d2-4d54-8c9b-7450787050df None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:43:06.786507 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67e0fca-b4d2-4d54-8c9b-7450787050df None admin] PATH_INFO: `/v3/users` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:43:06.786752 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67e0fca-b4d2-4d54-8c9b-7450787050df None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:43:06.788113 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67e0fca-b4d2-4d54-8c9b-7450787050df None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:43:06.895511 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 554/1110] 10.222.0.27 () {60 vars in 1132 bytes} [Thu Aug 18 21:43:06 2022] POST /identity/v3/users => generated 286 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:43:08.824566 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6849d86d-3fda-4385-a916-f6953c4fa7c3 None None] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:43:08.825115 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6849d86d-3fda-4385-a916-f6953c4fa7c3 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:43:08.825229 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6849d86d-3fda-4385-a916-f6953c4fa7c3 None None] PATH_INFO: `/` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:43:08.826488 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 557/1111] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:43:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:43:08.832570 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b0171d-c9fb-44f6-aefc-891b5b11fc58 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:43:08.832965 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b0171d-c9fb-44f6-aefc-891b5b11fc58 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:43:08.833151 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b0171d-c9fb-44f6-aefc-891b5b11fc58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:43:08.851341 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-e6b0171d-c9fb-44f6-aefc-891b5b11fc58 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:43:08.852555 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-e6b0171d-c9fb-44f6-aefc-891b5b11fc58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:43:08.916663 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 555/1112] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:43:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 21:43:09.184645 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6849d86d-3fda-4385-a916-f6953c4fa7c3 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:43:09.283530 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6849d86d-3fda-4385-a916-f6953c4fa7c3 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:43:09.316898 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe09994-d2a0-417a-a205-2e8fb34c8617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:43:09.317521 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe09994-d2a0-417a-a205-2e8fb34c8617 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:43:09.317802 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe09994-d2a0-417a-a205-2e8fb34c8617 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:43:09.318076 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe09994-d2a0-417a-a205-2e8fb34c8617 None admin] PATH_INFO: `/v3/roles/66171a9efb5344c7a903946f238a3808` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:43:09.319458 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe09994-d2a0-417a-a205-2e8fb34c8617 None admin] RBAC: Authorizing `identity:get_role(role_id=66171a9efb5344c7a903946f238a3808)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:43:09.320863 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe09994-d2a0-417a-a205-2e8fb34c8617 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:43:09.322174 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 558/1113] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Aug 18 21:43:09 2022] GET /identity/v3/roles/66171a9efb5344c7a903946f238a3808 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:43:09.327901 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b0171d-c9fb-44f6-aefc-891b5b11fc58 None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:43:09.437001 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b0171d-c9fb-44f6-aefc-891b5b11fc58 None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:43:09.438413 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:43:09.470948 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b71b3b-77da-4f15-870a-ed53fd767ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:43:09.471562 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b71b3b-77da-4f15-870a-ed53fd767ec1 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:43:09.471843 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b71b3b-77da-4f15-870a-ed53fd767ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:43:09.472117 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b71b3b-77da-4f15-870a-ed53fd767ec1 None admin] PATH_INFO: `/v3/users/ab29885eff3c4bcd97ea939a94ce6b4a` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:43:09.484660 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b71b3b-77da-4f15-870a-ed53fd767ec1 None admin] RBAC: Authorizing `identity:get_user(user_id=ab29885eff3c4bcd97ea939a94ce6b4a)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:43:09.486137 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b71b3b-77da-4f15-870a-ed53fd767ec1 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:43:09.487733 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 556/1114] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Aug 18 21:43:09 2022] GET /identity/v3/users/ab29885eff3c4bcd97ea939a94ce6b4a => generated 286 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:43:09.493588 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe09994-d2a0-417a-a205-2e8fb34c8617 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:43:09.549324 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:43:09.591417 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe09994-d2a0-417a-a205-2e8fb34c8617 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:43:09.624876 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618ee42e-d480-4796-aeb8-7342c170fa9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:43:09.625462 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618ee42e-d480-4796-aeb8-7342c170fa9f None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:43:09.625738 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618ee42e-d480-4796-aeb8-7342c170fa9f None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:43:09.626010 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618ee42e-d480-4796-aeb8-7342c170fa9f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:43:09.692123 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618ee42e-d480-4796-aeb8-7342c170fa9f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:43:09.693538 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618ee42e-d480-4796-aeb8-7342c170fa9f None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:43:09.745425 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:43:09.787824 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 559/1115] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Aug 18 21:43:09 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 18 21:43:09.793713 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b71b3b-77da-4f15-870a-ed53fd767ec1 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:43:09.890007 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b71b3b-77da-4f15-870a-ed53fd767ec1 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:43:09.922323 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274dbd26-75b0-4445-ba0e-5783d10137c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:43:09.922928 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274dbd26-75b0-4445-ba0e-5783d10137c0 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:43:09.923858 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274dbd26-75b0-4445-ba0e-5783d10137c0 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:43:09.924127 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274dbd26-75b0-4445-ba0e-5783d10137c0 None admin] PATH_INFO: `/v3/projects/3f45e8ef37e14b2ca7e9ccc40ea2d906` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:43:09.925236 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274dbd26-75b0-4445-ba0e-5783d10137c0 None admin] RBAC: Authorizing `identity:get_project(project_id=3f45e8ef37e14b2ca7e9ccc40ea2d906)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:43:09.926677 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274dbd26-75b0-4445-ba0e-5783d10137c0 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:43:09.928264 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 557/1116] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Aug 18 21:43:09 2022] GET /identity/v3/projects/3f45e8ef37e14b2ca7e9ccc40ea2d906 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:43:09.934265 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618ee42e-d480-4796-aeb8-7342c170fa9f None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:43:10.028210 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618ee42e-d480-4796-aeb8-7342c170fa9f None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:43:10.060764 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eaf8cd-bbd2-42cb-8b7a-3966f263e78c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:43:10.061344 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eaf8cd-bbd2-42cb-8b7a-3966f263e78c None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:43:10.061619 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eaf8cd-bbd2-42cb-8b7a-3966f263e78c None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:43:10.061885 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eaf8cd-bbd2-42cb-8b7a-3966f263e78c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:43:10.062587 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65eaf8cd-bbd2-42cb-8b7a-3966f263e78c None admin] RBAC: Adding query filter params (role.id=66171a9efb5344c7a903946f238a3808, scope.project.id=3f45e8ef37e14b2ca7e9ccc40ea2d906, user.id=ab29885eff3c4bcd97ea939a94ce6b4a) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:43:10.062887 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65eaf8cd-bbd2-42cb-8b7a-3966f263e78c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:43:10.064435 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65eaf8cd-bbd2-42cb-8b7a-3966f263e78c None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:43:10.069553 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 560/1117] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Aug 18 21:43:09 2022] GET /identity/v3/role_assignments?user.id=ab29885eff3c4bcd97ea939a94ce6b4a&scope.project.id=3f45e8ef37e14b2ca7e9ccc40ea2d906&role.id=66171a9efb5344c7a903946f238a3808 => generated 259 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:43:11.930516 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12de3a30-b99d-4c56-b6dc-b8e1ff86a132 None None] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:43:11.931088 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12de3a30-b99d-4c56-b6dc-b8e1ff86a132 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:43:11.931088 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12de3a30-b99d-4c56-b6dc-b8e1ff86a132 None None] PATH_INFO: `/` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:43:11.932380 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 558/1118] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:43:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:43:11.937818 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d0cb40-f56a-4ac8-8546-7b7f24940650 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:43:11.938201 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d0cb40-f56a-4ac8-8546-7b7f24940650 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:43:11.938360 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d0cb40-f56a-4ac8-8546-7b7f24940650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:43:11.956569 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-36d0cb40-f56a-4ac8-8546-7b7f24940650 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:43:11.957770 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-36d0cb40-f56a-4ac8-8546-7b7f24940650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:43:11.971355 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:43:12.022218 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 561/1119] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:43:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 21:43:12.291624 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12de3a30-b99d-4c56-b6dc-b8e1ff86a132 None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:43:12.319335 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:43:12.389688 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12de3a30-b99d-4c56-b6dc-b8e1ff86a132 None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:43:12.421724 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bd1a53-0ea2-4985-b0ae-a34e81ffda42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:43:12.422331 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bd1a53-0ea2-4985-b0ae-a34e81ffda42 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:43:12.422603 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bd1a53-0ea2-4985-b0ae-a34e81ffda42 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:43:12.422870 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bd1a53-0ea2-4985-b0ae-a34e81ffda42 None admin] PATH_INFO: `/v3/roles/66171a9efb5344c7a903946f238a3808` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:43:12.424929 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bd1a53-0ea2-4985-b0ae-a34e81ffda42 None admin] RBAC: Authorizing `identity:get_role(role_id=66171a9efb5344c7a903946f238a3808)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:43:12.426258 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bd1a53-0ea2-4985-b0ae-a34e81ffda42 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:43:12.427543 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 559/1120] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Aug 18 21:43:12 2022] GET /identity/v3/roles/66171a9efb5344c7a903946f238a3808 => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:43:12.433553 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d0cb40-f56a-4ac8-8546-7b7f24940650 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:43:12.527925 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d0cb40-f56a-4ac8-8546-7b7f24940650 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:43:12.561027 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157d8898-5012-4f13-9aa6-319148d6a467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:43:12.561578 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157d8898-5012-4f13-9aa6-319148d6a467 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:43:12.561857 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157d8898-5012-4f13-9aa6-319148d6a467 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:43:12.562129 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157d8898-5012-4f13-9aa6-319148d6a467 None admin] PATH_INFO: `/v3/users/ab29885eff3c4bcd97ea939a94ce6b4a` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:43:12.563237 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157d8898-5012-4f13-9aa6-319148d6a467 None admin] RBAC: Authorizing `identity:get_user(user_id=ab29885eff3c4bcd97ea939a94ce6b4a)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:43:12.565305 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157d8898-5012-4f13-9aa6-319148d6a467 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:43:12.566867 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 562/1121] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Aug 18 21:43:12 2022] GET /identity/v3/users/ab29885eff3c4bcd97ea939a94ce6b4a => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:43:12.572567 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bd1a53-0ea2-4985-b0ae-a34e81ffda42 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:43:12.663364 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:43:12.669035 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bd1a53-0ea2-4985-b0ae-a34e81ffda42 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:43:12.704458 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faae3226-eda9-41ca-9c50-fcd597fad7c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:43:12.705140 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faae3226-eda9-41ca-9c50-fcd597fad7c0 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:43:12.705419 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faae3226-eda9-41ca-9c50-fcd597fad7c0 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:43:12.705690 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faae3226-eda9-41ca-9c50-fcd597fad7c0 None admin] PATH_INFO: `/v3/projects/3f45e8ef37e14b2ca7e9ccc40ea2d906` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:43:12.706796 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faae3226-eda9-41ca-9c50-fcd597fad7c0 None admin] RBAC: Authorizing `identity:get_project(project_id=3f45e8ef37e14b2ca7e9ccc40ea2d906)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:43:12.708206 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faae3226-eda9-41ca-9c50-fcd597fad7c0 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:43:12.709854 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 560/1122] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Aug 18 21:43:12 2022] GET /identity/v3/projects/3f45e8ef37e14b2ca7e9ccc40ea2d906 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:43:12.715758 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157d8898-5012-4f13-9aa6-319148d6a467 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:43:12.734152 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:43:12.812453 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157d8898-5012-4f13-9aa6-319148d6a467 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:43:12.846853 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfa821b-f414-48a8-a2cc-57f1183019c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:43:12.847496 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfa821b-f414-48a8-a2cc-57f1183019c9 None admin] REQUEST_METHOD: `PUT` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:43:12.847773 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfa821b-f414-48a8-a2cc-57f1183019c9 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:43:12.848045 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfa821b-f414-48a8-a2cc-57f1183019c9 None admin] PATH_INFO: `/v3/projects/3f45e8ef37e14b2ca7e9ccc40ea2d906/users/ab29885eff3c4bcd97ea939a94ce6b4a/roles/66171a9efb5344c7a903946f238a3808` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:43:12.850176 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfa821b-f414-48a8-a2cc-57f1183019c9 None admin] RBAC: Authorizing `identity:create_grant(project_id=3f45e8ef37e14b2ca7e9ccc40ea2d906, user_id=ab29885eff3c4bcd97ea939a94ce6b4a, role_id=66171a9efb5344c7a903946f238a3808)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:43:12.851598 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfa821b-f414-48a8-a2cc-57f1183019c9 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:43:12.922529 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 563/1123] 10.222.0.27 () {58 vars in 1439 bytes} [Thu Aug 18 21:43:12 2022] PUT /identity/v3/projects/3f45e8ef37e14b2ca7e9ccc40ea2d906/users/ab29885eff3c4bcd97ea939a94ce6b4a/roles/66171a9efb5344c7a903946f238a3808 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:43:14.793222 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f0ed74-a892-4465-a8d0-85e9da900c21 None None] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:43:14.793749 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f0ed74-a892-4465-a8d0-85e9da900c21 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:43:14.793749 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f0ed74-a892-4465-a8d0-85e9da900c21 None None] PATH_INFO: `/` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:43:14.795111 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 561/1124] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:43:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:43:14.801139 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb0c2a2-d9ff-4cbe-9fc0-b614e6827001 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:43:14.801584 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb0c2a2-d9ff-4cbe-9fc0-b614e6827001 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:43:14.801691 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb0c2a2-d9ff-4cbe-9fc0-b614e6827001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:43:14.819632 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-beb0c2a2-d9ff-4cbe-9fc0-b614e6827001 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:43:14.820849 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-beb0c2a2-d9ff-4cbe-9fc0-b614e6827001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:43:14.884308 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 564/1125] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:43:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 21:43:15.151793 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f0ed74-a892-4465-a8d0-85e9da900c21 None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:43:15.250310 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f0ed74-a892-4465-a8d0-85e9da900c21 None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:43:15.284013 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0dd479-f4b3-4b5f-a249-ee6e4bdf2b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:43:15.284679 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0dd479-f4b3-4b5f-a249-ee6e4bdf2b25 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:43:15.284969 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0dd479-f4b3-4b5f-a249-ee6e4bdf2b25 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:43:15.285245 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0dd479-f4b3-4b5f-a249-ee6e4bdf2b25 None admin] PATH_INFO: `/v3/roles/66171a9efb5344c7a903946f238a3808` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:43:15.286681 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0dd479-f4b3-4b5f-a249-ee6e4bdf2b25 None admin] RBAC: Authorizing `identity:get_role(role_id=66171a9efb5344c7a903946f238a3808)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:43:15.288037 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0dd479-f4b3-4b5f-a249-ee6e4bdf2b25 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:43:15.289405 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 562/1126] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Aug 18 21:43:15 2022] GET /identity/v3/roles/66171a9efb5344c7a903946f238a3808 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:43:15.295198 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb0c2a2-d9ff-4cbe-9fc0-b614e6827001 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:43:15.306011 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:43:15.393193 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb0c2a2-d9ff-4cbe-9fc0-b614e6827001 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:43:15.426783 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13453bfe-df66-437b-9136-a36782923739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:43:15.427339 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13453bfe-df66-437b-9136-a36782923739 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:43:15.427618 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13453bfe-df66-437b-9136-a36782923739 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:43:15.427890 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13453bfe-df66-437b-9136-a36782923739 None admin] PATH_INFO: `/v3/users/ab29885eff3c4bcd97ea939a94ce6b4a` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:43:15.429020 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13453bfe-df66-437b-9136-a36782923739 None admin] RBAC: Authorizing `identity:get_user(user_id=ab29885eff3c4bcd97ea939a94ce6b4a)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:43:15.430459 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13453bfe-df66-437b-9136-a36782923739 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:43:15.432013 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 565/1127] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Aug 18 21:43:15 2022] GET /identity/v3/users/ab29885eff3c4bcd97ea939a94ce6b4a => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:43:15.437802 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0dd479-f4b3-4b5f-a249-ee6e4bdf2b25 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:43:15.469920 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:43:15.538562 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0dd479-f4b3-4b5f-a249-ee6e4bdf2b25 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:43:15.572713 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1836c1e-8e4d-49fb-91a4-df4dd8d2887c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:43:15.573306 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1836c1e-8e4d-49fb-91a4-df4dd8d2887c None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:43:15.573587 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1836c1e-8e4d-49fb-91a4-df4dd8d2887c None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:43:15.573859 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1836c1e-8e4d-49fb-91a4-df4dd8d2887c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:43:15.639742 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1836c1e-8e4d-49fb-91a4-df4dd8d2887c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:43:15.641213 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1836c1e-8e4d-49fb-91a4-df4dd8d2887c None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:43:15.670059 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:43:15.738743 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 563/1128] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Aug 18 21:43:15 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 18 21:43:15.744582 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13453bfe-df66-437b-9136-a36782923739 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:43:15.820200 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:43:15.842634 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13453bfe-df66-437b-9136-a36782923739 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:43:15.875910 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2e7659-b425-485c-98ee-cb6f294ce88c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:43:15.877056 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2e7659-b425-485c-98ee-cb6f294ce88c None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:43:15.877331 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2e7659-b425-485c-98ee-cb6f294ce88c None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:43:15.877600 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2e7659-b425-485c-98ee-cb6f294ce88c None admin] PATH_INFO: `/v3/projects/3f45e8ef37e14b2ca7e9ccc40ea2d906` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:43:15.878706 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2e7659-b425-485c-98ee-cb6f294ce88c None admin] RBAC: Authorizing `identity:get_project(project_id=3f45e8ef37e14b2ca7e9ccc40ea2d906)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:43:15.880130 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2e7659-b425-485c-98ee-cb6f294ce88c None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:43:15.881773 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 566/1129] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Aug 18 21:43:15 2022] GET /identity/v3/projects/3f45e8ef37e14b2ca7e9ccc40ea2d906 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:43:15.887967 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1836c1e-8e4d-49fb-91a4-df4dd8d2887c None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:43:15.982583 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1836c1e-8e4d-49fb-91a4-df4dd8d2887c None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:43:16.011565 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:43:16.016144 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a3be3d-bf46-461f-bbec-bf9b1b446b95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:43:16.016773 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a3be3d-bf46-461f-bbec-bf9b1b446b95 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:43:16.017738 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a3be3d-bf46-461f-bbec-bf9b1b446b95 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:43:16.023946 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a3be3d-bf46-461f-bbec-bf9b1b446b95 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:43:16.023946 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a3be3d-bf46-461f-bbec-bf9b1b446b95 None admin] RBAC: Adding query filter params (role.id=66171a9efb5344c7a903946f238a3808, scope.project.id=3f45e8ef37e14b2ca7e9ccc40ea2d906, user.id=ab29885eff3c4bcd97ea939a94ce6b4a) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:43:16.023946 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a3be3d-bf46-461f-bbec-bf9b1b446b95 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:43:16.023946 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a3be3d-bf46-461f-bbec-bf9b1b446b95 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:43:16.026091 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 564/1130] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Aug 18 21:43:15 2022] GET /identity/v3/role_assignments?user.id=ab29885eff3c4bcd97ea939a94ce6b4a&scope.project.id=3f45e8ef37e14b2ca7e9ccc40ea2d906&role.id=66171a9efb5344c7a903946f238a3808 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:43:17.952263 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5500a2-89f1-4779-b120-d0e71d726056 None None] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:43:17.952847 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5500a2-89f1-4779-b120-d0e71d726056 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:43:17.952847 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5500a2-89f1-4779-b120-d0e71d726056 None None] PATH_INFO: `/` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:43:17.954140 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 567/1131] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:43:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:43:17.959984 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0492505-d31d-43b3-bfab-778a2c15d071 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:43:17.960424 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0492505-d31d-43b3-bfab-778a2c15d071 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:43:17.960519 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0492505-d31d-43b3-bfab-778a2c15d071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:43:17.978831 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-b0492505-d31d-43b3-bfab-778a2c15d071 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:43:17.980000 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-b0492505-d31d-43b3-bfab-778a2c15d071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:43:18.044209 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 565/1132] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:43:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 21:43:18.308244 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5500a2-89f1-4779-b120-d0e71d726056 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:43:18.405920 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5500a2-89f1-4779-b120-d0e71d726056 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:43:18.438347 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545d1cd7-a2b4-40b8-adb6-97fddffddccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:43:18.439487 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545d1cd7-a2b4-40b8-adb6-97fddffddccd None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:43:18.439902 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545d1cd7-a2b4-40b8-adb6-97fddffddccd None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:43:18.440172 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545d1cd7-a2b4-40b8-adb6-97fddffddccd None admin] PATH_INFO: `/v3/domains/default` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:43:18.441293 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545d1cd7-a2b4-40b8-adb6-97fddffddccd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:43:18.442702 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545d1cd7-a2b4-40b8-adb6-97fddffddccd None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:43:18.444215 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 568/1133] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 18 21:43:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:43:18.449966 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0492505-d31d-43b3-bfab-778a2c15d071 None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:43:18.546457 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0492505-d31d-43b3-bfab-778a2c15d071 None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:43:18.571828 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:43:18.580858 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1017013-5e1b-4d0f-87a9-e9a5ece88335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:43:18.582671 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1017013-5e1b-4d0f-87a9-e9a5ece88335 None admin] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:43:18.582671 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1017013-5e1b-4d0f-87a9-e9a5ece88335 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:43:18.582671 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1017013-5e1b-4d0f-87a9-e9a5ece88335 None admin] PATH_INFO: `/v3/projects` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:43:18.582671 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1017013-5e1b-4d0f-87a9-e9a5ece88335 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:43:18.584024 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1017013-5e1b-4d0f-87a9-e9a5ece88335 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:43:18.680780 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 566/1134] 10.222.0.27 () {60 vars in 1141 bytes} [Thu Aug 18 21:43:18 2022] POST /identity/v3/projects => generated 311 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:43:20.608714 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfccf0e-ab98-4165-ba73-9b93d085bb73 None None] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:43:20.609242 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfccf0e-ab98-4165-ba73-9b93d085bb73 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:43:20.609336 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfccf0e-ab98-4165-ba73-9b93d085bb73 None None] PATH_INFO: `/` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:43:20.610603 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 569/1135] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:43:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:43:20.616437 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd1f5ba-ab40-4c28-b112-4082d52adcbf None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:43:20.616891 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd1f5ba-ab40-4c28-b112-4082d52adcbf None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:43:20.617024 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd1f5ba-ab40-4c28-b112-4082d52adcbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:43:20.635047 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-0cd1f5ba-ab40-4c28-b112-4082d52adcbf None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:43:20.636224 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-0cd1f5ba-ab40-4c28-b112-4082d52adcbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:43:20.700512 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 567/1136] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:43:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 21:43:20.974158 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfccf0e-ab98-4165-ba73-9b93d085bb73 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:43:20.988980 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:43:21.075396 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfccf0e-ab98-4165-ba73-9b93d085bb73 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:43:21.108999 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ace9369-3245-4da5-8025-2becde0565e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:43:21.109614 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ace9369-3245-4da5-8025-2becde0565e7 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:43:21.109890 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ace9369-3245-4da5-8025-2becde0565e7 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:43:21.110160 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ace9369-3245-4da5-8025-2becde0565e7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:43:21.111362 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ace9369-3245-4da5-8025-2becde0565e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:43:21.112820 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ace9369-3245-4da5-8025-2becde0565e7 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:43:21.114366 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 570/1137] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 18 21:43:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:43:21.120169 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd1f5ba-ab40-4c28-b112-4082d52adcbf None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:43:21.216026 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd1f5ba-ab40-4c28-b112-4082d52adcbf None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:43:21.225403 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:43:21.249559 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4968a859-f1f9-4b6a-b708-dfe3d829dca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:43:21.250159 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4968a859-f1f9-4b6a-b708-dfe3d829dca9 None admin] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:43:21.250437 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4968a859-f1f9-4b6a-b708-dfe3d829dca9 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:43:21.250710 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4968a859-f1f9-4b6a-b708-dfe3d829dca9 None admin] PATH_INFO: `/v3/users` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:43:21.251911 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4968a859-f1f9-4b6a-b708-dfe3d829dca9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:43:21.253407 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4968a859-f1f9-4b6a-b708-dfe3d829dca9 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:43:21.359841 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 568/1138] 10.222.0.27 () {60 vars in 1132 bytes} [Thu Aug 18 21:43:21 2022] POST /identity/v3/users => generated 286 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:43:23.295701 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1d9b11-7964-4b28-b670-3d8ce45c04a9 None None] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:43:23.296130 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1d9b11-7964-4b28-b670-3d8ce45c04a9 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:43:23.296251 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1d9b11-7964-4b28-b670-3d8ce45c04a9 None None] PATH_INFO: `/` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:43:23.297604 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 571/1139] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:43:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:43:23.303360 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce52ecc0-06cd-4fde-8f31-88e9264dd246 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:43:23.303769 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce52ecc0-06cd-4fde-8f31-88e9264dd246 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:43:23.303913 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce52ecc0-06cd-4fde-8f31-88e9264dd246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:43:23.322499 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-ce52ecc0-06cd-4fde-8f31-88e9264dd246 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:43:23.323688 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-ce52ecc0-06cd-4fde-8f31-88e9264dd246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:43:23.389842 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 569/1140] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:43:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 21:43:23.656273 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1d9b11-7964-4b28-b670-3d8ce45c04a9 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:43:23.734021 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:43:23.753808 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1d9b11-7964-4b28-b670-3d8ce45c04a9 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:43:23.786639 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaf0bd4-9712-460f-9bd4-784779e3a411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:43:23.787257 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaf0bd4-9712-460f-9bd4-784779e3a411 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:43:23.787537 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaf0bd4-9712-460f-9bd4-784779e3a411 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:43:23.787810 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaf0bd4-9712-460f-9bd4-784779e3a411 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:43:23.797684 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaf0bd4-9712-460f-9bd4-784779e3a411 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:43:23.803066 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application [None req-abaf0bd4-9712-460f-9bd4-784779e3a411 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 21:43:23.803066 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:43:23.803066 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:43:23.803066 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:43:23.803066 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:43:23.803066 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:43:23.803066 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:43:23.803066 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:43:23.803066 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:43:23.803066 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:43:23.803066 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:43:23.803066 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:43:23.803066 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:43:23.803066 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:43:23.803066 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:43:23.803066 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:43:23.804214 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:43:23.804214 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:43:23.804214 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:43:23.804214 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:43:23.804214 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:43:23.804214 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:43:23.804214 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:43:23.804214 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:43:23.804214 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:43:23.804214 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:43:23.804214 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:43:23.804214 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application with Lock( Aug 18 21:43:23.804214 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:43:23.804214 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:43:23.804214 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:43:23.804214 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:43:23.805209 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:43:23.805209 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:43:23.805209 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:43:23.805209 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:43:23.805209 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:43:23.805209 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:43:23.805209 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:43:23.805209 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:43:23.805209 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:43:23.805209 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:43:23.805209 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 21:43:23.805209 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:43:23.805209 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 572/1141] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Aug 18 21:43:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:43:23.810403 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce52ecc0-06cd-4fde-8f31-88e9264dd246 None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:43:23.899396 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:43:23.905804 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce52ecc0-06cd-4fde-8f31-88e9264dd246 None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:43:23.938791 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ff9bf0-8fdf-472d-90c2-41a49b73c2d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:43:23.939866 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ff9bf0-8fdf-472d-90c2-41a49b73c2d4 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:43:23.940142 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ff9bf0-8fdf-472d-90c2-41a49b73c2d4 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:43:23.940413 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ff9bf0-8fdf-472d-90c2-41a49b73c2d4 None admin] PATH_INFO: `/v3/roles` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:43:23.941101 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ff9bf0-8fdf-472d-90c2-41a49b73c2d4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:43:23.941655 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ff9bf0-8fdf-472d-90c2-41a49b73c2d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:43:23.943158 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ff9bf0-8fdf-472d-90c2-41a49b73c2d4 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:43:23.951237 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 570/1142] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Aug 18 21:43:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:43:23.957240 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaf0bd4-9712-460f-9bd4-784779e3a411 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:43:24.057008 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaf0bd4-9712-460f-9bd4-784779e3a411 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:43:24.090832 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198c42f9-6c05-4370-b6b0-a1f110505c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:43:24.091449 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198c42f9-6c05-4370-b6b0-a1f110505c40 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:43:24.091729 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198c42f9-6c05-4370-b6b0-a1f110505c40 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:43:24.092001 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198c42f9-6c05-4370-b6b0-a1f110505c40 None admin] PATH_INFO: `/v3/users/a72c9fc37c984c3a9595e3742c7181f2` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:43:24.102539 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:43:24.105731 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198c42f9-6c05-4370-b6b0-a1f110505c40 None admin] RBAC: Authorizing `identity:get_user(user_id=a72c9fc37c984c3a9595e3742c7181f2)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:43:24.107162 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198c42f9-6c05-4370-b6b0-a1f110505c40 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:43:24.108776 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 573/1143] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Aug 18 21:43:23 2022] GET /identity/v3/users/a72c9fc37c984c3a9595e3742c7181f2 => generated 286 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:43:24.114668 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ff9bf0-8fdf-472d-90c2-41a49b73c2d4 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:43:24.288253 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ff9bf0-8fdf-472d-90c2-41a49b73c2d4 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:43:24.321001 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65017a5d-1094-462c-8f62-2f8cceb94367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:43:24.321595 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65017a5d-1094-462c-8f62-2f8cceb94367 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:43:24.321869 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65017a5d-1094-462c-8f62-2f8cceb94367 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:43:24.322133 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65017a5d-1094-462c-8f62-2f8cceb94367 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:43:24.346968 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:43:24.388111 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65017a5d-1094-462c-8f62-2f8cceb94367 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:43:24.389577 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65017a5d-1094-462c-8f62-2f8cceb94367 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:43:24.486223 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 571/1144] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Aug 18 21:43:24 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 18 21:43:24.492196 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198c42f9-6c05-4370-b6b0-a1f110505c40 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:43:24.588042 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198c42f9-6c05-4370-b6b0-a1f110505c40 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:43:24.620728 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9778a63a-ea42-42b8-9596-aa100475a70a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:43:24.621337 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9778a63a-ea42-42b8-9596-aa100475a70a None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:43:24.621612 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9778a63a-ea42-42b8-9596-aa100475a70a None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:43:24.621882 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9778a63a-ea42-42b8-9596-aa100475a70a None admin] PATH_INFO: `/v3/projects/1dc971d2eb8246d8b556109532b50c0a` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:43:24.622984 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9778a63a-ea42-42b8-9596-aa100475a70a None admin] RBAC: Authorizing `identity:get_project(project_id=1dc971d2eb8246d8b556109532b50c0a)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:43:24.624400 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9778a63a-ea42-42b8-9596-aa100475a70a None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:43:24.626029 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 574/1145] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Aug 18 21:43:24 2022] GET /identity/v3/projects/1dc971d2eb8246d8b556109532b50c0a => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:43:24.632313 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65017a5d-1094-462c-8f62-2f8cceb94367 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:43:24.687168 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:43:24.729938 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65017a5d-1094-462c-8f62-2f8cceb94367 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:43:24.763707 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5115081f-dfaa-4d98-bdfb-eac163b021fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:43:24.764301 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5115081f-dfaa-4d98-bdfb-eac163b021fa None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:43:24.764581 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5115081f-dfaa-4d98-bdfb-eac163b021fa None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:43:24.764881 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5115081f-dfaa-4d98-bdfb-eac163b021fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:43:24.765593 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5115081f-dfaa-4d98-bdfb-eac163b021fa None admin] RBAC: Adding query filter params (role.id=0833202e2a3d47d1b6b3af57006641b1, scope.project.id=1dc971d2eb8246d8b556109532b50c0a, user.id=a72c9fc37c984c3a9595e3742c7181f2) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:43:24.765899 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5115081f-dfaa-4d98-bdfb-eac163b021fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:43:24.767756 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5115081f-dfaa-4d98-bdfb-eac163b021fa None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:43:24.773103 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 572/1146] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Aug 18 21:43:24 2022] GET /identity/v3/role_assignments?user.id=a72c9fc37c984c3a9595e3742c7181f2&scope.project.id=1dc971d2eb8246d8b556109532b50c0a&role.id=0833202e2a3d47d1b6b3af57006641b1 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 21:43:26.642894 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7569846-1625-49d9-b5b6-53ad12a25e18 None None] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:43:26.643617 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7569846-1625-49d9-b5b6-53ad12a25e18 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:43:26.643617 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7569846-1625-49d9-b5b6-53ad12a25e18 None None] PATH_INFO: `/` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:43:26.644851 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 575/1147] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:43:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:43:26.650015 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d0450e-e3bd-4dcf-8c86-6c87cbebe89b None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:43:26.650383 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d0450e-e3bd-4dcf-8c86-6c87cbebe89b None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:43:26.650559 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d0450e-e3bd-4dcf-8c86-6c87cbebe89b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:43:26.668442 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-e8d0450e-e3bd-4dcf-8c86-6c87cbebe89b None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:43:26.669642 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-e8d0450e-e3bd-4dcf-8c86-6c87cbebe89b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:43:26.733371 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 573/1148] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:43:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 21:43:27.005071 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7569846-1625-49d9-b5b6-53ad12a25e18 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:43:27.070312 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:43:27.104797 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7569846-1625-49d9-b5b6-53ad12a25e18 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:43:27.137738 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c8fca5-5b34-4a37-8479-5e4dd97e1de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:43:27.138349 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c8fca5-5b34-4a37-8479-5e4dd97e1de4 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:43:27.138628 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c8fca5-5b34-4a37-8479-5e4dd97e1de4 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:43:27.138899 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c8fca5-5b34-4a37-8479-5e4dd97e1de4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:43:27.148937 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c8fca5-5b34-4a37-8479-5e4dd97e1de4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:43:27.153557 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application [None req-54c8fca5-5b34-4a37-8479-5e4dd97e1de4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 21:43:27.153557 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:43:27.153557 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:43:27.153557 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:43:27.153557 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:43:27.153557 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:43:27.153557 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:43:27.153557 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:43:27.153557 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:43:27.153557 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:43:27.153557 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:43:27.153557 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:43:27.153557 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:43:27.153557 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:43:27.153557 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:43:27.153557 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:43:27.154626 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:43:27.154626 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:43:27.154626 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:43:27.154626 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:43:27.154626 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:43:27.154626 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:43:27.154626 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:43:27.154626 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:43:27.154626 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:43:27.154626 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:43:27.154626 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:43:27.154626 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application with Lock( Aug 18 21:43:27.154626 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:43:27.154626 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:43:27.154626 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:43:27.154626 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:43:27.155475 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:43:27.155475 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:43:27.155475 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:43:27.155475 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:43:27.155475 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:43:27.155475 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:43:27.155475 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:43:27.155475 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:43:27.155475 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:43:27.155475 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:43:27.155475 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 21:43:27.155475 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:43:27.155475 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 576/1149] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Aug 18 21:43:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:43:27.161676 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d0450e-e3bd-4dcf-8c86-6c87cbebe89b None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:43:27.211045 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:43:27.258993 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d0450e-e3bd-4dcf-8c86-6c87cbebe89b None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:43:27.292401 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df24448-7089-4823-9aae-00591928f028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:43:27.293046 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df24448-7089-4823-9aae-00591928f028 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:43:27.293331 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df24448-7089-4823-9aae-00591928f028 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:43:27.293605 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df24448-7089-4823-9aae-00591928f028 None admin] PATH_INFO: `/v3/roles` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:43:27.294292 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df24448-7089-4823-9aae-00591928f028 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:43:27.294594 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df24448-7089-4823-9aae-00591928f028 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:43:27.295961 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df24448-7089-4823-9aae-00591928f028 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:43:27.304059 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 574/1150] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Aug 18 21:43:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:43:27.309889 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c8fca5-5b34-4a37-8479-5e4dd97e1de4 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:43:27.406776 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c8fca5-5b34-4a37-8479-5e4dd97e1de4 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:43:27.432258 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:43:27.440736 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ab51cf-e284-4aba-8827-13d0ee7d70cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:43:27.441352 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ab51cf-e284-4aba-8827-13d0ee7d70cd None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:43:27.441631 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ab51cf-e284-4aba-8827-13d0ee7d70cd None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:43:27.447608 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ab51cf-e284-4aba-8827-13d0ee7d70cd None admin] PATH_INFO: `/v3/users/a72c9fc37c984c3a9595e3742c7181f2` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:43:27.447608 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ab51cf-e284-4aba-8827-13d0ee7d70cd None admin] RBAC: Authorizing `identity:get_user(user_id=a72c9fc37c984c3a9595e3742c7181f2)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:43:27.447608 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ab51cf-e284-4aba-8827-13d0ee7d70cd None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:43:27.447608 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 577/1151] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Aug 18 21:43:27 2022] GET /identity/v3/users/a72c9fc37c984c3a9595e3742c7181f2 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:43:27.451833 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df24448-7089-4823-9aae-00591928f028 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:43:27.550416 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df24448-7089-4823-9aae-00591928f028 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:43:27.562515 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:43:27.584963 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d01d2a-c480-4434-93da-86e1b1966e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:43:27.585586 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d01d2a-c480-4434-93da-86e1b1966e7d None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:43:27.585862 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d01d2a-c480-4434-93da-86e1b1966e7d None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:43:27.586138 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d01d2a-c480-4434-93da-86e1b1966e7d None admin] PATH_INFO: `/v3/projects/1dc971d2eb8246d8b556109532b50c0a` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:43:27.587241 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d01d2a-c480-4434-93da-86e1b1966e7d None admin] RBAC: Authorizing `identity:get_project(project_id=1dc971d2eb8246d8b556109532b50c0a)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:43:27.588682 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d01d2a-c480-4434-93da-86e1b1966e7d None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:43:27.590305 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 575/1152] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Aug 18 21:43:27 2022] GET /identity/v3/projects/1dc971d2eb8246d8b556109532b50c0a => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:43:27.597029 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ab51cf-e284-4aba-8827-13d0ee7d70cd None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:43:27.693040 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ab51cf-e284-4aba-8827-13d0ee7d70cd None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:43:27.725748 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad52ef32-9f16-472a-8900-52146345b4f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:43:27.726387 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad52ef32-9f16-472a-8900-52146345b4f1 None admin] REQUEST_METHOD: `PUT` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:43:27.726662 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad52ef32-9f16-472a-8900-52146345b4f1 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:43:27.726932 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad52ef32-9f16-472a-8900-52146345b4f1 None admin] PATH_INFO: `/v3/projects/1dc971d2eb8246d8b556109532b50c0a/users/a72c9fc37c984c3a9595e3742c7181f2/roles/0833202e2a3d47d1b6b3af57006641b1` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:43:27.728823 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad52ef32-9f16-472a-8900-52146345b4f1 None admin] RBAC: Authorizing `identity:create_grant(project_id=1dc971d2eb8246d8b556109532b50c0a, user_id=a72c9fc37c984c3a9595e3742c7181f2, role_id=0833202e2a3d47d1b6b3af57006641b1)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:43:27.730244 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad52ef32-9f16-472a-8900-52146345b4f1 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:43:27.815840 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 578/1153] 10.222.0.27 () {58 vars in 1439 bytes} [Thu Aug 18 21:43:27 2022] PUT /identity/v3/projects/1dc971d2eb8246d8b556109532b50c0a/users/a72c9fc37c984c3a9595e3742c7181f2/roles/0833202e2a3d47d1b6b3af57006641b1 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:43:29.712549 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04336397-8ae7-472b-a27f-34d2da3858c1 None None] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:43:29.713098 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04336397-8ae7-472b-a27f-34d2da3858c1 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:43:29.713098 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04336397-8ae7-472b-a27f-34d2da3858c1 None None] PATH_INFO: `/` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:43:29.714452 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 576/1154] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:43:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:43:29.719569 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d85b650-f111-41f9-a608-f92959c1b493 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:43:29.719989 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d85b650-f111-41f9-a608-f92959c1b493 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:43:29.720115 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d85b650-f111-41f9-a608-f92959c1b493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:43:29.738415 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-9d85b650-f111-41f9-a608-f92959c1b493 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:43:29.739601 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-9d85b650-f111-41f9-a608-f92959c1b493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:43:29.787810 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:43:29.804452 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 579/1155] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:43:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 21:43:30.070755 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04336397-8ae7-472b-a27f-34d2da3858c1 None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:43:30.169332 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04336397-8ae7-472b-a27f-34d2da3858c1 None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:43:30.201861 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb6b2dc-cb2d-4b24-ad53-8c89abe37e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:43:30.202477 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb6b2dc-cb2d-4b24-ad53-8c89abe37e39 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:43:30.202754 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb6b2dc-cb2d-4b24-ad53-8c89abe37e39 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:43:30.203017 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb6b2dc-cb2d-4b24-ad53-8c89abe37e39 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:43:30.213460 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb6b2dc-cb2d-4b24-ad53-8c89abe37e39 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:43:30.218095 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application [None req-7fb6b2dc-cb2d-4b24-ad53-8c89abe37e39 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 21:43:30.218095 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:43:30.218095 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:43:30.218095 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:43:30.218095 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:43:30.218095 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:43:30.218095 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:43:30.218095 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:43:30.218095 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:43:30.218095 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:43:30.218095 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:43:30.218095 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:43:30.218095 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:43:30.218095 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:43:30.218095 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:43:30.218095 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:43:30.219179 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:43:30.219179 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:43:30.219179 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:43:30.219179 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:43:30.219179 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:43:30.219179 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:43:30.219179 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:43:30.219179 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:43:30.219179 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:43:30.219179 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:43:30.219179 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:43:30.219179 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application with Lock( Aug 18 21:43:30.219179 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:43:30.219179 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:43:30.219179 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:43:30.219179 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:43:30.220109 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:43:30.220109 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:43:30.220109 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:43:30.220109 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:43:30.220109 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:43:30.220109 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:43:30.220109 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:43:30.220109 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:43:30.220109 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:43:30.220109 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:43:30.220109 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 21:43:30.220109 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:43:30.220109 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 577/1156] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Aug 18 21:43:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:43:30.225814 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d85b650-f111-41f9-a608-f92959c1b493 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:43:30.324666 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d85b650-f111-41f9-a608-f92959c1b493 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:43:30.357154 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c885ae5f-38fc-4387-b7c6-ed07a7527f57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:43:30.357748 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c885ae5f-38fc-4387-b7c6-ed07a7527f57 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:43:30.358024 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c885ae5f-38fc-4387-b7c6-ed07a7527f57 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:43:30.358294 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c885ae5f-38fc-4387-b7c6-ed07a7527f57 None admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:43:30.358953 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c885ae5f-38fc-4387-b7c6-ed07a7527f57 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:43:30.359250 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c885ae5f-38fc-4387-b7c6-ed07a7527f57 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:43:30.360621 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c885ae5f-38fc-4387-b7c6-ed07a7527f57 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:43:30.368409 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 580/1157] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Aug 18 21:43:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:43:30.374349 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb6b2dc-cb2d-4b24-ad53-8c89abe37e39 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:43:30.415944 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:43:30.472600 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb6b2dc-cb2d-4b24-ad53-8c89abe37e39 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:43:30.505928 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf44f284-40ca-4281-8c6d-b4960d4521d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:43:30.506545 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf44f284-40ca-4281-8c6d-b4960d4521d8 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:43:30.506821 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf44f284-40ca-4281-8c6d-b4960d4521d8 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:43:30.507094 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf44f284-40ca-4281-8c6d-b4960d4521d8 None admin] PATH_INFO: `/v3/users/a72c9fc37c984c3a9595e3742c7181f2` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:43:30.508208 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf44f284-40ca-4281-8c6d-b4960d4521d8 None admin] RBAC: Authorizing `identity:get_user(user_id=a72c9fc37c984c3a9595e3742c7181f2)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:43:30.509650 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf44f284-40ca-4281-8c6d-b4960d4521d8 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:43:30.511213 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 578/1158] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Aug 18 21:43:30 2022] GET /identity/v3/users/a72c9fc37c984c3a9595e3742c7181f2 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:43:30.517306 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c885ae5f-38fc-4387-b7c6-ed07a7527f57 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:43:30.562113 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:43:30.615439 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c885ae5f-38fc-4387-b7c6-ed07a7527f57 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:43:30.648107 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b492a6c9-c00d-4060-809c-a35e7d4f034a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:43:30.648715 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b492a6c9-c00d-4060-809c-a35e7d4f034a None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:43:30.648993 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b492a6c9-c00d-4060-809c-a35e7d4f034a None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:43:30.649265 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b492a6c9-c00d-4060-809c-a35e7d4f034a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:43:30.713146 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b492a6c9-c00d-4060-809c-a35e7d4f034a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:43:30.714577 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b492a6c9-c00d-4060-809c-a35e7d4f034a None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:43:30.757502 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:43:30.808039 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 581/1159] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Aug 18 21:43:30 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 18 21:43:30.813958 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf44f284-40ca-4281-8c6d-b4960d4521d8 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:43:30.910384 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf44f284-40ca-4281-8c6d-b4960d4521d8 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:43:30.918671 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:43:30.942877 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9898be-48ea-42d1-bd7f-3ee86415ca1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:43:30.943492 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9898be-48ea-42d1-bd7f-3ee86415ca1b None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:43:30.943772 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9898be-48ea-42d1-bd7f-3ee86415ca1b None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:43:30.944163 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9898be-48ea-42d1-bd7f-3ee86415ca1b None admin] PATH_INFO: `/v3/projects/1dc971d2eb8246d8b556109532b50c0a` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:43:30.945276 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9898be-48ea-42d1-bd7f-3ee86415ca1b None admin] RBAC: Authorizing `identity:get_project(project_id=1dc971d2eb8246d8b556109532b50c0a)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:43:30.946677 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9898be-48ea-42d1-bd7f-3ee86415ca1b None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:43:30.948270 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 579/1160] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Aug 18 21:43:30 2022] GET /identity/v3/projects/1dc971d2eb8246d8b556109532b50c0a => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:43:30.954373 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b492a6c9-c00d-4060-809c-a35e7d4f034a None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:43:31.050871 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b492a6c9-c00d-4060-809c-a35e7d4f034a None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:43:31.083390 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c23ceb9-ef45-48ea-a877-ad9f2dc6334c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:43:31.083979 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c23ceb9-ef45-48ea-a877-ad9f2dc6334c None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:43:31.084263 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c23ceb9-ef45-48ea-a877-ad9f2dc6334c None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:43:31.084538 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c23ceb9-ef45-48ea-a877-ad9f2dc6334c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:43:31.085298 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c23ceb9-ef45-48ea-a877-ad9f2dc6334c None admin] RBAC: Adding query filter params (role.id=0833202e2a3d47d1b6b3af57006641b1, scope.project.id=1dc971d2eb8246d8b556109532b50c0a, user.id=a72c9fc37c984c3a9595e3742c7181f2) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:43:31.085589 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c23ceb9-ef45-48ea-a877-ad9f2dc6334c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:43:31.087025 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c23ceb9-ef45-48ea-a877-ad9f2dc6334c None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:43:31.092558 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 582/1161] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Aug 18 21:43:30 2022] GET /identity/v3/role_assignments?user.id=a72c9fc37c984c3a9595e3742c7181f2&scope.project.id=1dc971d2eb8246d8b556109532b50c0a&role.id=0833202e2a3d47d1b6b3af57006641b1 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:43:33.014396 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa796e22-99b9-47b0-b63b-09b7805f587f None None] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:43:33.014928 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa796e22-99b9-47b0-b63b-09b7805f587f None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:43:33.014928 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa796e22-99b9-47b0-b63b-09b7805f587f None None] PATH_INFO: `/` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:43:33.016273 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 580/1162] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:43:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:43:33.021939 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a6f8ae-d6dd-4977-85ca-c665eb32e581 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:43:33.022364 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a6f8ae-d6dd-4977-85ca-c665eb32e581 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:43:33.022480 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a6f8ae-d6dd-4977-85ca-c665eb32e581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:43:33.040854 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-47a6f8ae-d6dd-4977-85ca-c665eb32e581 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:43:33.042038 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-47a6f8ae-d6dd-4977-85ca-c665eb32e581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:43:33.044805 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:43:33.108871 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 583/1163] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:43:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 21:43:33.384179 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa796e22-99b9-47b0-b63b-09b7805f587f None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:43:33.484000 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa796e22-99b9-47b0-b63b-09b7805f587f None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:43:33.515640 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd26c8b-475d-46a1-9c7d-5ad773decb66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:43:33.516232 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd26c8b-475d-46a1-9c7d-5ad773decb66 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:43:33.516513 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd26c8b-475d-46a1-9c7d-5ad773decb66 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:43:33.516813 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd26c8b-475d-46a1-9c7d-5ad773decb66 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:43:33.561139 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:43:33.583345 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd26c8b-475d-46a1-9c7d-5ad773decb66 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:43:33.585858 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd26c8b-475d-46a1-9c7d-5ad773decb66 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:43:33.682922 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 581/1164] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Aug 18 21:43:33 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 18 21:43:33.689000 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a6f8ae-d6dd-4977-85ca-c665eb32e581 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:43:33.782553 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a6f8ae-d6dd-4977-85ca-c665eb32e581 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:43:33.815925 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9c007a-aa2e-4e9e-b9d4-337e0978321e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:43:33.816472 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9c007a-aa2e-4e9e-b9d4-337e0978321e None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:43:33.816773 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9c007a-aa2e-4e9e-b9d4-337e0978321e None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:43:33.817044 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9c007a-aa2e-4e9e-b9d4-337e0978321e None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:43:33.823388 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9c007a-aa2e-4e9e-b9d4-337e0978321e None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:43:33.824857 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9c007a-aa2e-4e9e-b9d4-337e0978321e None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:43:33.827200 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:43:33.835979 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application [None req-6e9c007a-aa2e-4e9e-b9d4-337e0978321e None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 18 21:43:33.835979 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:43:33.835979 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 18 21:43:33.835979 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 18 21:43:33.835979 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 21:43:33.835979 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 21:43:33.835979 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 21:43:33.835979 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 21:43:33.835979 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 18 21:43:33.835979 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:43:33.835979 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 21:43:33.835979 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:43:33.835979 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:43:33.835979 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:43:33.835979 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:43:33.835979 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:43:33.835979 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:43:33.837250 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:43:33.837250 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:43:33.837250 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:43:33.837250 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:43:33.837250 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:43:33.837250 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:43:33.837250 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 21:43:33.837250 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 21:43:33.837250 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 21:43:33.837250 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 21:43:33.837250 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:43:33.837250 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:43:33.837250 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:43:33.837250 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:43:33.837250 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:43:33.837250 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:43:33.838430 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:43:33.838430 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application with Lock( Aug 18 21:43:33.838430 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:43:33.838430 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:43:33.838430 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:43:33.838430 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:43:33.838430 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:43:33.838430 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:43:33.838430 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:43:33.838430 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:43:33.838430 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 18 21:43:33.838430 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 21:43:33.838430 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 18 21:43:33.838430 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:43:33.838430 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 584/1165] 10.222.0.27 () {56 vars in 1117 bytes} [Thu Aug 18 21:43:33 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:43:33.843048 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd26c8b-475d-46a1-9c7d-5ad773decb66 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:43:33.916513 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:43:33.938479 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd26c8b-475d-46a1-9c7d-5ad773decb66 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:43:33.971503 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9db9b11-16b1-4340-870e-2a538efde206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:43:33.972089 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9db9b11-16b1-4340-870e-2a538efde206 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:43:33.972360 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9db9b11-16b1-4340-870e-2a538efde206 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:43:33.972700 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9db9b11-16b1-4340-870e-2a538efde206 None admin] PATH_INFO: `/v3/domains` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:43:33.973324 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9db9b11-16b1-4340-870e-2a538efde206 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:43:33.973614 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9db9b11-16b1-4340-870e-2a538efde206 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:43:33.974951 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9db9b11-16b1-4340-870e-2a538efde206 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:43:33.981773 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 582/1166] 10.222.0.27 () {56 vars in 1115 bytes} [Thu Aug 18 21:43:33 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:43:35.906081 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1073cf15-1ac6-46ec-80cb-88f8a37bc619 None None] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:43:35.906607 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1073cf15-1ac6-46ec-80cb-88f8a37bc619 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:43:35.906607 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1073cf15-1ac6-46ec-80cb-88f8a37bc619 None None] PATH_INFO: `/` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:43:35.908862 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 585/1167] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:43:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:43:35.913873 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ad7e51-3006-4406-9530-e46960c8bcaa None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:43:35.914313 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ad7e51-3006-4406-9530-e46960c8bcaa None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:43:35.914412 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ad7e51-3006-4406-9530-e46960c8bcaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:43:35.932408 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-54ad7e51-3006-4406-9530-e46960c8bcaa None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:43:35.933640 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-54ad7e51-3006-4406-9530-e46960c8bcaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:43:35.999474 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 583/1168] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:43:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 21:43:36.268417 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1073cf15-1ac6-46ec-80cb-88f8a37bc619 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:43:36.366701 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1073cf15-1ac6-46ec-80cb-88f8a37bc619 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:43:36.399332 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58d91dc-dc9b-47eb-8aa3-8a9677c74333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:43:36.399912 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58d91dc-dc9b-47eb-8aa3-8a9677c74333 None admin] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:43:36.400187 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58d91dc-dc9b-47eb-8aa3-8a9677c74333 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:43:36.400455 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58d91dc-dc9b-47eb-8aa3-8a9677c74333 None admin] PATH_INFO: `/v3/domains` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:43:36.401139 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58d91dc-dc9b-47eb-8aa3-8a9677c74333 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:43:36.402492 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58d91dc-dc9b-47eb-8aa3-8a9677c74333 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:43:36.510174 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 586/1169] 10.222.0.27 () {60 vars in 1138 bytes} [Thu Aug 18 21:43:36 2022] POST /identity/v3/domains => generated 267 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:43:38.462382 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0194782c-bbca-4ed8-8d1e-e39c4d6b3cd7 None None] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:43:38.462929 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0194782c-bbca-4ed8-8d1e-e39c4d6b3cd7 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:43:38.462929 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0194782c-bbca-4ed8-8d1e-e39c4d6b3cd7 None None] PATH_INFO: `/` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:43:38.464278 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 584/1170] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:43:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:43:38.469545 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bd20f6-8c46-4f42-af5f-d4cb1844a8bf None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:43:38.469934 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bd20f6-8c46-4f42-af5f-d4cb1844a8bf None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:43:38.470096 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bd20f6-8c46-4f42-af5f-d4cb1844a8bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:43:38.489165 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-f6bd20f6-8c46-4f42-af5f-d4cb1844a8bf None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:43:38.490363 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-f6bd20f6-8c46-4f42-af5f-d4cb1844a8bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:43:38.546037 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:43:38.557640 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 587/1171] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:43:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 21:43:38.837602 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0194782c-bbca-4ed8-8d1e-e39c4d6b3cd7 None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:43:38.907891 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:43:38.938384 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0194782c-bbca-4ed8-8d1e-e39c4d6b3cd7 None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:43:38.972340 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caf646b-56d0-4b6b-a4b1-cc3400e0f3f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:43:38.972980 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caf646b-56d0-4b6b-a4b1-cc3400e0f3f6 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:43:38.973263 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caf646b-56d0-4b6b-a4b1-cc3400e0f3f6 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:43:38.973536 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caf646b-56d0-4b6b-a4b1-cc3400e0f3f6 None admin] PATH_INFO: `/v3/domains/2a18653d175a4c77a3883bbebdc56d0b` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:43:38.983577 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caf646b-56d0-4b6b-a4b1-cc3400e0f3f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=2a18653d175a4c77a3883bbebdc56d0b)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:43:38.985051 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caf646b-56d0-4b6b-a4b1-cc3400e0f3f6 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:43:38.986667 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 585/1172] 10.222.0.27 () {56 vars in 1183 bytes} [Thu Aug 18 21:43:38 2022] GET /identity/v3/domains/2a18653d175a4c77a3883bbebdc56d0b => generated 267 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:43:38.992682 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bd20f6-8c46-4f42-af5f-d4cb1844a8bf None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:43:39.088962 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bd20f6-8c46-4f42-af5f-d4cb1844a8bf None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:43:39.121255 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be36ebf-7994-41f7-8e94-6594e0091025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:43:39.121872 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be36ebf-7994-41f7-8e94-6594e0091025 None admin] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:43:39.122152 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be36ebf-7994-41f7-8e94-6594e0091025 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:43:39.122422 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be36ebf-7994-41f7-8e94-6594e0091025 None admin] PATH_INFO: `/v3/projects` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:43:39.123060 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be36ebf-7994-41f7-8e94-6594e0091025 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:43:39.124489 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be36ebf-7994-41f7-8e94-6594e0091025 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:43:39.274016 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 588/1173] 10.222.0.27 () {60 vars in 1141 bytes} [Thu Aug 18 21:43:38 2022] POST /identity/v3/projects => generated 361 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:43:41.194882 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827920bd-b7f3-428d-93d5-f2c32b4e7032 None None] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:43:41.195449 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827920bd-b7f3-428d-93d5-f2c32b4e7032 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:43:41.195449 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827920bd-b7f3-428d-93d5-f2c32b4e7032 None None] PATH_INFO: `/` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:43:41.196786 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 586/1174] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:43:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:43:41.201985 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcad74c-6f4a-4b78-8095-15f64cb080c1 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:43:41.202418 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcad74c-6f4a-4b78-8095-15f64cb080c1 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:43:41.202526 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcad74c-6f4a-4b78-8095-15f64cb080c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:43:41.221107 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-5dcad74c-6f4a-4b78-8095-15f64cb080c1 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:43:41.222340 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-5dcad74c-6f4a-4b78-8095-15f64cb080c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:43:41.257510 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:43:41.289676 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 589/1175] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:43:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 21:43:41.563918 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827920bd-b7f3-428d-93d5-f2c32b4e7032 None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:43:41.663905 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827920bd-b7f3-428d-93d5-f2c32b4e7032 None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:43:41.691957 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:43:41.706893 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af816488-2939-41bf-9906-4ef4e49ad8f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:43:41.707582 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af816488-2939-41bf-9906-4ef4e49ad8f7 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:43:41.707866 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af816488-2939-41bf-9906-4ef4e49ad8f7 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:43:41.708143 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af816488-2939-41bf-9906-4ef4e49ad8f7 None admin] PATH_INFO: `/v3/domains/2a18653d175a4c77a3883bbebdc56d0b` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:43:41.709366 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af816488-2939-41bf-9906-4ef4e49ad8f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=2a18653d175a4c77a3883bbebdc56d0b)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:43:41.710802 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af816488-2939-41bf-9906-4ef4e49ad8f7 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:43:41.712872 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 587/1176] 10.222.0.27 () {56 vars in 1183 bytes} [Thu Aug 18 21:43:41 2022] GET /identity/v3/domains/2a18653d175a4c77a3883bbebdc56d0b => generated 267 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:43:41.718813 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcad74c-6f4a-4b78-8095-15f64cb080c1 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:43:41.814606 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcad74c-6f4a-4b78-8095-15f64cb080c1 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:43:41.847462 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949fb384-c499-432b-9226-b5ecbf6f7d75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:43:41.848039 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949fb384-c499-432b-9226-b5ecbf6f7d75 None admin] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:43:41.848319 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949fb384-c499-432b-9226-b5ecbf6f7d75 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:43:41.848607 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949fb384-c499-432b-9226-b5ecbf6f7d75 None admin] PATH_INFO: `/v3/users` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:43:41.849342 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949fb384-c499-432b-9226-b5ecbf6f7d75 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:43:41.850887 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949fb384-c499-432b-9226-b5ecbf6f7d75 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:43:41.936839 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 590/1177] 10.222.0.27 () {60 vars in 1132 bytes} [Thu Aug 18 21:43:41 2022] POST /identity/v3/users => generated 311 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:43:43.888709 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8004b9ae-a6a2-47bf-9b95-87dfcf3b9c34 None None] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:43:43.889239 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8004b9ae-a6a2-47bf-9b95-87dfcf3b9c34 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:43:43.889350 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8004b9ae-a6a2-47bf-9b95-87dfcf3b9c34 None None] PATH_INFO: `/` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:43:43.890602 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 588/1178] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:43:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:43:43.896546 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea4b6ab-57b2-4101-bc66-8e5708ba34e7 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:43:43.896983 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea4b6ab-57b2-4101-bc66-8e5708ba34e7 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:43:43.897135 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea4b6ab-57b2-4101-bc66-8e5708ba34e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:43:43.915099 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-6ea4b6ab-57b2-4101-bc66-8e5708ba34e7 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:43:43.916291 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-6ea4b6ab-57b2-4101-bc66-8e5708ba34e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:43:43.938858 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:43:43.981904 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 591/1179] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:43:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 21:43:44.253936 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8004b9ae-a6a2-47bf-9b95-87dfcf3b9c34 None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:43:44.355451 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8004b9ae-a6a2-47bf-9b95-87dfcf3b9c34 None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:43:44.388140 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f3db79-836c-4e13-a6af-68e6980388bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:43:44.388789 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f3db79-836c-4e13-a6af-68e6980388bd None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:43:44.389068 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f3db79-836c-4e13-a6af-68e6980388bd None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:43:44.389337 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f3db79-836c-4e13-a6af-68e6980388bd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:43:44.400915 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f3db79-836c-4e13-a6af-68e6980388bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:43:44.405506 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application [None req-88f3db79-836c-4e13-a6af-68e6980388bd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 21:43:44.405506 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:43:44.405506 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:43:44.405506 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:43:44.405506 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:43:44.405506 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:43:44.405506 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:43:44.405506 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:43:44.405506 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:43:44.405506 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:43:44.405506 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:43:44.405506 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:43:44.405506 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:43:44.405506 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:43:44.405506 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:43:44.405506 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:43:44.408925 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:43:44.408925 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:43:44.408925 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:43:44.408925 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:43:44.408925 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:43:44.408925 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:43:44.408925 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:43:44.408925 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:43:44.408925 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:43:44.408925 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:43:44.408925 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:43:44.408925 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application with Lock( Aug 18 21:43:44.408925 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:43:44.408925 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:43:44.408925 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:43:44.408925 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:43:44.410350 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:43:44.410350 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:43:44.410350 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:43:44.410350 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:43:44.410350 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:43:44.410350 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:43:44.410350 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:43:44.410350 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:43:44.410350 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:43:44.410350 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:43:44.410350 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 21:43:44.410350 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:43:44.410350 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 589/1180] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Aug 18 21:43:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:43:44.413487 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea4b6ab-57b2-4101-bc66-8e5708ba34e7 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:43:44.510918 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea4b6ab-57b2-4101-bc66-8e5708ba34e7 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:43:44.543853 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83e8e29-40cf-4e60-80d6-24fd031f82ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:43:44.544445 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83e8e29-40cf-4e60-80d6-24fd031f82ab None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:43:44.544756 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83e8e29-40cf-4e60-80d6-24fd031f82ab None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:43:44.545031 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83e8e29-40cf-4e60-80d6-24fd031f82ab None admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:43:44.545690 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83e8e29-40cf-4e60-80d6-24fd031f82ab None admin] RBAC: Adding query filter params (name=admin) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:43:44.545992 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83e8e29-40cf-4e60-80d6-24fd031f82ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:43:44.547357 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83e8e29-40cf-4e60-80d6-24fd031f82ab None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:43:44.555762 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 592/1181] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Aug 18 21:43:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:43:44.561676 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f3db79-836c-4e13-a6af-68e6980388bd None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:43:44.620548 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:43:44.662165 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f3db79-836c-4e13-a6af-68e6980388bd None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:43:44.695722 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de29398-62ca-44f7-93d6-d9cc516a1fbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:43:44.696625 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de29398-62ca-44f7-93d6-d9cc516a1fbd None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:43:44.696918 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de29398-62ca-44f7-93d6-d9cc516a1fbd None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:43:44.697189 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de29398-62ca-44f7-93d6-d9cc516a1fbd None admin] PATH_INFO: `/v3/users/e31b36b159704ef9ab6570f2a6b320cb` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:43:44.710654 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de29398-62ca-44f7-93d6-d9cc516a1fbd None admin] RBAC: Authorizing `identity:get_user(user_id=e31b36b159704ef9ab6570f2a6b320cb)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:43:44.712100 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de29398-62ca-44f7-93d6-d9cc516a1fbd None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:43:44.713821 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 590/1182] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Aug 18 21:43:44 2022] GET /identity/v3/users/e31b36b159704ef9ab6570f2a6b320cb => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:43:44.719986 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83e8e29-40cf-4e60-80d6-24fd031f82ab None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:43:44.742256 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:43:44.819986 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83e8e29-40cf-4e60-80d6-24fd031f82ab None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:43:44.853011 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01859bd1-3570-4240-8e84-a3292a8edd9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:43:44.853601 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01859bd1-3570-4240-8e84-a3292a8edd9b None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:43:44.853879 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01859bd1-3570-4240-8e84-a3292a8edd9b None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:43:44.854151 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01859bd1-3570-4240-8e84-a3292a8edd9b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:43:44.918907 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01859bd1-3570-4240-8e84-a3292a8edd9b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:43:44.920348 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01859bd1-3570-4240-8e84-a3292a8edd9b None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:43:44.939612 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:43:45.015390 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 593/1183] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Aug 18 21:43:44 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 18 21:43:45.022123 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de29398-62ca-44f7-93d6-d9cc516a1fbd None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:43:45.120666 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de29398-62ca-44f7-93d6-d9cc516a1fbd None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:43:45.137134 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:43:45.155095 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfeece9-58ce-4f47-b191-5709041467f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:43:45.155758 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfeece9-58ce-4f47-b191-5709041467f8 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:43:45.156039 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfeece9-58ce-4f47-b191-5709041467f8 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:43:45.156310 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfeece9-58ce-4f47-b191-5709041467f8 None admin] PATH_INFO: `/v3/projects/1a4b50fde8e540d0805dcc5abe27ad62` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:43:45.157456 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfeece9-58ce-4f47-b191-5709041467f8 None admin] RBAC: Authorizing `identity:get_project(project_id=1a4b50fde8e540d0805dcc5abe27ad62)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:43:45.159150 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfeece9-58ce-4f47-b191-5709041467f8 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:43:45.161282 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 591/1184] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Aug 18 21:43:45 2022] GET /identity/v3/projects/1a4b50fde8e540d0805dcc5abe27ad62 => generated 361 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:43:45.167266 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01859bd1-3570-4240-8e84-a3292a8edd9b None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:43:45.262998 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01859bd1-3570-4240-8e84-a3292a8edd9b None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:43:45.283310 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:43:45.297653 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e20200b-f7c6-42d9-b428-17f2bf6bd391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:43:45.298247 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e20200b-f7c6-42d9-b428-17f2bf6bd391 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:43:45.298632 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e20200b-f7c6-42d9-b428-17f2bf6bd391 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:43:45.298821 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e20200b-f7c6-42d9-b428-17f2bf6bd391 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:43:45.299764 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e20200b-f7c6-42d9-b428-17f2bf6bd391 None admin] RBAC: Adding query filter params (role.id=0833202e2a3d47d1b6b3af57006641b1, scope.project.id=1a4b50fde8e540d0805dcc5abe27ad62, user.id=e31b36b159704ef9ab6570f2a6b320cb) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:43:45.300068 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e20200b-f7c6-42d9-b428-17f2bf6bd391 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:43:45.301562 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e20200b-f7c6-42d9-b428-17f2bf6bd391 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:43:45.307368 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 594/1185] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Aug 18 21:43:45 2022] GET /identity/v3/role_assignments?user.id=e31b36b159704ef9ab6570f2a6b320cb&scope.project.id=1a4b50fde8e540d0805dcc5abe27ad62&role.id=0833202e2a3d47d1b6b3af57006641b1 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:43:47.162121 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c283ed-cfc7-4560-bbd6-3f76b91ce0f0 None None] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:43:47.162688 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c283ed-cfc7-4560-bbd6-3f76b91ce0f0 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:43:47.162688 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c283ed-cfc7-4560-bbd6-3f76b91ce0f0 None None] PATH_INFO: `/` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:43:47.164021 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 592/1186] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:43:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:43:47.169132 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c734f57-d349-4cb3-975f-80293b9214e8 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:43:47.169514 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c734f57-d349-4cb3-975f-80293b9214e8 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:43:47.169676 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c734f57-d349-4cb3-975f-80293b9214e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:43:47.187159 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-1c734f57-d349-4cb3-975f-80293b9214e8 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:43:47.188327 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-1c734f57-d349-4cb3-975f-80293b9214e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:43:47.252534 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 595/1187] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:43:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 21:43:47.519565 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c283ed-cfc7-4560-bbd6-3f76b91ce0f0 None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:43:47.617957 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c283ed-cfc7-4560-bbd6-3f76b91ce0f0 None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:43:47.650221 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab1cea2-137e-4903-b588-d5ec82d32eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:43:47.650827 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab1cea2-137e-4903-b588-d5ec82d32eff None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:43:47.651101 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab1cea2-137e-4903-b588-d5ec82d32eff None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:43:47.651368 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab1cea2-137e-4903-b588-d5ec82d32eff None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:43:47.661524 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab1cea2-137e-4903-b588-d5ec82d32eff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:43:47.666135 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application [None req-3ab1cea2-137e-4903-b588-d5ec82d32eff None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 21:43:47.666135 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:43:47.666135 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:43:47.666135 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:43:47.666135 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:43:47.666135 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:43:47.666135 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:43:47.666135 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:43:47.666135 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:43:47.666135 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:43:47.666135 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:43:47.666135 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:43:47.666135 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:43:47.666135 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:43:47.666135 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:43:47.666135 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:43:47.667210 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:43:47.667210 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:43:47.667210 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:43:47.667210 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:43:47.667210 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:43:47.667210 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:43:47.667210 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:43:47.667210 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:43:47.667210 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:43:47.667210 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:43:47.667210 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:43:47.667210 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application with Lock( Aug 18 21:43:47.667210 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:43:47.667210 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:43:47.667210 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:43:47.667210 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:43:47.668055 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:43:47.668055 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:43:47.668055 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:43:47.668055 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:43:47.668055 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:43:47.668055 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:43:47.668055 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:43:47.668055 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:43:47.668055 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:43:47.668055 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:43:47.668055 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 21:43:47.668055 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:43:47.668055 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 593/1188] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Aug 18 21:43:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:43:47.673356 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c734f57-d349-4cb3-975f-80293b9214e8 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:43:47.776629 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c734f57-d349-4cb3-975f-80293b9214e8 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:43:47.790966 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:43:47.810246 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234f1023-4a86-49eb-9453-104942c46192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:43:47.810845 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234f1023-4a86-49eb-9453-104942c46192 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:43:47.811127 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234f1023-4a86-49eb-9453-104942c46192 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:43:47.811440 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234f1023-4a86-49eb-9453-104942c46192 None admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:43:47.812048 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234f1023-4a86-49eb-9453-104942c46192 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:43:47.812350 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234f1023-4a86-49eb-9453-104942c46192 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:43:47.813752 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234f1023-4a86-49eb-9453-104942c46192 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:43:47.821588 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 596/1189] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Aug 18 21:43:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:43:47.827493 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab1cea2-137e-4903-b588-d5ec82d32eff None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:43:47.874195 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:43:47.927477 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab1cea2-137e-4903-b588-d5ec82d32eff None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:43:47.960699 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f300eb74-d11f-46ac-b961-aea47e00ea5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:43:47.961315 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f300eb74-d11f-46ac-b961-aea47e00ea5b None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:43:47.961593 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f300eb74-d11f-46ac-b961-aea47e00ea5b None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:43:47.961866 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f300eb74-d11f-46ac-b961-aea47e00ea5b None admin] PATH_INFO: `/v3/users/e31b36b159704ef9ab6570f2a6b320cb` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:43:47.962981 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f300eb74-d11f-46ac-b961-aea47e00ea5b None admin] RBAC: Authorizing `identity:get_user(user_id=e31b36b159704ef9ab6570f2a6b320cb)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:43:47.964409 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f300eb74-d11f-46ac-b961-aea47e00ea5b None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:43:47.966007 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 594/1190] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Aug 18 21:43:47 2022] GET /identity/v3/users/e31b36b159704ef9ab6570f2a6b320cb => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:43:47.972306 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234f1023-4a86-49eb-9453-104942c46192 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:43:48.070128 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234f1023-4a86-49eb-9453-104942c46192 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:43:48.102729 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1ad1f1-3cb0-48e4-aad7-addb514e0c55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:43:48.103344 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1ad1f1-3cb0-48e4-aad7-addb514e0c55 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:43:48.103626 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1ad1f1-3cb0-48e4-aad7-addb514e0c55 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:43:48.103899 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1ad1f1-3cb0-48e4-aad7-addb514e0c55 None admin] PATH_INFO: `/v3/projects/1a4b50fde8e540d0805dcc5abe27ad62` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:43:48.105027 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1ad1f1-3cb0-48e4-aad7-addb514e0c55 None admin] RBAC: Authorizing `identity:get_project(project_id=1a4b50fde8e540d0805dcc5abe27ad62)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:43:48.106457 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1ad1f1-3cb0-48e4-aad7-addb514e0c55 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:43:48.108076 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 597/1191] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Aug 18 21:43:47 2022] GET /identity/v3/projects/1a4b50fde8e540d0805dcc5abe27ad62 => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:43:48.114355 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f300eb74-d11f-46ac-b961-aea47e00ea5b None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:43:48.212797 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f300eb74-d11f-46ac-b961-aea47e00ea5b None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:43:48.226315 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:43:48.246666 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0204ac7-f9d5-436a-8025-104e3aed1327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:43:48.247310 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0204ac7-f9d5-436a-8025-104e3aed1327 None admin] REQUEST_METHOD: `PUT` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:43:48.247592 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0204ac7-f9d5-436a-8025-104e3aed1327 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:43:48.247867 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0204ac7-f9d5-436a-8025-104e3aed1327 None admin] PATH_INFO: `/v3/projects/1a4b50fde8e540d0805dcc5abe27ad62/users/e31b36b159704ef9ab6570f2a6b320cb/roles/0833202e2a3d47d1b6b3af57006641b1` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:43:48.249755 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0204ac7-f9d5-436a-8025-104e3aed1327 None admin] RBAC: Authorizing `identity:create_grant(project_id=1a4b50fde8e540d0805dcc5abe27ad62, user_id=e31b36b159704ef9ab6570f2a6b320cb, role_id=0833202e2a3d47d1b6b3af57006641b1)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:43:48.251189 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0204ac7-f9d5-436a-8025-104e3aed1327 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:43:48.320428 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 595/1192] 10.222.0.27 () {58 vars in 1439 bytes} [Thu Aug 18 21:43:48 2022] PUT /identity/v3/projects/1a4b50fde8e540d0805dcc5abe27ad62/users/e31b36b159704ef9ab6570f2a6b320cb/roles/0833202e2a3d47d1b6b3af57006641b1 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 21:43:50.204948 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462599c8-6768-49f4-bbaf-16cd8b4288ea None None] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:43:50.205511 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462599c8-6768-49f4-bbaf-16cd8b4288ea None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:43:50.205606 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462599c8-6768-49f4-bbaf-16cd8b4288ea None None] PATH_INFO: `/` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:43:50.206895 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 598/1193] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:43:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:43:50.211978 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854d172f-5c86-440b-a891-6c352cd5afef None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:43:50.212400 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854d172f-5c86-440b-a891-6c352cd5afef None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:43:50.212509 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854d172f-5c86-440b-a891-6c352cd5afef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:43:50.230130 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-854d172f-5c86-440b-a891-6c352cd5afef None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:43:50.231308 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-854d172f-5c86-440b-a891-6c352cd5afef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:43:50.296679 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 596/1194] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:43:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 21:43:50.566647 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462599c8-6768-49f4-bbaf-16cd8b4288ea None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:43:50.612349 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:43:50.665723 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462599c8-6768-49f4-bbaf-16cd8b4288ea None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:43:50.698146 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b5d291-b9de-4833-9862-83130ec3c2c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:43:50.698754 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b5d291-b9de-4833-9862-83130ec3c2c7 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:43:50.699032 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b5d291-b9de-4833-9862-83130ec3c2c7 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:43:50.699304 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b5d291-b9de-4833-9862-83130ec3c2c7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:43:50.710014 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b5d291-b9de-4833-9862-83130ec3c2c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:43:50.714656 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application [None req-39b5d291-b9de-4833-9862-83130ec3c2c7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 21:43:50.714656 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:43:50.714656 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:43:50.714656 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:43:50.714656 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:43:50.714656 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:43:50.714656 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:43:50.714656 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:43:50.714656 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:43:50.714656 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:43:50.714656 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:43:50.714656 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:43:50.714656 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:43:50.714656 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:43:50.714656 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:43:50.714656 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:43:50.715727 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:43:50.715727 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:43:50.715727 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:43:50.715727 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:43:50.715727 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:43:50.715727 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:43:50.715727 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:43:50.715727 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:43:50.715727 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:43:50.715727 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:43:50.715727 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:43:50.715727 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application with Lock( Aug 18 21:43:50.715727 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:43:50.715727 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:43:50.715727 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:43:50.715727 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:43:50.716811 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:43:50.716811 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:43:50.716811 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:43:50.716811 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:43:50.716811 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:43:50.716811 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:43:50.716811 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:43:50.716811 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:43:50.716811 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:43:50.716811 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:43:50.716811 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 21:43:50.716811 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:43:50.716811 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 599/1195] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Aug 18 21:43:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:43:50.722472 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854d172f-5c86-440b-a891-6c352cd5afef None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:43:50.818585 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854d172f-5c86-440b-a891-6c352cd5afef None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:43:50.819969 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:43:50.852185 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e2453e-f222-4648-bcb2-429ade96cd5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:43:50.852802 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e2453e-f222-4648-bcb2-429ade96cd5c None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:43:50.853080 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e2453e-f222-4648-bcb2-429ade96cd5c None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:43:50.853347 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e2453e-f222-4648-bcb2-429ade96cd5c None admin] PATH_INFO: `/v3/roles` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:43:50.853993 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e2453e-f222-4648-bcb2-429ade96cd5c None admin] RBAC: Adding query filter params (name=admin) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:43:50.854288 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e2453e-f222-4648-bcb2-429ade96cd5c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:43:50.855625 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e2453e-f222-4648-bcb2-429ade96cd5c None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:43:50.864122 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 597/1196] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Aug 18 21:43:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:43:50.870166 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b5d291-b9de-4833-9862-83130ec3c2c7 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:43:50.968369 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b5d291-b9de-4833-9862-83130ec3c2c7 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:43:50.970677 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:43:51.002423 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb2b4e0-08ea-4f6d-a9dd-ac93f978a8b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:43:51.003041 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb2b4e0-08ea-4f6d-a9dd-ac93f978a8b1 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:43:51.003318 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb2b4e0-08ea-4f6d-a9dd-ac93f978a8b1 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:43:51.003590 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb2b4e0-08ea-4f6d-a9dd-ac93f978a8b1 None admin] PATH_INFO: `/v3/users/e31b36b159704ef9ab6570f2a6b320cb` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:43:51.004722 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb2b4e0-08ea-4f6d-a9dd-ac93f978a8b1 None admin] RBAC: Authorizing `identity:get_user(user_id=e31b36b159704ef9ab6570f2a6b320cb)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:43:51.006150 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb2b4e0-08ea-4f6d-a9dd-ac93f978a8b1 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:43:51.007743 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 600/1197] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Aug 18 21:43:50 2022] GET /identity/v3/users/e31b36b159704ef9ab6570f2a6b320cb => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:43:51.013797 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e2453e-f222-4648-bcb2-429ade96cd5c None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:43:51.111475 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e2453e-f222-4648-bcb2-429ade96cd5c None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:43:51.145069 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eec55b5-a529-4bda-9e20-69cc81a72c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:43:51.145665 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eec55b5-a529-4bda-9e20-69cc81a72c2a None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:43:51.145975 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eec55b5-a529-4bda-9e20-69cc81a72c2a None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:43:51.146269 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eec55b5-a529-4bda-9e20-69cc81a72c2a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:43:51.175160 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:43:51.212479 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eec55b5-a529-4bda-9e20-69cc81a72c2a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:43:51.213968 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eec55b5-a529-4bda-9e20-69cc81a72c2a None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:43:51.310949 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 598/1198] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Aug 18 21:43:51 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 18 21:43:51.316856 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb2b4e0-08ea-4f6d-a9dd-ac93f978a8b1 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:43:51.414399 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb2b4e0-08ea-4f6d-a9dd-ac93f978a8b1 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:43:51.446675 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43265ce4-d44d-4e0b-a54d-38bbed805b8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:43:51.447294 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43265ce4-d44d-4e0b-a54d-38bbed805b8b None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:43:51.447595 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43265ce4-d44d-4e0b-a54d-38bbed805b8b None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:43:51.447876 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43265ce4-d44d-4e0b-a54d-38bbed805b8b None admin] PATH_INFO: `/v3/projects/1a4b50fde8e540d0805dcc5abe27ad62` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:43:51.449010 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43265ce4-d44d-4e0b-a54d-38bbed805b8b None admin] RBAC: Authorizing `identity:get_project(project_id=1a4b50fde8e540d0805dcc5abe27ad62)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:43:51.450439 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43265ce4-d44d-4e0b-a54d-38bbed805b8b None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:43:51.452047 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 601/1199] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Aug 18 21:43:51 2022] GET /identity/v3/projects/1a4b50fde8e540d0805dcc5abe27ad62 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:43:51.459061 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eec55b5-a529-4bda-9e20-69cc81a72c2a None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:43:51.520127 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:43:51.556506 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eec55b5-a529-4bda-9e20-69cc81a72c2a None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:43:51.589541 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d03345d-eb49-4376-9401-82361f4a33e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:43:51.590128 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d03345d-eb49-4376-9401-82361f4a33e6 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:43:51.590405 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d03345d-eb49-4376-9401-82361f4a33e6 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:43:51.590673 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d03345d-eb49-4376-9401-82361f4a33e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:43:51.591381 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d03345d-eb49-4376-9401-82361f4a33e6 None admin] RBAC: Adding query filter params (role.id=0833202e2a3d47d1b6b3af57006641b1, scope.project.id=1a4b50fde8e540d0805dcc5abe27ad62, user.id=e31b36b159704ef9ab6570f2a6b320cb) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:43:51.591685 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d03345d-eb49-4376-9401-82361f4a33e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:43:51.593141 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d03345d-eb49-4376-9401-82361f4a33e6 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:43:51.599256 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 599/1200] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Aug 18 21:43:51 2022] GET /identity/v3/role_assignments?user.id=e31b36b159704ef9ab6570f2a6b320cb&scope.project.id=1a4b50fde8e540d0805dcc5abe27ad62&role.id=0833202e2a3d47d1b6b3af57006641b1 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:44:01.442520 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=80 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:44:01.596181 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=36 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:45:04.509839 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d7f010-8837-4a6a-b291-3eb88c2497c3 None None] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:45:04.510552 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d7f010-8837-4a6a-b291-3eb88c2497c3 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:45:04.510552 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d7f010-8837-4a6a-b291-3eb88c2497c3 None None] PATH_INFO: `/` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:45:04.512139 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 602/1201] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:45:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:45:04.517439 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3510209e-f005-4ed0-9db1-2d6ff74aa7e3 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:45:04.517921 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3510209e-f005-4ed0-9db1-2d6ff74aa7e3 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:45:04.518397 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3510209e-f005-4ed0-9db1-2d6ff74aa7e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:45:04.543897 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-3510209e-f005-4ed0-9db1-2d6ff74aa7e3 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:45:04.545051 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-3510209e-f005-4ed0-9db1-2d6ff74aa7e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:45:04.611303 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 600/1202] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:45:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 21:45:04.889500 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d7f010-8837-4a6a-b291-3eb88c2497c3 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:45:04.989704 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d7f010-8837-4a6a-b291-3eb88c2497c3 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:45:05.023803 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38cb798-0580-4dfa-8ed7-0f39df1d05ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:45:05.024452 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38cb798-0580-4dfa-8ed7-0f39df1d05ac None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:45:05.024752 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38cb798-0580-4dfa-8ed7-0f39df1d05ac None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:45:05.025021 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38cb798-0580-4dfa-8ed7-0f39df1d05ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:45:05.035840 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38cb798-0580-4dfa-8ed7-0f39df1d05ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:45:05.037284 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38cb798-0580-4dfa-8ed7-0f39df1d05ac None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:45:05.051170 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application [None req-e38cb798-0580-4dfa-8ed7-0f39df1d05ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:45:05.051170 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:45:05.051170 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:45:05.051170 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:45:05.051170 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:45:05.051170 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:45:05.051170 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:45:05.051170 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:45:05.051170 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:45:05.051170 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:45:05.051170 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:45:05.051170 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:45:05.051170 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 21:45:05.051170 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 21:45:05.051170 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 21:45:05.051170 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 21:45:05.052221 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:45:05.052221 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:45:05.052221 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:45:05.052221 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:45:05.052221 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:45:05.052221 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:45:05.052221 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:45:05.052221 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application with Lock( Aug 18 21:45:05.052221 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:45:05.052221 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:45:05.052221 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:45:05.052221 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:45:05.052221 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:45:05.052221 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:45:05.052221 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:45:05.052221 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:45:05.052221 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 21:45:05.053366 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 21:45:05.053366 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:45:05.053366 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:45:05.053366 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 603/1203] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 18 21:45:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:45:05.058706 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3510209e-f005-4ed0-9db1-2d6ff74aa7e3 None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:45:05.157465 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3510209e-f005-4ed0-9db1-2d6ff74aa7e3 None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:45:05.185920 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:45:05.194054 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332afbcc-5cbc-4c44-8b24-95196dbd1e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:45:05.194666 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332afbcc-5cbc-4c44-8b24-95196dbd1e51 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:45:05.194944 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332afbcc-5cbc-4c44-8b24-95196dbd1e51 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:45:05.195219 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332afbcc-5cbc-4c44-8b24-95196dbd1e51 None admin] PATH_INFO: `/v3/domains` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:45:05.195946 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332afbcc-5cbc-4c44-8b24-95196dbd1e51 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:45:05.196252 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332afbcc-5cbc-4c44-8b24-95196dbd1e51 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:45:05.197710 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332afbcc-5cbc-4c44-8b24-95196dbd1e51 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:45:05.209632 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 601/1204] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 18 21:45:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:45:05.215929 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38cb798-0580-4dfa-8ed7-0f39df1d05ac None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:45:05.268687 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:45:05.315937 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38cb798-0580-4dfa-8ed7-0f39df1d05ac None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:45:05.350140 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc74767-288d-4941-b74c-38c303f8a7fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:45:05.350738 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc74767-288d-4941-b74c-38c303f8a7fa None admin] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:45:05.351018 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc74767-288d-4941-b74c-38c303f8a7fa None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:45:05.351329 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc74767-288d-4941-b74c-38c303f8a7fa None admin] PATH_INFO: `/v3/users` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:45:05.351992 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc74767-288d-4941-b74c-38c303f8a7fa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:45:05.353453 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc74767-288d-4941-b74c-38c303f8a7fa None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:45:05.612839 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 604/1205] 10.222.0.27 () {60 vars in 1132 bytes} [Thu Aug 18 21:45:05 2022] POST /identity/v3/users => generated 251 bytes in 397 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:45:07.563992 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6512dc-f785-4d52-a7bd-fef166d7328d None None] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:45:07.564529 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6512dc-f785-4d52-a7bd-fef166d7328d None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:45:07.564529 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6512dc-f785-4d52-a7bd-fef166d7328d None None] PATH_INFO: `/` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:45:07.565932 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 602/1206] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:45:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:45:07.571645 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a06b5c-5713-4874-bf4c-010406462bc5 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:45:07.572072 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a06b5c-5713-4874-bf4c-010406462bc5 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:45:07.572184 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a06b5c-5713-4874-bf4c-010406462bc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:45:07.590958 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-e1a06b5c-5713-4874-bf4c-010406462bc5 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:45:07.592157 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-e1a06b5c-5713-4874-bf4c-010406462bc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:45:07.664698 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 605/1207] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:45:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 21:45:07.937362 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6512dc-f785-4d52-a7bd-fef166d7328d None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:45:08.051216 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6512dc-f785-4d52-a7bd-fef166d7328d None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:45:08.086660 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918d9a9c-7c82-41a5-8dce-208175bd7c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:45:08.087350 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918d9a9c-7c82-41a5-8dce-208175bd7c22 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:45:08.087628 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918d9a9c-7c82-41a5-8dce-208175bd7c22 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:45:08.087897 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918d9a9c-7c82-41a5-8dce-208175bd7c22 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:45:08.099072 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918d9a9c-7c82-41a5-8dce-208175bd7c22 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:45:08.103829 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application [None req-918d9a9c-7c82-41a5-8dce-208175bd7c22 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 21:45:08.103829 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:45:08.103829 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:45:08.103829 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:45:08.103829 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:45:08.103829 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:45:08.103829 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:45:08.103829 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:45:08.103829 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:45:08.103829 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:45:08.103829 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:45:08.103829 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:45:08.103829 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:45:08.103829 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:45:08.103829 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:45:08.103829 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:45:08.105507 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:45:08.105507 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:45:08.105507 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:45:08.105507 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:45:08.105507 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:45:08.105507 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:45:08.105507 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:45:08.105507 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:45:08.105507 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:45:08.105507 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:45:08.105507 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:45:08.105507 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application with Lock( Aug 18 21:45:08.105507 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:45:08.105507 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:45:08.105507 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:45:08.105507 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:45:08.106436 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:45:08.106436 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:45:08.106436 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:45:08.106436 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:45:08.106436 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:45:08.106436 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:45:08.106436 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:45:08.106436 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:45:08.106436 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:45:08.106436 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:45:08.106436 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 21:45:08.106436 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:45:08.106436 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 603/1208] 10.222.0.27 () {56 vars in 1102 bytes} [Thu Aug 18 21:45:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:45:08.112339 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a06b5c-5713-4874-bf4c-010406462bc5 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:45:08.158499 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:45:08.217670 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a06b5c-5713-4874-bf4c-010406462bc5 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:45:08.250878 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1150337-d356-4b6c-8c27-6d0e23168704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:45:08.251497 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1150337-d356-4b6c-8c27-6d0e23168704 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:45:08.251834 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1150337-d356-4b6c-8c27-6d0e23168704 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:45:08.252123 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1150337-d356-4b6c-8c27-6d0e23168704 None admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:45:08.252819 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1150337-d356-4b6c-8c27-6d0e23168704 None admin] RBAC: Adding query filter params (name=service) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:45:08.253154 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1150337-d356-4b6c-8c27-6d0e23168704 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:45:08.254561 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1150337-d356-4b6c-8c27-6d0e23168704 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:45:08.262705 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 606/1209] 10.222.0.27 () {56 vars in 1103 bytes} [Thu Aug 18 21:45:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:45:08.268496 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918d9a9c-7c82-41a5-8dce-208175bd7c22 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:45:08.320612 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:45:08.369363 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918d9a9c-7c82-41a5-8dce-208175bd7c22 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:45:08.404869 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c25fcc-318e-4592-a3fc-7a7ff985d5e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:45:08.405517 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c25fcc-318e-4592-a3fc-7a7ff985d5e7 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:45:08.405785 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c25fcc-318e-4592-a3fc-7a7ff985d5e7 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:45:08.406058 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c25fcc-318e-4592-a3fc-7a7ff985d5e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:45:08.416815 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c25fcc-318e-4592-a3fc-7a7ff985d5e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:45:08.419244 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c25fcc-318e-4592-a3fc-7a7ff985d5e7 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:45:08.434091 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application [None req-34c25fcc-318e-4592-a3fc-7a7ff985d5e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:45:08.434091 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:45:08.434091 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:45:08.434091 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:45:08.434091 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:45:08.434091 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:45:08.434091 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:45:08.434091 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:45:08.434091 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:45:08.434091 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:45:08.434091 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:45:08.434091 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:45:08.434091 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 21:45:08.434091 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 21:45:08.434091 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 21:45:08.434091 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 21:45:08.442025 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:45:08.442025 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:45:08.442025 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:45:08.442025 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:45:08.442025 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:45:08.442025 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:45:08.442025 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:45:08.442025 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application with Lock( Aug 18 21:45:08.442025 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:45:08.442025 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:45:08.442025 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:45:08.442025 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:45:08.442025 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:45:08.442025 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:45:08.442025 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:45:08.442025 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:45:08.442025 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 21:45:08.443131 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 21:45:08.443131 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:45:08.443131 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:45:08.443131 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 604/1210] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 18 21:45:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:45:08.443417 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1150337-d356-4b6c-8c27-6d0e23168704 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:45:08.541104 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:45:08.545021 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1150337-d356-4b6c-8c27-6d0e23168704 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:45:08.585302 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4833176-3f70-4f4b-8caa-7d0d8a81ac92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:45:08.586042 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4833176-3f70-4f4b-8caa-7d0d8a81ac92 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:45:08.586224 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4833176-3f70-4f4b-8caa-7d0d8a81ac92 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:45:08.586497 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4833176-3f70-4f4b-8caa-7d0d8a81ac92 None admin] PATH_INFO: `/v3/domains` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:45:08.587144 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4833176-3f70-4f4b-8caa-7d0d8a81ac92 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:45:08.587443 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4833176-3f70-4f4b-8caa-7d0d8a81ac92 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:45:08.588836 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4833176-3f70-4f4b-8caa-7d0d8a81ac92 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:45:08.601521 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 607/1211] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 18 21:45:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:45:08.607365 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c25fcc-318e-4592-a3fc-7a7ff985d5e7 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:45:08.710931 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c25fcc-318e-4592-a3fc-7a7ff985d5e7 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:45:08.712543 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:45:08.748077 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271cd744-309b-480e-9838-3a4dde928f1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:45:08.748746 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271cd744-309b-480e-9838-3a4dde928f1b None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:45:08.749027 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271cd744-309b-480e-9838-3a4dde928f1b None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:45:08.749296 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271cd744-309b-480e-9838-3a4dde928f1b None admin] PATH_INFO: `/v3/users/placement` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:45:08.758003 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271cd744-309b-480e-9838-3a4dde928f1b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:45:08.759483 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271cd744-309b-480e-9838-3a4dde928f1b None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:45:08.771467 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application [None req-271cd744-309b-480e-9838-3a4dde928f1b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 18 21:45:08.771467 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:45:08.771467 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:45:08.771467 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:45:08.771467 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:45:08.771467 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:45:08.771467 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:45:08.771467 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:45:08.771467 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:45:08.771467 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:45:08.771467 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:45:08.771467 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:45:08.771467 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 21:45:08.771467 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 21:45:08.771467 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 21:45:08.771467 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 21:45:08.772531 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:45:08.772531 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:45:08.772531 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 21:45:08.772531 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 21:45:08.772531 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 21:45:08.772531 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 21:45:08.772531 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:45:08.772531 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:45:08.772531 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:45:08.772531 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:45:08.772531 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:45:08.772531 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application with Lock( Aug 18 21:45:08.772531 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:45:08.772531 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:45:08.772531 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:45:08.772531 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:45:08.772531 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:45:08.772531 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:45:08.773751 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:45:08.773751 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:45:08.773751 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 21:45:08.773751 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 21:45:08.773751 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 21:45:08.773751 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 21:45:08.773751 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 21:45:08.773751 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 21:45:08.773751 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 18 21:45:08.773751 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:45:08.773751 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 605/1212] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 18 21:45:08 2022] GET /identity/v3/users/placement => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:45:08.779178 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4833176-3f70-4f4b-8caa-7d0d8a81ac92 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:45:08.880294 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4833176-3f70-4f4b-8caa-7d0d8a81ac92 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:45:08.914932 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451fd473-7137-45e8-ac20-0cd27774545c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:45:08.915540 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451fd473-7137-45e8-ac20-0cd27774545c None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:45:08.915814 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451fd473-7137-45e8-ac20-0cd27774545c None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:45:08.916095 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451fd473-7137-45e8-ac20-0cd27774545c None admin] PATH_INFO: `/v3/users` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:45:08.916851 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451fd473-7137-45e8-ac20-0cd27774545c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:45:08.917154 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451fd473-7137-45e8-ac20-0cd27774545c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:45:08.918866 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451fd473-7137-45e8-ac20-0cd27774545c None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:45:08.935922 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 608/1213] 10.222.0.27 () {56 vars in 1143 bytes} [Thu Aug 18 21:45:08 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:45:08.941727 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271cd744-309b-480e-9838-3a4dde928f1b None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:45:09.054075 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271cd744-309b-480e-9838-3a4dde928f1b None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:45:09.089154 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce42a12-6f46-484a-a99d-47b6b8f2492a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:45:09.089756 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce42a12-6f46-484a-a99d-47b6b8f2492a None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:45:09.090028 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce42a12-6f46-484a-a99d-47b6b8f2492a None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:45:09.090294 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce42a12-6f46-484a-a99d-47b6b8f2492a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:45:09.118850 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:45:09.156788 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce42a12-6f46-484a-a99d-47b6b8f2492a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:45:09.158167 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce42a12-6f46-484a-a99d-47b6b8f2492a None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:45:09.270857 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 606/1214] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Aug 18 21:45:08 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 18 21:45:09.276889 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451fd473-7137-45e8-ac20-0cd27774545c None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:45:09.296401 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:45:09.380069 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451fd473-7137-45e8-ac20-0cd27774545c None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:45:09.418954 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74208cf-1917-4a37-8a7f-fac8f11b94a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:45:09.420026 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74208cf-1917-4a37-8a7f-fac8f11b94a5 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:45:09.420305 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74208cf-1917-4a37-8a7f-fac8f11b94a5 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:45:09.420576 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74208cf-1917-4a37-8a7f-fac8f11b94a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:45:09.430553 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74208cf-1917-4a37-8a7f-fac8f11b94a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:45:09.431993 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74208cf-1917-4a37-8a7f-fac8f11b94a5 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:45:09.446914 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application [None req-f74208cf-1917-4a37-8a7f-fac8f11b94a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:45:09.446914 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:45:09.446914 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:45:09.446914 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:45:09.446914 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:45:09.446914 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:45:09.446914 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:45:09.446914 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:45:09.446914 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:45:09.446914 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:45:09.446914 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:45:09.446914 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:45:09.446914 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 21:45:09.446914 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 21:45:09.446914 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 21:45:09.446914 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 21:45:09.448089 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:45:09.448089 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:45:09.448089 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:45:09.448089 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:45:09.448089 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:45:09.448089 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:45:09.448089 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:45:09.448089 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application with Lock( Aug 18 21:45:09.448089 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:45:09.448089 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:45:09.448089 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:45:09.448089 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:45:09.448089 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:45:09.448089 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:45:09.448089 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:45:09.448089 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:45:09.448089 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 21:45:09.449016 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 21:45:09.449016 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:45:09.449016 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:45:09.449016 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 609/1215] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 18 21:45:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:45:09.454416 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce42a12-6f46-484a-a99d-47b6b8f2492a None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:45:09.519590 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:45:09.557113 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce42a12-6f46-484a-a99d-47b6b8f2492a None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:45:09.590436 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ae3584-afe3-4bee-b1a2-e0e4094fa6df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:45:09.591060 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ae3584-afe3-4bee-b1a2-e0e4094fa6df None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:45:09.591487 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ae3584-afe3-4bee-b1a2-e0e4094fa6df None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:45:09.591766 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ae3584-afe3-4bee-b1a2-e0e4094fa6df None admin] PATH_INFO: `/v3/domains` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:45:09.592403 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ae3584-afe3-4bee-b1a2-e0e4094fa6df None admin] RBAC: Adding query filter params (name=Default) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:45:09.592738 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ae3584-afe3-4bee-b1a2-e0e4094fa6df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:45:09.594088 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ae3584-afe3-4bee-b1a2-e0e4094fa6df None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:45:09.607638 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 607/1216] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 18 21:45:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:45:09.613452 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74208cf-1917-4a37-8a7f-fac8f11b94a5 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:45:09.686580 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:45:09.723589 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74208cf-1917-4a37-8a7f-fac8f11b94a5 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:45:09.760422 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f8ee42-b145-43c6-babc-2f73edd6988b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:45:09.761083 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f8ee42-b145-43c6-babc-2f73edd6988b None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:45:09.761358 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f8ee42-b145-43c6-babc-2f73edd6988b None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:45:09.761626 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f8ee42-b145-43c6-babc-2f73edd6988b None admin] PATH_INFO: `/v3/projects/service` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:45:09.768199 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f8ee42-b145-43c6-babc-2f73edd6988b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:45:09.769670 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f8ee42-b145-43c6-babc-2f73edd6988b None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:45:09.786332 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application [None req-f9f8ee42-b145-43c6-babc-2f73edd6988b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 21:45:09.786332 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:45:09.786332 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:45:09.786332 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:45:09.786332 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:45:09.786332 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:45:09.786332 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:45:09.786332 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:45:09.786332 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:45:09.786332 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:45:09.786332 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:45:09.786332 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:45:09.786332 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 21:45:09.786332 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 21:45:09.786332 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 21:45:09.791588 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 21:45:09.791588 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:45:09.791588 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:45:09.791588 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:45:09.791588 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:45:09.791588 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:45:09.791588 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:45:09.791588 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:45:09.791588 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application with Lock( Aug 18 21:45:09.791588 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:45:09.791588 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:45:09.791588 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:45:09.791588 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:45:09.791588 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:45:09.791588 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:45:09.791588 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:45:09.791588 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:45:09.792558 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 21:45:09.792558 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 21:45:09.792558 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 21:45:09.792558 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 21:45:09.792558 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 21:45:09.792558 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 21:45:09.792558 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 21:45:09.792558 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:45:09.792558 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 610/1217] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Aug 18 21:45:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:45:09.793098 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ae3584-afe3-4bee-b1a2-e0e4094fa6df None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:45:09.892862 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ae3584-afe3-4bee-b1a2-e0e4094fa6df None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:45:09.915083 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:45:09.927013 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fa09df-be9b-4f22-913a-6d8cd10764f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:45:09.927611 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fa09df-be9b-4f22-913a-6d8cd10764f4 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:45:09.927890 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fa09df-be9b-4f22-913a-6d8cd10764f4 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:45:09.928162 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fa09df-be9b-4f22-913a-6d8cd10764f4 None admin] PATH_INFO: `/v3/projects` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:45:09.928872 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fa09df-be9b-4f22-913a-6d8cd10764f4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:45:09.929175 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fa09df-be9b-4f22-913a-6d8cd10764f4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:45:09.930606 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fa09df-be9b-4f22-913a-6d8cd10764f4 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:45:09.942491 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 608/1218] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Aug 18 21:45:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:45:09.948587 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f8ee42-b145-43c6-babc-2f73edd6988b None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:45:10.048044 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f8ee42-b145-43c6-babc-2f73edd6988b None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:45:10.076093 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:45:10.081946 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcd339c-9660-4575-af73-a10b56ec34b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:45:10.082542 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcd339c-9660-4575-af73-a10b56ec34b4 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:45:10.082815 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcd339c-9660-4575-af73-a10b56ec34b4 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:45:10.083082 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcd339c-9660-4575-af73-a10b56ec34b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:45:10.083823 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcd339c-9660-4575-af73-a10b56ec34b4 None admin] RBAC: Adding query filter params (role.id=30d8ac11e30e4b1d83940485e98d147c, scope.project.id=4b54801b90484d689034f838f85fc0a4, user.id=b44c0cf2d8b34f3e81c59d19eedbdfcc) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:45:10.084126 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcd339c-9660-4575-af73-a10b56ec34b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:45:10.085588 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcd339c-9660-4575-af73-a10b56ec34b4 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:45:10.090720 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 611/1219] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Aug 18 21:45:09 2022] GET /identity/v3/role_assignments?user.id=b44c0cf2d8b34f3e81c59d19eedbdfcc&scope.project.id=4b54801b90484d689034f838f85fc0a4&role.id=30d8ac11e30e4b1d83940485e98d147c => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:45:11.999815 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d1309c-e5b3-4397-bbde-ab8d9cdb8438 None None] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:45:12.000648 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d1309c-e5b3-4397-bbde-ab8d9cdb8438 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:45:12.000648 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d1309c-e5b3-4397-bbde-ab8d9cdb8438 None None] PATH_INFO: `/` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:45:12.001757 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 609/1220] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:45:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 21:45:12.007413 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7003a1bf-f789-423d-a92a-08f0e9e4fdd0 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:45:12.014136 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7003a1bf-f789-423d-a92a-08f0e9e4fdd0 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:45:12.014136 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7003a1bf-f789-423d-a92a-08f0e9e4fdd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:45:12.026687 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-7003a1bf-f789-423d-a92a-08f0e9e4fdd0 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:45:12.027885 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-7003a1bf-f789-423d-a92a-08f0e9e4fdd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:45:12.094913 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 612/1221] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:45:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 21:45:12.367545 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d1309c-e5b3-4397-bbde-ab8d9cdb8438 None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:45:12.472301 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d1309c-e5b3-4397-bbde-ab8d9cdb8438 None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:45:12.508563 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acf3aa9-3341-43af-99e7-3eb2683c6124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:45:12.509344 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acf3aa9-3341-43af-99e7-3eb2683c6124 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:45:12.509849 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acf3aa9-3341-43af-99e7-3eb2683c6124 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:45:12.510225 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acf3aa9-3341-43af-99e7-3eb2683c6124 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:45:12.521399 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acf3aa9-3341-43af-99e7-3eb2683c6124 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:45:12.526031 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application [None req-0acf3aa9-3341-43af-99e7-3eb2683c6124 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 21:45:12.526031 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:45:12.526031 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:45:12.526031 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:45:12.526031 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:45:12.526031 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:45:12.526031 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:45:12.526031 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:45:12.526031 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:45:12.526031 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:45:12.526031 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:45:12.526031 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:45:12.526031 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:45:12.526031 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:45:12.526031 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:45:12.526031 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:45:12.527116 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:45:12.527116 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:45:12.527116 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:45:12.527116 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:45:12.527116 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:45:12.527116 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:45:12.527116 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:45:12.527116 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:45:12.527116 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:45:12.527116 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:45:12.527116 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:45:12.527116 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application with Lock( Aug 18 21:45:12.527116 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:45:12.527116 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:45:12.527116 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:45:12.527116 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:45:12.528343 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:45:12.528343 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:45:12.528343 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:45:12.528343 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:45:12.528343 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:45:12.528343 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:45:12.528343 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:45:12.528343 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:45:12.528343 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:45:12.528343 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:45:12.528343 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 21:45:12.528343 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:45:12.528343 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 610/1222] 10.222.0.27 () {56 vars in 1102 bytes} [Thu Aug 18 21:45:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:45:12.533659 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7003a1bf-f789-423d-a92a-08f0e9e4fdd0 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:45:12.643436 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7003a1bf-f789-423d-a92a-08f0e9e4fdd0 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:45:12.667889 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:45:12.679356 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70889c39-b1e7-4cbe-896c-8b13ee47c814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:45:12.679996 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70889c39-b1e7-4cbe-896c-8b13ee47c814 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:45:12.680276 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70889c39-b1e7-4cbe-896c-8b13ee47c814 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:45:12.680548 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70889c39-b1e7-4cbe-896c-8b13ee47c814 None admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:45:12.681240 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70889c39-b1e7-4cbe-896c-8b13ee47c814 None admin] RBAC: Adding query filter params (name=service) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:45:12.681541 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70889c39-b1e7-4cbe-896c-8b13ee47c814 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:45:12.682908 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70889c39-b1e7-4cbe-896c-8b13ee47c814 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:45:12.691084 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 613/1223] 10.222.0.27 () {56 vars in 1103 bytes} [Thu Aug 18 21:45:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:45:12.698620 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acf3aa9-3341-43af-99e7-3eb2683c6124 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:45:12.743993 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:45:12.803032 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acf3aa9-3341-43af-99e7-3eb2683c6124 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:45:12.837151 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb94184e-1854-4c44-9e3e-e7a55c32f6c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:45:12.837782 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb94184e-1854-4c44-9e3e-e7a55c32f6c2 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:45:12.838063 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb94184e-1854-4c44-9e3e-e7a55c32f6c2 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:45:12.838337 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb94184e-1854-4c44-9e3e-e7a55c32f6c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:45:12.850547 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb94184e-1854-4c44-9e3e-e7a55c32f6c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:45:12.852050 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb94184e-1854-4c44-9e3e-e7a55c32f6c2 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:45:12.867582 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application [None req-bb94184e-1854-4c44-9e3e-e7a55c32f6c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:45:12.867582 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:45:12.867582 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:45:12.867582 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:45:12.867582 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:45:12.867582 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:45:12.867582 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:45:12.867582 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:45:12.867582 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:45:12.867582 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:45:12.867582 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:45:12.867582 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:45:12.867582 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 21:45:12.867582 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 21:45:12.867582 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 21:45:12.867582 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 21:45:12.868783 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:45:12.868783 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:45:12.868783 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:45:12.868783 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:45:12.868783 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:45:12.868783 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:45:12.868783 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:45:12.868783 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application with Lock( Aug 18 21:45:12.868783 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:45:12.868783 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:45:12.868783 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:45:12.868783 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:45:12.868783 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:45:12.868783 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:45:12.868783 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:45:12.868783 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:45:12.868783 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 21:45:12.869998 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 21:45:12.869998 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:45:12.869998 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:45:12.869998 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 611/1224] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 18 21:45:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:45:12.874799 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70889c39-b1e7-4cbe-896c-8b13ee47c814 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:45:12.976470 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70889c39-b1e7-4cbe-896c-8b13ee47c814 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:45:13.009561 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5120ab64-3002-4736-8f07-4c3049cee2e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:45:13.010226 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5120ab64-3002-4736-8f07-4c3049cee2e6 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:45:13.010423 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5120ab64-3002-4736-8f07-4c3049cee2e6 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:45:13.010692 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5120ab64-3002-4736-8f07-4c3049cee2e6 None admin] PATH_INFO: `/v3/domains` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:45:13.011327 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5120ab64-3002-4736-8f07-4c3049cee2e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:45:13.011622 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5120ab64-3002-4736-8f07-4c3049cee2e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:45:13.013612 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5120ab64-3002-4736-8f07-4c3049cee2e6 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:45:13.025533 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 614/1225] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 18 21:45:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:45:13.032009 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb94184e-1854-4c44-9e3e-e7a55c32f6c2 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:45:13.128569 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:45:13.135909 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb94184e-1854-4c44-9e3e-e7a55c32f6c2 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:45:13.172563 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72be56df-4699-475a-ba18-c1284ef50810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:45:13.173358 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72be56df-4699-475a-ba18-c1284ef50810 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:45:13.173639 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72be56df-4699-475a-ba18-c1284ef50810 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:45:13.173913 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72be56df-4699-475a-ba18-c1284ef50810 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:45:13.181589 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72be56df-4699-475a-ba18-c1284ef50810 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:45:13.183091 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72be56df-4699-475a-ba18-c1284ef50810 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:45:13.195452 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application [None req-72be56df-4699-475a-ba18-c1284ef50810 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 18 21:45:13.195452 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:45:13.195452 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:45:13.195452 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:45:13.195452 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:45:13.195452 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:45:13.195452 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:45:13.195452 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:45:13.195452 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:45:13.195452 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:45:13.195452 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:45:13.195452 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:45:13.195452 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 21:45:13.195452 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 21:45:13.195452 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 21:45:13.195452 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 21:45:13.196647 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:45:13.196647 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:45:13.196647 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 21:45:13.196647 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 21:45:13.196647 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 21:45:13.196647 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 21:45:13.196647 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:45:13.196647 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:45:13.196647 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:45:13.196647 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:45:13.196647 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:45:13.196647 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application with Lock( Aug 18 21:45:13.196647 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:45:13.196647 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:45:13.196647 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:45:13.196647 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:45:13.196647 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:45:13.196647 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:45:13.197811 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:45:13.197811 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:45:13.197811 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 21:45:13.197811 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 21:45:13.197811 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 21:45:13.197811 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 21:45:13.197811 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 21:45:13.197811 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 21:45:13.197811 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 18 21:45:13.197811 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:45:13.201299 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 612/1226] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 18 21:45:13 2022] GET /identity/v3/users/placement => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:45:13.202977 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5120ab64-3002-4736-8f07-4c3049cee2e6 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:45:13.258554 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:45:13.313076 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5120ab64-3002-4736-8f07-4c3049cee2e6 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:45:13.347898 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221f632a-6fe1-45e0-807a-22e202cc3771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:45:13.348502 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221f632a-6fe1-45e0-807a-22e202cc3771 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:45:13.348882 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221f632a-6fe1-45e0-807a-22e202cc3771 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:45:13.349160 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221f632a-6fe1-45e0-807a-22e202cc3771 None admin] PATH_INFO: `/v3/users` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:45:13.349916 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221f632a-6fe1-45e0-807a-22e202cc3771 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:45:13.350216 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221f632a-6fe1-45e0-807a-22e202cc3771 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:45:13.351666 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221f632a-6fe1-45e0-807a-22e202cc3771 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:45:13.370752 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 615/1227] 10.222.0.27 () {56 vars in 1143 bytes} [Thu Aug 18 21:45:13 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:45:13.377891 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72be56df-4699-475a-ba18-c1284ef50810 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:45:13.484905 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72be56df-4699-475a-ba18-c1284ef50810 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:45:13.522520 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9825814f-6a40-4421-8639-df73a4d4b5a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:45:13.523512 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9825814f-6a40-4421-8639-df73a4d4b5a1 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:45:13.524012 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9825814f-6a40-4421-8639-df73a4d4b5a1 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:45:13.524421 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9825814f-6a40-4421-8639-df73a4d4b5a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:45:13.537933 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9825814f-6a40-4421-8639-df73a4d4b5a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:45:13.539371 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9825814f-6a40-4421-8639-df73a4d4b5a1 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:45:13.553376 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application [None req-9825814f-6a40-4421-8639-df73a4d4b5a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:45:13.553376 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:45:13.553376 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:45:13.553376 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:45:13.553376 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:45:13.553376 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:45:13.553376 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:45:13.553376 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:45:13.553376 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:45:13.553376 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:45:13.553376 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:45:13.553376 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:45:13.553376 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 21:45:13.553376 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 21:45:13.553376 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 21:45:13.553376 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 21:45:13.554631 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:45:13.554631 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:45:13.554631 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:45:13.554631 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:45:13.554631 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:45:13.554631 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:45:13.554631 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:45:13.554631 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application with Lock( Aug 18 21:45:13.554631 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:45:13.554631 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:45:13.554631 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:45:13.554631 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:45:13.554631 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:45:13.554631 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:45:13.554631 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:45:13.554631 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:45:13.554631 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 21:45:13.556102 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 21:45:13.556102 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:45:13.556102 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:45:13.556102 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 613/1228] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 18 21:45:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:45:13.560642 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221f632a-6fe1-45e0-807a-22e202cc3771 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:45:13.669325 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221f632a-6fe1-45e0-807a-22e202cc3771 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:45:13.671686 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:45:13.705447 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86ac2ec-7b61-4170-a21d-0041d3cf397d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:45:13.706054 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ac2ec-7b61-4170-a21d-0041d3cf397d None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:45:13.706335 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ac2ec-7b61-4170-a21d-0041d3cf397d None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:45:13.706609 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ac2ec-7b61-4170-a21d-0041d3cf397d None admin] PATH_INFO: `/v3/domains` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:45:13.707255 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86ac2ec-7b61-4170-a21d-0041d3cf397d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:45:13.707557 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86ac2ec-7b61-4170-a21d-0041d3cf397d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:45:13.708961 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86ac2ec-7b61-4170-a21d-0041d3cf397d None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:45:13.721457 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 616/1229] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 18 21:45:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:45:13.727287 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9825814f-6a40-4421-8639-df73a4d4b5a1 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:45:13.737620 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:45:13.834220 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9825814f-6a40-4421-8639-df73a4d4b5a1 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:45:13.869621 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48125559-80ef-4747-ac32-fcd70f1d58b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:45:13.870253 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48125559-80ef-4747-ac32-fcd70f1d58b1 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:45:13.870538 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48125559-80ef-4747-ac32-fcd70f1d58b1 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:45:13.870812 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48125559-80ef-4747-ac32-fcd70f1d58b1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:45:13.878598 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48125559-80ef-4747-ac32-fcd70f1d58b1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:45:13.884461 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48125559-80ef-4747-ac32-fcd70f1d58b1 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:45:13.892691 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application [None req-48125559-80ef-4747-ac32-fcd70f1d58b1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 21:45:13.892691 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:45:13.892691 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:45:13.892691 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:45:13.892691 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:45:13.892691 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:45:13.892691 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:45:13.892691 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:45:13.892691 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:45:13.892691 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:45:13.892691 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:45:13.892691 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:45:13.892691 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 21:45:13.892691 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 21:45:13.892691 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 21:45:13.893734 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 21:45:13.893734 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:45:13.893734 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:45:13.893734 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:45:13.893734 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:45:13.893734 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:45:13.893734 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:45:13.893734 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:45:13.893734 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application with Lock( Aug 18 21:45:13.893734 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:45:13.893734 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:45:13.893734 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:45:13.893734 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:45:13.893734 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:45:13.893734 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:45:13.893734 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:45:13.893734 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:45:13.894857 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 21:45:13.894857 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 21:45:13.894857 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 21:45:13.894857 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 21:45:13.894857 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 21:45:13.894857 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 21:45:13.894857 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 21:45:13.894857 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:45:13.894857 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 614/1230] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Aug 18 21:45:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 21:45:13.900185 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86ac2ec-7b61-4170-a21d-0041d3cf397d None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:45:14.002372 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86ac2ec-7b61-4170-a21d-0041d3cf397d None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:45:14.037103 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ca35a0-0870-4ab4-869c-853933f5a4a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:45:14.037759 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ca35a0-0870-4ab4-869c-853933f5a4a3 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:45:14.037977 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ca35a0-0870-4ab4-869c-853933f5a4a3 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:45:14.038251 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ca35a0-0870-4ab4-869c-853933f5a4a3 None admin] PATH_INFO: `/v3/projects` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:45:14.038942 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ca35a0-0870-4ab4-869c-853933f5a4a3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:45:14.039249 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ca35a0-0870-4ab4-869c-853933f5a4a3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:45:14.040714 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ca35a0-0870-4ab4-869c-853933f5a4a3 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:45:14.053612 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 617/1231] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Aug 18 21:45:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:45:14.059838 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48125559-80ef-4747-ac32-fcd70f1d58b1 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:45:14.128074 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:45:14.163429 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48125559-80ef-4747-ac32-fcd70f1d58b1 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:45:14.197149 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb11ee2e-2a1d-4f35-bc47-854b240be002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:45:14.197920 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb11ee2e-2a1d-4f35-bc47-854b240be002 None admin] REQUEST_METHOD: `PUT` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:45:14.198194 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb11ee2e-2a1d-4f35-bc47-854b240be002 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:45:14.198466 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb11ee2e-2a1d-4f35-bc47-854b240be002 None admin] PATH_INFO: `/v3/projects/4b54801b90484d689034f838f85fc0a4/users/b44c0cf2d8b34f3e81c59d19eedbdfcc/roles/30d8ac11e30e4b1d83940485e98d147c` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:45:14.214107 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb11ee2e-2a1d-4f35-bc47-854b240be002 None admin] RBAC: Authorizing `identity:create_grant(project_id=4b54801b90484d689034f838f85fc0a4, user_id=b44c0cf2d8b34f3e81c59d19eedbdfcc, role_id=30d8ac11e30e4b1d83940485e98d147c)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:45:14.215540 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb11ee2e-2a1d-4f35-bc47-854b240be002 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:45:14.347174 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 615/1232] 10.222.0.27 () {58 vars in 1439 bytes} [Thu Aug 18 21:45:14 2022] PUT /identity/v3/projects/4b54801b90484d689034f838f85fc0a4/users/b44c0cf2d8b34f3e81c59d19eedbdfcc/roles/30d8ac11e30e4b1d83940485e98d147c => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:45:16.264673 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c856f4-7c08-4d11-ac15-f581e0da893b None None] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:45:16.265264 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c856f4-7c08-4d11-ac15-f581e0da893b None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:45:16.265401 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c856f4-7c08-4d11-ac15-f581e0da893b None None] PATH_INFO: `/` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:45:16.266750 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 618/1233] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:45:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:45:16.272395 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a652cd-8924-4f5f-a485-c9935388079b None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:45:16.272832 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a652cd-8924-4f5f-a485-c9935388079b None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:45:16.272981 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a652cd-8924-4f5f-a485-c9935388079b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:45:16.291140 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-09a652cd-8924-4f5f-a485-c9935388079b None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:45:16.292329 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-09a652cd-8924-4f5f-a485-c9935388079b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:45:16.362214 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 616/1234] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:45:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 21:45:16.633411 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c856f4-7c08-4d11-ac15-f581e0da893b None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:45:16.661499 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:45:16.737911 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c856f4-7c08-4d11-ac15-f581e0da893b None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:45:16.772714 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27f7c6e-9146-4f57-9825-8752b9a44ecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:45:16.773342 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27f7c6e-9146-4f57-9825-8752b9a44ecf None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:45:16.773625 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27f7c6e-9146-4f57-9825-8752b9a44ecf None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:45:16.773902 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27f7c6e-9146-4f57-9825-8752b9a44ecf None admin] PATH_INFO: `/v3/roles/service` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:45:16.784277 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27f7c6e-9146-4f57-9825-8752b9a44ecf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:45:16.788935 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application [None req-c27f7c6e-9146-4f57-9825-8752b9a44ecf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 21:45:16.788935 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:45:16.788935 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:45:16.788935 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:45:16.788935 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:45:16.788935 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:45:16.788935 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:45:16.788935 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:45:16.788935 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:45:16.788935 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:45:16.788935 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:45:16.788935 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:45:16.788935 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:45:16.788935 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:45:16.788935 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:45:16.788935 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:45:16.790155 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:45:16.790155 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:45:16.790155 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:45:16.790155 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:45:16.790155 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:45:16.790155 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:45:16.790155 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:45:16.790155 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:45:16.790155 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:45:16.790155 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:45:16.790155 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:45:16.790155 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application with Lock( Aug 18 21:45:16.790155 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:45:16.790155 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:45:16.790155 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:45:16.790155 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:45:16.791259 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:45:16.791259 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:45:16.791259 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:45:16.791259 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:45:16.791259 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:45:16.791259 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:45:16.791259 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:45:16.791259 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:45:16.791259 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:45:16.791259 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:45:16.791259 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 21:45:16.791259 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:45:16.791259 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 619/1235] 10.222.0.27 () {56 vars in 1102 bytes} [Thu Aug 18 21:45:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:45:16.796682 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a652cd-8924-4f5f-a485-c9935388079b None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:45:16.842976 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:45:16.895979 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a652cd-8924-4f5f-a485-c9935388079b None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:45:16.930946 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e40617-31de-40ef-b4d2-24be8636e5d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:45:16.931555 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e40617-31de-40ef-b4d2-24be8636e5d8 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:45:16.931838 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e40617-31de-40ef-b4d2-24be8636e5d8 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:45:16.932113 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e40617-31de-40ef-b4d2-24be8636e5d8 None admin] PATH_INFO: `/v3/roles` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:45:16.932870 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e40617-31de-40ef-b4d2-24be8636e5d8 None admin] RBAC: Adding query filter params (name=service) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:45:16.933430 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e40617-31de-40ef-b4d2-24be8636e5d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:45:16.935414 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e40617-31de-40ef-b4d2-24be8636e5d8 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:45:16.944224 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 617/1236] 10.222.0.27 () {56 vars in 1103 bytes} [Thu Aug 18 21:45:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:45:16.950054 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27f7c6e-9146-4f57-9825-8752b9a44ecf None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:45:17.036261 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:45:17.053425 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27f7c6e-9146-4f57-9825-8752b9a44ecf None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:45:17.087401 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d2b5eb-3040-455a-94bb-eb30a3185b44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:45:17.088026 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d2b5eb-3040-455a-94bb-eb30a3185b44 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:45:17.088307 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d2b5eb-3040-455a-94bb-eb30a3185b44 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:45:17.088615 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d2b5eb-3040-455a-94bb-eb30a3185b44 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:45:17.099776 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d2b5eb-3040-455a-94bb-eb30a3185b44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:45:17.101275 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d2b5eb-3040-455a-94bb-eb30a3185b44 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:45:17.116243 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application [None req-76d2b5eb-3040-455a-94bb-eb30a3185b44 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:45:17.116243 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:45:17.116243 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:45:17.116243 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:45:17.116243 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:45:17.116243 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:45:17.116243 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:45:17.116243 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:45:17.116243 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:45:17.116243 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:45:17.116243 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:45:17.116243 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:45:17.116243 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 21:45:17.116243 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 21:45:17.116243 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 21:45:17.116243 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 21:45:17.122081 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:45:17.122081 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:45:17.122081 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:45:17.122081 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:45:17.122081 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:45:17.122081 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:45:17.122081 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:45:17.122081 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application with Lock( Aug 18 21:45:17.122081 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:45:17.122081 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:45:17.122081 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:45:17.122081 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:45:17.122081 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:45:17.122081 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:45:17.122081 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:45:17.122081 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:45:17.122081 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 21:45:17.123096 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 21:45:17.123096 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:45:17.123096 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:45:17.123096 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 620/1237] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 18 21:45:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:45:17.123524 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e40617-31de-40ef-b4d2-24be8636e5d8 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:45:17.225541 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e40617-31de-40ef-b4d2-24be8636e5d8 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:45:17.236029 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:45:17.261043 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7ef303-b003-4aa2-b774-dddebe91f60e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:45:17.261681 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7ef303-b003-4aa2-b774-dddebe91f60e None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:45:17.261960 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7ef303-b003-4aa2-b774-dddebe91f60e None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:45:17.262227 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7ef303-b003-4aa2-b774-dddebe91f60e None admin] PATH_INFO: `/v3/domains` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:45:17.262896 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7ef303-b003-4aa2-b774-dddebe91f60e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:45:17.263193 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7ef303-b003-4aa2-b774-dddebe91f60e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:45:17.264629 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7ef303-b003-4aa2-b774-dddebe91f60e None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:45:17.277093 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 618/1238] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 18 21:45:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:45:17.283660 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d2b5eb-3040-455a-94bb-eb30a3185b44 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:45:17.385883 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d2b5eb-3040-455a-94bb-eb30a3185b44 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:45:17.420776 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712b008e-870d-40fe-bb70-de425fc57eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:45:17.421957 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712b008e-870d-40fe-bb70-de425fc57eac None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:45:17.422236 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712b008e-870d-40fe-bb70-de425fc57eac None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:45:17.422506 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712b008e-870d-40fe-bb70-de425fc57eac None admin] PATH_INFO: `/v3/users/placement` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:45:17.425261 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:45:17.431055 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712b008e-870d-40fe-bb70-de425fc57eac None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:45:17.432499 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712b008e-870d-40fe-bb70-de425fc57eac None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:45:17.443651 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application [None req-712b008e-870d-40fe-bb70-de425fc57eac None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 18 21:45:17.443651 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:45:17.443651 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:45:17.443651 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:45:17.443651 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:45:17.443651 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:45:17.443651 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:45:17.443651 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:45:17.443651 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:45:17.443651 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:45:17.443651 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:45:17.443651 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:45:17.443651 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 21:45:17.443651 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 21:45:17.443651 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 21:45:17.443651 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 21:45:17.444774 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:45:17.444774 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:45:17.444774 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 21:45:17.444774 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 21:45:17.444774 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 21:45:17.444774 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 21:45:17.444774 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:45:17.444774 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:45:17.444774 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:45:17.444774 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:45:17.444774 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:45:17.444774 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application with Lock( Aug 18 21:45:17.444774 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:45:17.444774 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:45:17.444774 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:45:17.444774 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:45:17.444774 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:45:17.444774 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:45:17.445918 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:45:17.445918 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:45:17.445918 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 21:45:17.445918 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 21:45:17.445918 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 21:45:17.445918 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 21:45:17.445918 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 21:45:17.445918 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 21:45:17.445918 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 18 21:45:17.445918 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:45:17.445918 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 621/1239] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 18 21:45:17 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:45:17.451489 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7ef303-b003-4aa2-b774-dddebe91f60e None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:45:17.557899 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7ef303-b003-4aa2-b774-dddebe91f60e None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:45:17.594146 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285c2b46-4ed2-4ad7-99ba-c38bafa41ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:45:17.594759 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285c2b46-4ed2-4ad7-99ba-c38bafa41ea8 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:45:17.595036 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285c2b46-4ed2-4ad7-99ba-c38bafa41ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:45:17.595305 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285c2b46-4ed2-4ad7-99ba-c38bafa41ea8 None admin] PATH_INFO: `/v3/users` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:45:17.596074 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285c2b46-4ed2-4ad7-99ba-c38bafa41ea8 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:45:17.596409 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285c2b46-4ed2-4ad7-99ba-c38bafa41ea8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:45:17.597866 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285c2b46-4ed2-4ad7-99ba-c38bafa41ea8 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:45:17.615407 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 619/1240] 10.222.0.27 () {56 vars in 1143 bytes} [Thu Aug 18 21:45:17 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:45:17.621482 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712b008e-870d-40fe-bb70-de425fc57eac None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:45:17.726329 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712b008e-870d-40fe-bb70-de425fc57eac None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:45:17.761039 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786b4489-4e81-4287-8262-a99d4b31f3a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:45:17.761633 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786b4489-4e81-4287-8262-a99d4b31f3a6 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:45:17.761908 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786b4489-4e81-4287-8262-a99d4b31f3a6 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:45:17.762181 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786b4489-4e81-4287-8262-a99d4b31f3a6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:45:17.823832 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:45:17.831032 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786b4489-4e81-4287-8262-a99d4b31f3a6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:45:17.832547 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786b4489-4e81-4287-8262-a99d4b31f3a6 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:45:17.934376 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 622/1241] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Aug 18 21:45:17 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 18 21:45:17.941182 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285c2b46-4ed2-4ad7-99ba-c38bafa41ea8 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:45:17.971079 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:45:18.043187 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285c2b46-4ed2-4ad7-99ba-c38bafa41ea8 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:45:18.079626 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cb99b2-62b6-4fad-8015-0df68e194eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:45:18.080180 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cb99b2-62b6-4fad-8015-0df68e194eac None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:45:18.080435 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cb99b2-62b6-4fad-8015-0df68e194eac None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:45:18.080740 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cb99b2-62b6-4fad-8015-0df68e194eac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:45:18.091028 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cb99b2-62b6-4fad-8015-0df68e194eac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:45:18.092475 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cb99b2-62b6-4fad-8015-0df68e194eac None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:45:18.107089 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application [None req-86cb99b2-62b6-4fad-8015-0df68e194eac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:45:18.107089 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:45:18.107089 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:45:18.107089 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:45:18.107089 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:45:18.107089 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:45:18.107089 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:45:18.107089 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:45:18.107089 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:45:18.107089 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:45:18.107089 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:45:18.107089 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:45:18.107089 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 21:45:18.107089 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 21:45:18.107089 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 21:45:18.107089 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 21:45:18.108235 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:45:18.108235 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:45:18.108235 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:45:18.108235 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:45:18.108235 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:45:18.108235 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:45:18.108235 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:45:18.108235 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application with Lock( Aug 18 21:45:18.108235 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:45:18.108235 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:45:18.108235 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:45:18.108235 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:45:18.108235 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:45:18.108235 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:45:18.108235 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:45:18.108235 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:45:18.108235 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 21:45:18.109641 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 21:45:18.109641 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:45:18.109641 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:45:18.109641 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 620/1242] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 18 21:45:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:45:18.113963 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786b4489-4e81-4287-8262-a99d4b31f3a6 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:45:18.211529 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:45:18.217812 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786b4489-4e81-4287-8262-a99d4b31f3a6 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:45:18.253521 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5080d9-2f3a-450a-85a6-4d292edbfe33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:45:18.254118 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5080d9-2f3a-450a-85a6-4d292edbfe33 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:45:18.254399 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5080d9-2f3a-450a-85a6-4d292edbfe33 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:45:18.254668 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5080d9-2f3a-450a-85a6-4d292edbfe33 None admin] PATH_INFO: `/v3/domains` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:45:18.255305 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5080d9-2f3a-450a-85a6-4d292edbfe33 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:45:18.255621 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5080d9-2f3a-450a-85a6-4d292edbfe33 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:45:18.257077 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5080d9-2f3a-450a-85a6-4d292edbfe33 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:45:18.269228 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 623/1243] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 18 21:45:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:45:18.275346 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cb99b2-62b6-4fad-8015-0df68e194eac None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:45:18.357292 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:45:18.379619 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cb99b2-62b6-4fad-8015-0df68e194eac None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:45:18.414550 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d945359-a5cc-4328-a736-ed6463fb6a58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:45:18.415189 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d945359-a5cc-4328-a736-ed6463fb6a58 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:45:18.415444 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d945359-a5cc-4328-a736-ed6463fb6a58 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:45:18.415714 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d945359-a5cc-4328-a736-ed6463fb6a58 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:45:18.424182 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d945359-a5cc-4328-a736-ed6463fb6a58 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:45:18.425808 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d945359-a5cc-4328-a736-ed6463fb6a58 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:45:18.437969 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application [None req-3d945359-a5cc-4328-a736-ed6463fb6a58 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 21:45:18.437969 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:45:18.437969 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:45:18.437969 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:45:18.437969 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:45:18.437969 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:45:18.437969 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:45:18.437969 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:45:18.437969 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:45:18.437969 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:45:18.437969 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:45:18.437969 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:45:18.437969 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 21:45:18.437969 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 21:45:18.437969 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 21:45:18.438974 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 21:45:18.438974 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:45:18.438974 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:45:18.438974 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:45:18.438974 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:45:18.438974 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:45:18.438974 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:45:18.438974 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:45:18.438974 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application with Lock( Aug 18 21:45:18.438974 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:45:18.438974 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:45:18.438974 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:45:18.438974 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:45:18.438974 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:45:18.438974 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:45:18.438974 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:45:18.438974 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:45:18.440286 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 21:45:18.440286 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 21:45:18.440286 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 21:45:18.440286 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 21:45:18.440286 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 21:45:18.440286 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 21:45:18.440286 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 21:45:18.440286 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:45:18.440286 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 621/1244] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Aug 18 21:45:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:45:18.444992 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5080d9-2f3a-450a-85a6-4d292edbfe33 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:45:18.542973 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5080d9-2f3a-450a-85a6-4d292edbfe33 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:45:18.576637 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d799bea7-c9e0-4f68-a5fd-0f9bcfb9aa98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:45:18.577235 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d799bea7-c9e0-4f68-a5fd-0f9bcfb9aa98 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:45:18.577550 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d799bea7-c9e0-4f68-a5fd-0f9bcfb9aa98 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:45:18.577816 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d799bea7-c9e0-4f68-a5fd-0f9bcfb9aa98 None admin] PATH_INFO: `/v3/projects` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:45:18.578499 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d799bea7-c9e0-4f68-a5fd-0f9bcfb9aa98 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:45:18.578799 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d799bea7-c9e0-4f68-a5fd-0f9bcfb9aa98 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:45:18.580220 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d799bea7-c9e0-4f68-a5fd-0f9bcfb9aa98 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:45:18.594038 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 624/1245] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Aug 18 21:45:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:45:18.600271 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d945359-a5cc-4328-a736-ed6463fb6a58 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:45:18.709050 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d945359-a5cc-4328-a736-ed6463fb6a58 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:45:18.748402 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680c7b13-1695-4bc6-8308-a65ec63835ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:45:18.749032 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680c7b13-1695-4bc6-8308-a65ec63835ba None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:45:18.749318 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680c7b13-1695-4bc6-8308-a65ec63835ba None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:45:18.749625 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680c7b13-1695-4bc6-8308-a65ec63835ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:45:18.750357 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680c7b13-1695-4bc6-8308-a65ec63835ba None admin] RBAC: Adding query filter params (role.id=30d8ac11e30e4b1d83940485e98d147c, scope.project.id=4b54801b90484d689034f838f85fc0a4, user.id=b44c0cf2d8b34f3e81c59d19eedbdfcc) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:45:18.750670 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680c7b13-1695-4bc6-8308-a65ec63835ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:45:18.752092 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680c7b13-1695-4bc6-8308-a65ec63835ba None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:45:18.758083 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 622/1246] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Aug 18 21:45:18 2022] GET /identity/v3/role_assignments?user.id=b44c0cf2d8b34f3e81c59d19eedbdfcc&scope.project.id=4b54801b90484d689034f838f85fc0a4&role.id=30d8ac11e30e4b1d83940485e98d147c => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:45:20.773179 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2c5d49-45b4-45d4-a56f-6c0f77b4bce7 None None] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:45:20.773735 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2c5d49-45b4-45d4-a56f-6c0f77b4bce7 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:45:20.773735 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2c5d49-45b4-45d4-a56f-6c0f77b4bce7 None None] PATH_INFO: `/` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:45:20.775100 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 625/1247] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:45:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:45:20.780330 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e53e38-44f8-4045-a56c-1c1052ec4500 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:45:20.781496 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e53e38-44f8-4045-a56c-1c1052ec4500 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:45:20.781673 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e53e38-44f8-4045-a56c-1c1052ec4500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:45:20.787872 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:45:20.800107 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-77e53e38-44f8-4045-a56c-1c1052ec4500 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:45:20.801345 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-77e53e38-44f8-4045-a56c-1c1052ec4500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:45:20.867706 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 623/1248] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:45:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 21:45:21.138151 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2c5d49-45b4-45d4-a56f-6c0f77b4bce7 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:45:21.157445 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:45:21.241133 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2c5d49-45b4-45d4-a56f-6c0f77b4bce7 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:45:21.277456 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48862fde-bc41-4337-b050-e9042ee1d43e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:45:21.278080 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48862fde-bc41-4337-b050-e9042ee1d43e None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:45:21.278359 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48862fde-bc41-4337-b050-e9042ee1d43e None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:45:21.278632 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48862fde-bc41-4337-b050-e9042ee1d43e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:45:21.289221 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48862fde-bc41-4337-b050-e9042ee1d43e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:45:21.294064 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application [None req-48862fde-bc41-4337-b050-e9042ee1d43e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 21:45:21.294064 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:45:21.294064 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:45:21.294064 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:45:21.294064 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:45:21.294064 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:45:21.294064 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:45:21.294064 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:45:21.294064 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:45:21.294064 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:45:21.294064 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:45:21.294064 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:45:21.294064 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:45:21.294064 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:45:21.294064 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:45:21.294064 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:45:21.295177 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:45:21.295177 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:45:21.295177 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:45:21.295177 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:45:21.295177 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:45:21.295177 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:45:21.295177 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:45:21.295177 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:45:21.295177 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:45:21.295177 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:45:21.295177 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:45:21.295177 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application with Lock( Aug 18 21:45:21.295177 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:45:21.295177 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:45:21.295177 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:45:21.295177 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:45:21.296726 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:45:21.296726 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:45:21.296726 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:45:21.296726 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:45:21.296726 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:45:21.296726 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:45:21.296726 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:45:21.296726 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:45:21.296726 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:45:21.296726 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:45:21.296726 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 21:45:21.296726 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:45:21.296726 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 626/1249] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Aug 18 21:45:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:45:21.302004 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e53e38-44f8-4045-a56c-1c1052ec4500 None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:45:21.402675 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e53e38-44f8-4045-a56c-1c1052ec4500 None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:45:21.431663 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:45:21.436466 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a022297-7c3b-4ba8-9778-2ed002ab33f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:45:21.438356 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a022297-7c3b-4ba8-9778-2ed002ab33f4 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:45:21.438356 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a022297-7c3b-4ba8-9778-2ed002ab33f4 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:45:21.438581 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a022297-7c3b-4ba8-9778-2ed002ab33f4 None admin] PATH_INFO: `/v3/roles` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:45:21.439036 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a022297-7c3b-4ba8-9778-2ed002ab33f4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:45:21.439335 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a022297-7c3b-4ba8-9778-2ed002ab33f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:45:21.440720 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a022297-7c3b-4ba8-9778-2ed002ab33f4 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:45:21.449114 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 624/1250] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Aug 18 21:45:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:45:21.454947 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48862fde-bc41-4337-b050-e9042ee1d43e None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:45:21.531708 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:45:21.554549 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48862fde-bc41-4337-b050-e9042ee1d43e None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:45:21.588134 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862606ed-548d-476c-80d9-33dac3a1db03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:45:21.588773 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862606ed-548d-476c-80d9-33dac3a1db03 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:45:21.589051 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862606ed-548d-476c-80d9-33dac3a1db03 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:45:21.589317 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862606ed-548d-476c-80d9-33dac3a1db03 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:45:21.600082 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862606ed-548d-476c-80d9-33dac3a1db03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:45:21.606471 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862606ed-548d-476c-80d9-33dac3a1db03 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:45:21.615723 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application [None req-862606ed-548d-476c-80d9-33dac3a1db03 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:45:21.615723 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:45:21.615723 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:45:21.615723 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:45:21.615723 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:45:21.615723 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:45:21.615723 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:45:21.615723 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:45:21.615723 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:45:21.615723 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:45:21.615723 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:45:21.615723 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:45:21.615723 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 21:45:21.615723 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 21:45:21.615723 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 21:45:21.615723 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 21:45:21.616838 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:45:21.616838 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:45:21.616838 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:45:21.616838 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:45:21.616838 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:45:21.616838 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:45:21.616838 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:45:21.616838 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application with Lock( Aug 18 21:45:21.616838 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:45:21.616838 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:45:21.616838 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:45:21.616838 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:45:21.616838 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:45:21.616838 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:45:21.616838 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:45:21.616838 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:45:21.616838 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 21:45:21.617928 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 21:45:21.617928 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:45:21.617928 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:45:21.617928 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 627/1251] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 18 21:45:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:45:21.622848 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a022297-7c3b-4ba8-9778-2ed002ab33f4 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:45:21.722676 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a022297-7c3b-4ba8-9778-2ed002ab33f4 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:45:21.755988 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9674dc7-ab7f-470a-b409-033a5c8d4c46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:45:21.756621 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9674dc7-ab7f-470a-b409-033a5c8d4c46 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:45:21.756902 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9674dc7-ab7f-470a-b409-033a5c8d4c46 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:45:21.757175 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9674dc7-ab7f-470a-b409-033a5c8d4c46 None admin] PATH_INFO: `/v3/domains` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:45:21.757817 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9674dc7-ab7f-470a-b409-033a5c8d4c46 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:45:21.758118 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9674dc7-ab7f-470a-b409-033a5c8d4c46 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:45:21.759478 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9674dc7-ab7f-470a-b409-033a5c8d4c46 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:45:21.771725 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 625/1252] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 18 21:45:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:45:21.777561 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862606ed-548d-476c-80d9-33dac3a1db03 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:45:21.879124 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862606ed-548d-476c-80d9-33dac3a1db03 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:45:21.904168 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:45:21.912491 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf64bb71-10be-4ba3-a5a6-051ca16df196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:45:21.913135 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf64bb71-10be-4ba3-a5a6-051ca16df196 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:45:21.913412 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf64bb71-10be-4ba3-a5a6-051ca16df196 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:45:21.913682 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf64bb71-10be-4ba3-a5a6-051ca16df196 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:45:21.920798 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf64bb71-10be-4ba3-a5a6-051ca16df196 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:45:21.924720 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf64bb71-10be-4ba3-a5a6-051ca16df196 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:45:21.933537 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application [None req-bf64bb71-10be-4ba3-a5a6-051ca16df196 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 18 21:45:21.933537 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:45:21.933537 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:45:21.933537 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:45:21.933537 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:45:21.933537 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:45:21.933537 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:45:21.933537 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:45:21.933537 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:45:21.933537 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:45:21.933537 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:45:21.933537 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:45:21.933537 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 21:45:21.933537 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 21:45:21.933537 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 21:45:21.933537 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 21:45:21.934627 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:45:21.934627 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:45:21.934627 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 21:45:21.934627 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 21:45:21.934627 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 21:45:21.934627 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 21:45:21.934627 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:45:21.934627 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:45:21.934627 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:45:21.934627 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:45:21.934627 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:45:21.934627 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application with Lock( Aug 18 21:45:21.934627 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:45:21.934627 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:45:21.934627 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:45:21.934627 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:45:21.934627 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:45:21.934627 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:45:21.935769 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:45:21.935769 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:45:21.935769 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 21:45:21.935769 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 21:45:21.935769 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 21:45:21.935769 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 21:45:21.935769 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 21:45:21.935769 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 21:45:21.935769 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 18 21:45:21.935769 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:45:21.935769 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 628/1253] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 18 21:45:21 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 21:45:21.940617 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9674dc7-ab7f-470a-b409-033a5c8d4c46 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:45:21.997954 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:45:22.041044 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9674dc7-ab7f-470a-b409-033a5c8d4c46 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:45:22.074591 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297ff60e-1ea1-4aec-9bb5-c86440aa8eb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:45:22.075191 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297ff60e-1ea1-4aec-9bb5-c86440aa8eb6 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:45:22.075472 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297ff60e-1ea1-4aec-9bb5-c86440aa8eb6 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:45:22.075746 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297ff60e-1ea1-4aec-9bb5-c86440aa8eb6 None admin] PATH_INFO: `/v3/users` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:45:22.076468 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297ff60e-1ea1-4aec-9bb5-c86440aa8eb6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:45:22.076805 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297ff60e-1ea1-4aec-9bb5-c86440aa8eb6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:45:22.079106 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297ff60e-1ea1-4aec-9bb5-c86440aa8eb6 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:45:22.096638 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 626/1254] 10.222.0.27 () {56 vars in 1143 bytes} [Thu Aug 18 21:45:21 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:45:22.102417 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf64bb71-10be-4ba3-a5a6-051ca16df196 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:45:22.201044 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf64bb71-10be-4ba3-a5a6-051ca16df196 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:45:22.234652 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765da244-8ff4-453e-b674-e624119d727f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:45:22.235243 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765da244-8ff4-453e-b674-e624119d727f None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:45:22.235518 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765da244-8ff4-453e-b674-e624119d727f None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:45:22.235788 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765da244-8ff4-453e-b674-e624119d727f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:45:22.289930 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:45:22.301856 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765da244-8ff4-453e-b674-e624119d727f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:45:22.303420 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765da244-8ff4-453e-b674-e624119d727f None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:45:22.401549 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 629/1255] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Aug 18 21:45:22 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 18 21:45:22.403868 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297ff60e-1ea1-4aec-9bb5-c86440aa8eb6 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:45:22.502335 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297ff60e-1ea1-4aec-9bb5-c86440aa8eb6 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:45:22.515075 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:45:22.537028 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2f9e83-ed07-4eaa-9505-b591cdd0136d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:45:22.537722 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2f9e83-ed07-4eaa-9505-b591cdd0136d None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:45:22.538009 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2f9e83-ed07-4eaa-9505-b591cdd0136d None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:45:22.538285 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2f9e83-ed07-4eaa-9505-b591cdd0136d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:45:22.549343 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2f9e83-ed07-4eaa-9505-b591cdd0136d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:45:22.550717 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2f9e83-ed07-4eaa-9505-b591cdd0136d None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:45:22.565937 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application [None req-6f2f9e83-ed07-4eaa-9505-b591cdd0136d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:45:22.565937 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:45:22.565937 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:45:22.565937 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:45:22.565937 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:45:22.565937 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:45:22.565937 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:45:22.565937 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:45:22.565937 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:45:22.565937 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:45:22.565937 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:45:22.565937 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:45:22.565937 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 21:45:22.565937 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 21:45:22.565937 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 21:45:22.565937 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 21:45:22.567046 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:45:22.567046 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:45:22.567046 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:45:22.567046 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:45:22.567046 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:45:22.567046 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:45:22.567046 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:45:22.567046 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application with Lock( Aug 18 21:45:22.567046 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:45:22.567046 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:45:22.567046 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:45:22.567046 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:45:22.567046 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:45:22.567046 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:45:22.567046 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:45:22.567046 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:45:22.567046 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 21:45:22.568152 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 21:45:22.568152 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:45:22.568152 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:45:22.568152 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 627/1256] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 18 21:45:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:45:22.572993 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765da244-8ff4-453e-b674-e624119d727f None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:45:22.660741 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:45:22.672575 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765da244-8ff4-453e-b674-e624119d727f None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:45:22.705916 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c08df32-6ed3-43b1-8434-08e9d3d0b213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:45:22.706508 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c08df32-6ed3-43b1-8434-08e9d3d0b213 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:45:22.706783 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c08df32-6ed3-43b1-8434-08e9d3d0b213 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:45:22.707054 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c08df32-6ed3-43b1-8434-08e9d3d0b213 None admin] PATH_INFO: `/v3/domains` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:45:22.707689 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c08df32-6ed3-43b1-8434-08e9d3d0b213 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:45:22.707982 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c08df32-6ed3-43b1-8434-08e9d3d0b213 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:45:22.709476 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c08df32-6ed3-43b1-8434-08e9d3d0b213 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:45:22.721405 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 630/1257] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 18 21:45:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:45:22.727280 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2f9e83-ed07-4eaa-9505-b591cdd0136d None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:45:22.831123 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2f9e83-ed07-4eaa-9505-b591cdd0136d None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:45:22.864399 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31eacd2-08fc-4cc2-a493-cc3f6161dabc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:45:22.865056 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31eacd2-08fc-4cc2-a493-cc3f6161dabc None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:45:22.865328 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31eacd2-08fc-4cc2-a493-cc3f6161dabc None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:45:22.865595 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31eacd2-08fc-4cc2-a493-cc3f6161dabc None admin] PATH_INFO: `/v3/projects/service` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:45:22.872025 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31eacd2-08fc-4cc2-a493-cc3f6161dabc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:45:22.873481 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31eacd2-08fc-4cc2-a493-cc3f6161dabc None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:45:22.885108 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application [None req-c31eacd2-08fc-4cc2-a493-cc3f6161dabc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 21:45:22.885108 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:45:22.885108 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:45:22.885108 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:45:22.885108 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:45:22.885108 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:45:22.885108 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:45:22.885108 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:45:22.885108 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:45:22.885108 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:45:22.885108 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:45:22.885108 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:45:22.885108 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 21:45:22.885108 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 21:45:22.885108 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 21:45:22.886069 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 21:45:22.886069 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:45:22.886069 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:45:22.886069 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:45:22.886069 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:45:22.886069 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:45:22.886069 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:45:22.886069 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:45:22.886069 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application with Lock( Aug 18 21:45:22.886069 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:45:22.886069 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:45:22.886069 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:45:22.886069 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:45:22.886069 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:45:22.886069 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:45:22.886069 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:45:22.886069 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:45:22.887053 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 21:45:22.887053 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 21:45:22.887053 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 21:45:22.887053 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 21:45:22.887053 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 21:45:22.887053 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 21:45:22.887053 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 21:45:22.887053 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:45:22.887053 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 628/1258] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Aug 18 21:45:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:45:22.892381 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c08df32-6ed3-43b1-8434-08e9d3d0b213 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:45:22.993535 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c08df32-6ed3-43b1-8434-08e9d3d0b213 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:45:23.027716 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f403b8e-0d75-433a-bb63-cc330e9a119b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:45:23.028327 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f403b8e-0d75-433a-bb63-cc330e9a119b None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:45:23.028630 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f403b8e-0d75-433a-bb63-cc330e9a119b None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:45:23.028971 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f403b8e-0d75-433a-bb63-cc330e9a119b None admin] PATH_INFO: `/v3/projects` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:45:23.029659 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f403b8e-0d75-433a-bb63-cc330e9a119b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:45:23.029959 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f403b8e-0d75-433a-bb63-cc330e9a119b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:45:23.031420 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f403b8e-0d75-433a-bb63-cc330e9a119b None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:45:23.043299 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 631/1259] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Aug 18 21:45:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:45:23.050313 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31eacd2-08fc-4cc2-a493-cc3f6161dabc None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:45:23.076031 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:45:23.147149 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31eacd2-08fc-4cc2-a493-cc3f6161dabc None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:45:23.181730 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e822df50-705b-4eb2-bbd6-1ad494f75040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:45:23.182326 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e822df50-705b-4eb2-bbd6-1ad494f75040 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:45:23.182642 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e822df50-705b-4eb2-bbd6-1ad494f75040 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:45:23.182921 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e822df50-705b-4eb2-bbd6-1ad494f75040 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:45:23.183638 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e822df50-705b-4eb2-bbd6-1ad494f75040 None admin] RBAC: Adding query filter params (role.id=0833202e2a3d47d1b6b3af57006641b1, scope.project.id=4b54801b90484d689034f838f85fc0a4, user.id=b44c0cf2d8b34f3e81c59d19eedbdfcc) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:45:23.183941 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e822df50-705b-4eb2-bbd6-1ad494f75040 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:45:23.185380 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e822df50-705b-4eb2-bbd6-1ad494f75040 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:45:23.190756 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 629/1260] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Aug 18 21:45:23 2022] GET /identity/v3/role_assignments?user.id=b44c0cf2d8b34f3e81c59d19eedbdfcc&scope.project.id=4b54801b90484d689034f838f85fc0a4&role.id=0833202e2a3d47d1b6b3af57006641b1 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:45:25.115877 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595a42fa-b43f-47f5-a3e6-d698573d80f8 None None] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:45:25.116449 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595a42fa-b43f-47f5-a3e6-d698573d80f8 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:45:25.116449 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595a42fa-b43f-47f5-a3e6-d698573d80f8 None None] PATH_INFO: `/` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:45:25.117776 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 632/1261] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:45:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:45:25.122793 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428860c0-b933-4617-af3a-5733b5f722ec None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:45:25.123224 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428860c0-b933-4617-af3a-5733b5f722ec None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:45:25.123324 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428860c0-b933-4617-af3a-5733b5f722ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:45:25.141365 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-428860c0-b933-4617-af3a-5733b5f722ec None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:45:25.142539 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-428860c0-b933-4617-af3a-5733b5f722ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:45:25.211989 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 630/1262] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:45:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 21:45:25.479369 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595a42fa-b43f-47f5-a3e6-d698573d80f8 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:45:25.490366 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:45:25.580996 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595a42fa-b43f-47f5-a3e6-d698573d80f8 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:45:25.615311 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c658340-f938-4db8-9da9-1019014ced14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:45:25.615927 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c658340-f938-4db8-9da9-1019014ced14 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:45:25.616204 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c658340-f938-4db8-9da9-1019014ced14 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:45:25.616472 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c658340-f938-4db8-9da9-1019014ced14 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:45:25.627557 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c658340-f938-4db8-9da9-1019014ced14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:45:25.632324 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application [None req-1c658340-f938-4db8-9da9-1019014ced14 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 21:45:25.632324 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:45:25.632324 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:45:25.632324 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:45:25.632324 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:45:25.632324 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:45:25.632324 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:45:25.632324 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:45:25.632324 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:45:25.632324 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:45:25.632324 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:45:25.632324 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:45:25.632324 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:45:25.632324 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:45:25.632324 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:45:25.632324 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:45:25.633505 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:45:25.633505 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:45:25.633505 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:45:25.633505 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:45:25.633505 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:45:25.633505 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:45:25.633505 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:45:25.633505 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:45:25.633505 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:45:25.633505 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:45:25.633505 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:45:25.633505 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application with Lock( Aug 18 21:45:25.633505 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:45:25.633505 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:45:25.633505 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:45:25.633505 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:45:25.634759 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:45:25.634759 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:45:25.634759 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:45:25.634759 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:45:25.634759 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:45:25.634759 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:45:25.634759 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:45:25.634759 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:45:25.634759 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:45:25.634759 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:45:25.634759 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 21:45:25.634759 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:45:25.634759 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 633/1263] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Aug 18 21:45:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:45:25.639729 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428860c0-b933-4617-af3a-5733b5f722ec None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:45:25.659221 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:45:25.743456 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428860c0-b933-4617-af3a-5733b5f722ec None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:45:25.777573 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfab3e92-1fd0-471f-8cfc-b440fa2c4099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:45:25.778199 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfab3e92-1fd0-471f-8cfc-b440fa2c4099 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:45:25.778463 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfab3e92-1fd0-471f-8cfc-b440fa2c4099 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:45:25.778734 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfab3e92-1fd0-471f-8cfc-b440fa2c4099 None admin] PATH_INFO: `/v3/roles` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:45:25.779394 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfab3e92-1fd0-471f-8cfc-b440fa2c4099 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:45:25.779698 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfab3e92-1fd0-471f-8cfc-b440fa2c4099 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:45:25.781367 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfab3e92-1fd0-471f-8cfc-b440fa2c4099 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:45:25.789515 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 631/1264] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Aug 18 21:45:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:45:25.795358 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c658340-f938-4db8-9da9-1019014ced14 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:45:25.862108 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:45:25.895050 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c658340-f938-4db8-9da9-1019014ced14 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:45:25.929007 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dec87b3-de85-4923-bc6f-5b4830079e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:45:25.929624 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dec87b3-de85-4923-bc6f-5b4830079e64 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:45:25.929909 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dec87b3-de85-4923-bc6f-5b4830079e64 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:45:25.930168 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dec87b3-de85-4923-bc6f-5b4830079e64 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:45:25.941157 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dec87b3-de85-4923-bc6f-5b4830079e64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:45:25.942651 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dec87b3-de85-4923-bc6f-5b4830079e64 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:45:25.956044 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application [None req-9dec87b3-de85-4923-bc6f-5b4830079e64 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:45:25.956044 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:45:25.956044 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:45:25.956044 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:45:25.956044 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:45:25.956044 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:45:25.956044 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:45:25.956044 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:45:25.956044 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:45:25.956044 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:45:25.956044 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:45:25.956044 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:45:25.956044 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 21:45:25.956044 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 21:45:25.956044 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 21:45:25.956044 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 21:45:25.957197 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:45:25.957197 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:45:25.957197 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:45:25.957197 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:45:25.957197 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:45:25.957197 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:45:25.957197 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:45:25.957197 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application with Lock( Aug 18 21:45:25.957197 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:45:25.957197 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:45:25.957197 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:45:25.957197 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:45:25.957197 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:45:25.957197 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:45:25.957197 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:45:25.957197 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:45:25.957197 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 21:45:25.958260 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 21:45:25.958260 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:45:25.958260 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:45:25.958260 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 634/1265] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 18 21:45:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:45:25.963089 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfab3e92-1fd0-471f-8cfc-b440fa2c4099 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:45:26.047236 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:45:26.067043 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfab3e92-1fd0-471f-8cfc-b440fa2c4099 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:45:26.099697 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b090c2-4f04-4a21-acbc-3904e2effaef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:45:26.100288 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b090c2-4f04-4a21-acbc-3904e2effaef None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:45:26.100564 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b090c2-4f04-4a21-acbc-3904e2effaef None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:45:26.100865 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b090c2-4f04-4a21-acbc-3904e2effaef None admin] PATH_INFO: `/v3/domains` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:45:26.101491 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b090c2-4f04-4a21-acbc-3904e2effaef None admin] RBAC: Adding query filter params (name=Default) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:45:26.101813 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b090c2-4f04-4a21-acbc-3904e2effaef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:45:26.103202 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b090c2-4f04-4a21-acbc-3904e2effaef None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:45:26.116322 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 632/1266] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 18 21:45:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:45:26.122002 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dec87b3-de85-4923-bc6f-5b4830079e64 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:45:26.220764 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dec87b3-de85-4923-bc6f-5b4830079e64 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:45:26.240103 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:45:26.253254 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52896c11-6699-403e-81f9-fc7ef9423ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:45:26.253870 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52896c11-6699-403e-81f9-fc7ef9423ab6 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:45:26.254145 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52896c11-6699-403e-81f9-fc7ef9423ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:45:26.254416 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52896c11-6699-403e-81f9-fc7ef9423ab6 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:45:26.262443 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52896c11-6699-403e-81f9-fc7ef9423ab6 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:45:26.263883 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52896c11-6699-403e-81f9-fc7ef9423ab6 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:45:26.275120 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application [None req-52896c11-6699-403e-81f9-fc7ef9423ab6 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 18 21:45:26.275120 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:45:26.275120 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:45:26.275120 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:45:26.275120 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:45:26.275120 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:45:26.275120 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:45:26.275120 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:45:26.275120 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:45:26.275120 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:45:26.275120 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:45:26.275120 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:45:26.275120 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 21:45:26.275120 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 21:45:26.275120 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 21:45:26.275120 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 21:45:26.276296 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:45:26.276296 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:45:26.276296 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 21:45:26.276296 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 21:45:26.276296 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 21:45:26.276296 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 21:45:26.276296 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:45:26.276296 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:45:26.276296 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:45:26.276296 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:45:26.276296 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:45:26.276296 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application with Lock( Aug 18 21:45:26.276296 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:45:26.276296 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:45:26.276296 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:45:26.276296 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:45:26.276296 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:45:26.276296 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:45:26.277318 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:45:26.277318 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:45:26.277318 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 21:45:26.277318 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 21:45:26.277318 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 21:45:26.277318 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 21:45:26.277318 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 21:45:26.277318 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 21:45:26.277318 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 18 21:45:26.277318 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:45:26.277318 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 635/1267] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 18 21:45:26 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 21:45:26.282634 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b090c2-4f04-4a21-acbc-3904e2effaef None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:45:26.380888 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b090c2-4f04-4a21-acbc-3904e2effaef None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:45:26.415183 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0d6db3-7858-416b-96f8-3f576fb272b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:45:26.415774 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0d6db3-7858-416b-96f8-3f576fb272b9 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:45:26.416048 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0d6db3-7858-416b-96f8-3f576fb272b9 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:45:26.416314 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0d6db3-7858-416b-96f8-3f576fb272b9 None admin] PATH_INFO: `/v3/users` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:45:26.417060 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0d6db3-7858-416b-96f8-3f576fb272b9 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:45:26.417351 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0d6db3-7858-416b-96f8-3f576fb272b9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:45:26.418753 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0d6db3-7858-416b-96f8-3f576fb272b9 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:45:26.427656 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:45:26.435729 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 633/1268] 10.222.0.27 () {56 vars in 1143 bytes} [Thu Aug 18 21:45:26 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:45:26.441595 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52896c11-6699-403e-81f9-fc7ef9423ab6 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:45:26.537876 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52896c11-6699-403e-81f9-fc7ef9423ab6 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:45:26.569715 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d68ca2-2b35-4169-a9d7-e15074d36526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:45:26.570326 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d68ca2-2b35-4169-a9d7-e15074d36526 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:45:26.570600 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d68ca2-2b35-4169-a9d7-e15074d36526 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:45:26.570867 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d68ca2-2b35-4169-a9d7-e15074d36526 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:45:26.581537 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d68ca2-2b35-4169-a9d7-e15074d36526 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:45:26.582960 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d68ca2-2b35-4169-a9d7-e15074d36526 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:45:26.597040 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application [None req-16d68ca2-2b35-4169-a9d7-e15074d36526 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:45:26.597040 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:45:26.597040 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:45:26.597040 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:45:26.597040 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:45:26.597040 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:45:26.597040 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:45:26.597040 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:45:26.597040 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:45:26.597040 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:45:26.597040 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:45:26.597040 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:45:26.597040 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 21:45:26.597040 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 21:45:26.597040 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 21:45:26.597040 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 21:45:26.598156 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:45:26.598156 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:45:26.598156 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:45:26.598156 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:45:26.598156 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:45:26.598156 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:45:26.598156 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:45:26.598156 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application with Lock( Aug 18 21:45:26.598156 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:45:26.598156 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:45:26.598156 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:45:26.598156 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:45:26.598156 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:45:26.598156 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:45:26.598156 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:45:26.598156 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:45:26.598156 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 21:45:26.599280 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 21:45:26.599280 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:45:26.599280 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:45:26.599280 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 636/1269] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 18 21:45:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:45:26.604014 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0d6db3-7858-416b-96f8-3f576fb272b9 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:45:26.702485 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0d6db3-7858-416b-96f8-3f576fb272b9 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:45:26.735899 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a21e25-6237-418d-9793-78a12afd49fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:45:26.736493 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a21e25-6237-418d-9793-78a12afd49fe None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:45:26.736794 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a21e25-6237-418d-9793-78a12afd49fe None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:45:26.737063 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a21e25-6237-418d-9793-78a12afd49fe None admin] PATH_INFO: `/v3/domains` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:45:26.737698 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a21e25-6237-418d-9793-78a12afd49fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:45:26.737987 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a21e25-6237-418d-9793-78a12afd49fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:45:26.739331 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a21e25-6237-418d-9793-78a12afd49fe None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:45:26.751342 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 634/1270] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 18 21:45:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:45:26.757331 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d68ca2-2b35-4169-a9d7-e15074d36526 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:45:26.789455 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:45:26.858627 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d68ca2-2b35-4169-a9d7-e15074d36526 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:45:26.893003 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ea447e-c8a1-44c2-8709-e8f50c9708f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:45:26.893618 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ea447e-c8a1-44c2-8709-e8f50c9708f1 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:45:26.893897 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ea447e-c8a1-44c2-8709-e8f50c9708f1 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:45:26.894167 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ea447e-c8a1-44c2-8709-e8f50c9708f1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:45:26.901070 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ea447e-c8a1-44c2-8709-e8f50c9708f1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:45:26.902513 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ea447e-c8a1-44c2-8709-e8f50c9708f1 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:45:26.913404 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application [None req-54ea447e-c8a1-44c2-8709-e8f50c9708f1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 21:45:26.913404 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:45:26.913404 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:45:26.913404 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:45:26.913404 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:45:26.913404 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:45:26.913404 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:45:26.913404 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:45:26.913404 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:45:26.913404 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:45:26.913404 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:45:26.913404 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:45:26.913404 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 21:45:26.913404 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 21:45:26.913404 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 21:45:26.914569 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 21:45:26.914569 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:45:26.914569 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:45:26.914569 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:45:26.914569 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:45:26.914569 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:45:26.914569 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:45:26.914569 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:45:26.914569 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application with Lock( Aug 18 21:45:26.914569 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:45:26.914569 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:45:26.914569 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:45:26.914569 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:45:26.914569 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:45:26.914569 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:45:26.914569 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:45:26.914569 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:45:26.915634 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 21:45:26.915634 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 21:45:26.915634 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 21:45:26.915634 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 21:45:26.915634 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 21:45:26.915634 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 21:45:26.915634 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 21:45:26.915634 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:45:26.915634 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 637/1271] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Aug 18 21:45:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:45:26.920399 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a21e25-6237-418d-9793-78a12afd49fe None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:45:26.980275 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:45:27.022890 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a21e25-6237-418d-9793-78a12afd49fe None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:45:27.057462 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c2b91b-d992-408d-a2a2-151d72577f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:45:27.058074 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c2b91b-d992-408d-a2a2-151d72577f02 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:45:27.058355 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c2b91b-d992-408d-a2a2-151d72577f02 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:45:27.058675 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c2b91b-d992-408d-a2a2-151d72577f02 None admin] PATH_INFO: `/v3/projects` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:45:27.059360 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c2b91b-d992-408d-a2a2-151d72577f02 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:45:27.059663 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c2b91b-d992-408d-a2a2-151d72577f02 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:45:27.061238 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c2b91b-d992-408d-a2a2-151d72577f02 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:45:27.073650 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 635/1272] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Aug 18 21:45:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:45:27.080734 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ea447e-c8a1-44c2-8709-e8f50c9708f1 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:45:27.172030 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:45:27.180817 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ea447e-c8a1-44c2-8709-e8f50c9708f1 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:45:27.214617 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c19410a-6396-4b2d-9d5f-7c429149a62b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:45:27.215260 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c19410a-6396-4b2d-9d5f-7c429149a62b None admin] REQUEST_METHOD: `PUT` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:45:27.215544 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c19410a-6396-4b2d-9d5f-7c429149a62b None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:45:27.215806 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c19410a-6396-4b2d-9d5f-7c429149a62b None admin] PATH_INFO: `/v3/projects/4b54801b90484d689034f838f85fc0a4/users/b44c0cf2d8b34f3e81c59d19eedbdfcc/roles/0833202e2a3d47d1b6b3af57006641b1` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:45:27.217673 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c19410a-6396-4b2d-9d5f-7c429149a62b None admin] RBAC: Authorizing `identity:create_grant(project_id=4b54801b90484d689034f838f85fc0a4, user_id=b44c0cf2d8b34f3e81c59d19eedbdfcc, role_id=0833202e2a3d47d1b6b3af57006641b1)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:45:27.219309 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c19410a-6396-4b2d-9d5f-7c429149a62b None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:45:27.397924 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 638/1273] 10.222.0.27 () {58 vars in 1439 bytes} [Thu Aug 18 21:45:27 2022] PUT /identity/v3/projects/4b54801b90484d689034f838f85fc0a4/users/b44c0cf2d8b34f3e81c59d19eedbdfcc/roles/0833202e2a3d47d1b6b3af57006641b1 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:45:29.321127 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152964de-955f-4836-b1dd-ac0499c84dda None None] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:45:29.321603 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152964de-955f-4836-b1dd-ac0499c84dda None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:45:29.321696 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152964de-955f-4836-b1dd-ac0499c84dda None None] PATH_INFO: `/` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:45:29.322980 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 636/1274] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:45:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:45:29.328089 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7071ae2d-6d05-4d39-a0d4-90b0c867e20c None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:45:29.328533 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7071ae2d-6d05-4d39-a0d4-90b0c867e20c None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:45:29.328675 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7071ae2d-6d05-4d39-a0d4-90b0c867e20c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:45:29.347803 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-7071ae2d-6d05-4d39-a0d4-90b0c867e20c None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:45:29.349044 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-7071ae2d-6d05-4d39-a0d4-90b0c867e20c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:45:29.416423 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 639/1275] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:45:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 21:45:29.688755 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152964de-955f-4836-b1dd-ac0499c84dda None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:45:29.790647 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152964de-955f-4836-b1dd-ac0499c84dda None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:45:29.807515 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:45:29.825170 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd208cf-c04a-4275-8464-fdef698c718a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:45:29.825880 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd208cf-c04a-4275-8464-fdef698c718a None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:45:29.826161 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd208cf-c04a-4275-8464-fdef698c718a None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:45:29.826433 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd208cf-c04a-4275-8464-fdef698c718a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:45:29.837146 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd208cf-c04a-4275-8464-fdef698c718a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 21:45:29.841944 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application [None req-9cd208cf-c04a-4275-8464-fdef698c718a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 21:45:29.841944 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:45:29.841944 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:45:29.841944 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:45:29.841944 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:45:29.841944 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:45:29.841944 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:45:29.841944 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:45:29.841944 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:45:29.841944 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:45:29.841944 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:45:29.841944 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:45:29.841944 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 21:45:29.841944 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 21:45:29.841944 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 21:45:29.841944 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 21:45:29.843034 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 21:45:29.843034 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 21:45:29.843034 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 21:45:29.843034 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 21:45:29.843034 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:45:29.843034 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:45:29.843034 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:45:29.843034 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:45:29.843034 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:45:29.843034 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:45:29.843034 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:45:29.843034 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application with Lock( Aug 18 21:45:29.843034 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:45:29.843034 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:45:29.843034 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:45:29.843034 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:45:29.843975 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:45:29.843975 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:45:29.843975 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:45:29.843975 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:45:29.843975 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 21:45:29.843975 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 21:45:29.843975 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 21:45:29.843975 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 21:45:29.843975 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 21:45:29.843975 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 21:45:29.843975 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 21:45:29.843975 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:45:29.843975 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 637/1276] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Aug 18 21:45:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:45:29.849569 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7071ae2d-6d05-4d39-a0d4-90b0c867e20c None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:45:29.928795 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:45:29.946694 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7071ae2d-6d05-4d39-a0d4-90b0c867e20c None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:45:29.979785 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f39882-b480-4bb0-966b-f0bc2b802e4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:45:29.980372 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f39882-b480-4bb0-966b-f0bc2b802e4b None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:45:29.980675 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f39882-b480-4bb0-966b-f0bc2b802e4b None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:45:29.980947 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f39882-b480-4bb0-966b-f0bc2b802e4b None admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:45:29.981597 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f39882-b480-4bb0-966b-f0bc2b802e4b None admin] RBAC: Adding query filter params (name=admin) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:45:29.981892 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f39882-b480-4bb0-966b-f0bc2b802e4b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:45:29.983252 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f39882-b480-4bb0-966b-f0bc2b802e4b None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:45:29.991298 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 640/1277] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Aug 18 21:45:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:45:29.997129 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd208cf-c04a-4275-8464-fdef698c718a None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:45:30.099436 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd208cf-c04a-4275-8464-fdef698c718a None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:45:30.133103 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0a2f92-0f66-4dd2-b5b9-b191c92350fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:45:30.133727 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0a2f92-0f66-4dd2-b5b9-b191c92350fc None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:45:30.134008 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0a2f92-0f66-4dd2-b5b9-b191c92350fc None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:45:30.134281 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0a2f92-0f66-4dd2-b5b9-b191c92350fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:45:30.145444 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0a2f92-0f66-4dd2-b5b9-b191c92350fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:45:30.149493 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0a2f92-0f66-4dd2-b5b9-b191c92350fc None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:45:30.162586 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application [None req-ec0a2f92-0f66-4dd2-b5b9-b191c92350fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:45:30.162586 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:45:30.162586 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:45:30.162586 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:45:30.162586 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:45:30.162586 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:45:30.162586 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:45:30.162586 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:45:30.162586 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:45:30.162586 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:45:30.162586 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:45:30.162586 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:45:30.162586 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 21:45:30.162586 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 21:45:30.162586 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 21:45:30.162586 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 21:45:30.163679 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:45:30.163679 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:45:30.163679 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:45:30.163679 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:45:30.163679 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:45:30.163679 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:45:30.163679 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:45:30.163679 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application with Lock( Aug 18 21:45:30.163679 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:45:30.163679 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:45:30.163679 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:45:30.163679 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:45:30.163679 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:45:30.163679 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:45:30.163679 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:45:30.163679 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:45:30.163679 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 21:45:30.164819 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 21:45:30.164819 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:45:30.164819 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:45:30.164819 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 638/1278] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 18 21:45:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:45:30.169846 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f39882-b480-4bb0-966b-f0bc2b802e4b None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:45:30.269021 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f39882-b480-4bb0-966b-f0bc2b802e4b None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:45:30.306103 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fecae33-164d-43e1-bd81-ab1c86fa3091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:45:30.306703 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fecae33-164d-43e1-bd81-ab1c86fa3091 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:45:30.306983 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fecae33-164d-43e1-bd81-ab1c86fa3091 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:45:30.307256 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fecae33-164d-43e1-bd81-ab1c86fa3091 None admin] PATH_INFO: `/v3/domains` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:45:30.307893 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fecae33-164d-43e1-bd81-ab1c86fa3091 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:45:30.308194 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fecae33-164d-43e1-bd81-ab1c86fa3091 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:45:30.309609 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fecae33-164d-43e1-bd81-ab1c86fa3091 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:45:30.322298 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 641/1279] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 18 21:45:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:45:30.328089 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0a2f92-0f66-4dd2-b5b9-b191c92350fc None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:45:30.359093 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:45:30.426401 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0a2f92-0f66-4dd2-b5b9-b191c92350fc None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:45:30.459733 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24324842-98b7-4c49-967d-2953e0598acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:45:30.460349 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24324842-98b7-4c49-967d-2953e0598acc None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:45:30.460644 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24324842-98b7-4c49-967d-2953e0598acc None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:45:30.460911 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24324842-98b7-4c49-967d-2953e0598acc None admin] PATH_INFO: `/v3/users/placement` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:45:30.468330 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24324842-98b7-4c49-967d-2953e0598acc None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:45:30.470159 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24324842-98b7-4c49-967d-2953e0598acc None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:45:30.481778 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application [None req-24324842-98b7-4c49-967d-2953e0598acc None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 18 21:45:30.481778 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:45:30.481778 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:45:30.481778 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:45:30.481778 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:45:30.481778 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:45:30.481778 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:45:30.481778 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:45:30.481778 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:45:30.481778 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:45:30.481778 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:45:30.481778 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:45:30.481778 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 21:45:30.481778 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 21:45:30.481778 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 21:45:30.481778 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 21:45:30.482905 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:45:30.482905 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:45:30.482905 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 21:45:30.482905 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 21:45:30.482905 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 21:45:30.482905 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 21:45:30.482905 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:45:30.482905 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:45:30.482905 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:45:30.482905 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:45:30.482905 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:45:30.482905 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application with Lock( Aug 18 21:45:30.482905 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:45:30.482905 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:45:30.482905 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:45:30.482905 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:45:30.482905 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:45:30.482905 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:45:30.484181 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:45:30.484181 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:45:30.484181 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 21:45:30.484181 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 21:45:30.484181 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 21:45:30.484181 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 21:45:30.484181 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 21:45:30.484181 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 21:45:30.484181 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 18 21:45:30.484181 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:45:30.484181 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 639/1280] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 18 21:45:30 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:45:30.489351 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fecae33-164d-43e1-bd81-ab1c86fa3091 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:45:30.493191 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:45:30.584784 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fecae33-164d-43e1-bd81-ab1c86fa3091 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:45:30.618106 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4cae79-59f8-428d-9e2f-b2d090f711ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:45:30.618883 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4cae79-59f8-428d-9e2f-b2d090f711ae None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:45:30.619086 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4cae79-59f8-428d-9e2f-b2d090f711ae None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:45:30.619361 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4cae79-59f8-428d-9e2f-b2d090f711ae None admin] PATH_INFO: `/v3/users` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:45:30.620085 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4cae79-59f8-428d-9e2f-b2d090f711ae None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:45:30.620388 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4cae79-59f8-428d-9e2f-b2d090f711ae None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:45:30.621837 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4cae79-59f8-428d-9e2f-b2d090f711ae None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:45:30.638026 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 642/1281] 10.222.0.27 () {56 vars in 1143 bytes} [Thu Aug 18 21:45:30 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:45:30.643915 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24324842-98b7-4c49-967d-2953e0598acc None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:45:30.734930 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:45:30.744569 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24324842-98b7-4c49-967d-2953e0598acc None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:45:30.787742 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b946d1-c0d2-4792-add6-e52333727837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:45:30.788348 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b946d1-c0d2-4792-add6-e52333727837 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:45:30.788653 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b946d1-c0d2-4792-add6-e52333727837 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:45:30.788930 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b946d1-c0d2-4792-add6-e52333727837 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:45:30.855590 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b946d1-c0d2-4792-add6-e52333727837 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:45:30.856997 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b946d1-c0d2-4792-add6-e52333727837 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:45:30.949373 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:45:30.961665 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 640/1282] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Aug 18 21:45:30 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 18 21:45:30.967890 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4cae79-59f8-428d-9e2f-b2d090f711ae None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:45:31.032992 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:45:31.075532 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4cae79-59f8-428d-9e2f-b2d090f711ae None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:45:31.108583 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c263eb-e154-4174-b971-711b6cd742c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:45:31.109229 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c263eb-e154-4174-b971-711b6cd742c0 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:45:31.109497 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c263eb-e154-4174-b971-711b6cd742c0 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:45:31.109762 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c263eb-e154-4174-b971-711b6cd742c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:45:31.122200 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c263eb-e154-4174-b971-711b6cd742c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:45:31.123672 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c263eb-e154-4174-b971-711b6cd742c0 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:45:31.140248 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application [None req-a2c263eb-e154-4174-b971-711b6cd742c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:45:31.140248 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:45:31.140248 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:45:31.140248 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:45:31.140248 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:45:31.140248 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:45:31.140248 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:45:31.140248 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:45:31.140248 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:45:31.140248 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:45:31.140248 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:45:31.140248 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:45:31.140248 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 21:45:31.140248 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 21:45:31.140248 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 21:45:31.140248 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 21:45:31.142246 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:45:31.142246 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:45:31.142246 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:45:31.142246 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:45:31.142246 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:45:31.142246 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:45:31.142246 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:45:31.142246 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application with Lock( Aug 18 21:45:31.142246 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:45:31.142246 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:45:31.142246 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:45:31.142246 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:45:31.142246 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:45:31.142246 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:45:31.142246 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:45:31.142246 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:45:31.142246 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 21:45:31.143559 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 21:45:31.143559 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 21:45:31.143559 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:45:31.143559 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 643/1283] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 18 21:45:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:45:31.150516 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b946d1-c0d2-4792-add6-e52333727837 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:45:31.258218 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b946d1-c0d2-4792-add6-e52333727837 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:45:31.294823 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594d7432-17ce-4d99-b327-d131c5077858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:45:31.295435 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594d7432-17ce-4d99-b327-d131c5077858 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:45:31.295710 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594d7432-17ce-4d99-b327-d131c5077858 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:45:31.295977 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594d7432-17ce-4d99-b327-d131c5077858 None admin] PATH_INFO: `/v3/domains` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:45:31.296644 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594d7432-17ce-4d99-b327-d131c5077858 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:45:31.296943 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594d7432-17ce-4d99-b327-d131c5077858 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:45:31.298942 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594d7432-17ce-4d99-b327-d131c5077858 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:45:31.310856 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 641/1284] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 18 21:45:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:45:31.317332 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c263eb-e154-4174-b971-711b6cd742c0 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:45:31.420816 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c263eb-e154-4174-b971-711b6cd742c0 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:45:31.435166 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:45:31.461319 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b810c29-e5ec-4b48-be0d-729ccf94e1e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:45:31.461319 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b810c29-e5ec-4b48-be0d-729ccf94e1e6 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:45:31.461319 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b810c29-e5ec-4b48-be0d-729ccf94e1e6 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:45:31.461319 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b810c29-e5ec-4b48-be0d-729ccf94e1e6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:45:31.464167 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b810c29-e5ec-4b48-be0d-729ccf94e1e6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:45:31.465658 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b810c29-e5ec-4b48-be0d-729ccf94e1e6 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:45:31.478634 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application [None req-3b810c29-e5ec-4b48-be0d-729ccf94e1e6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 21:45:31.478634 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:45:31.478634 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:45:31.478634 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:45:31.478634 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:45:31.478634 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:45:31.478634 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:45:31.478634 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:45:31.478634 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:45:31.478634 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:45:31.478634 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:45:31.478634 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:45:31.478634 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 21:45:31.478634 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 21:45:31.478634 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 21:45:31.483133 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 21:45:31.483133 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:45:31.483133 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:45:31.483133 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:45:31.483133 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:45:31.483133 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:45:31.483133 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:45:31.483133 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:45:31.483133 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application with Lock( Aug 18 21:45:31.483133 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:45:31.483133 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:45:31.483133 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:45:31.483133 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:45:31.483133 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:45:31.483133 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:45:31.483133 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:45:31.483133 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:45:31.484243 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 21:45:31.484243 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 21:45:31.484243 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 21:45:31.484243 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 21:45:31.484243 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 21:45:31.484243 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 21:45:31.484243 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 21:45:31.484243 dv-cinder-853678-3-smb devstack@keystone.service[88097]: ERROR keystone.server.flask.application Aug 18 21:45:31.484243 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 644/1285] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Aug 18 21:45:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:45:31.487115 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594d7432-17ce-4d99-b327-d131c5077858 None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:45:31.540222 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:45:31.593664 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594d7432-17ce-4d99-b327-d131c5077858 None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:45:31.628733 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df895c9-9b8b-4d25-86d2-874f32c1eae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:45:31.629338 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df895c9-9b8b-4d25-86d2-874f32c1eae7 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:45:31.629610 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df895c9-9b8b-4d25-86d2-874f32c1eae7 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:45:31.629875 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df895c9-9b8b-4d25-86d2-874f32c1eae7 None admin] PATH_INFO: `/v3/projects` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:45:31.630548 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df895c9-9b8b-4d25-86d2-874f32c1eae7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:45:31.630843 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df895c9-9b8b-4d25-86d2-874f32c1eae7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:45:31.632339 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df895c9-9b8b-4d25-86d2-874f32c1eae7 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:45:31.644410 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 642/1286] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Aug 18 21:45:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 21:45:31.651109 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b810c29-e5ec-4b48-be0d-729ccf94e1e6 None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:45:31.756172 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b810c29-e5ec-4b48-be0d-729ccf94e1e6 None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:45:31.792283 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e99775b-a931-4bc2-9537-6c262667a800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:45:31.792923 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e99775b-a931-4bc2-9537-6c262667a800 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:45:31.793209 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e99775b-a931-4bc2-9537-6c262667a800 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:45:31.793482 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e99775b-a931-4bc2-9537-6c262667a800 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:45:31.794216 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e99775b-a931-4bc2-9537-6c262667a800 None admin] RBAC: Adding query filter params (role.id=0833202e2a3d47d1b6b3af57006641b1, scope.project.id=4b54801b90484d689034f838f85fc0a4, user.id=b44c0cf2d8b34f3e81c59d19eedbdfcc) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:45:31.794527 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e99775b-a931-4bc2-9537-6c262667a800 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:45:31.796030 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e99775b-a931-4bc2-9537-6c262667a800 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:45:31.803348 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 645/1287] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Aug 18 21:45:31 2022] GET /identity/v3/role_assignments?user.id=b44c0cf2d8b34f3e81c59d19eedbdfcc&scope.project.id=4b54801b90484d689034f838f85fc0a4&role.id=0833202e2a3d47d1b6b3af57006641b1 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:45:33.787629 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2896cd5-9e7f-4f6b-aed8-eddc1242c345 None None] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:45:33.788187 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2896cd5-9e7f-4f6b-aed8-eddc1242c345 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:45:33.788187 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2896cd5-9e7f-4f6b-aed8-eddc1242c345 None None] PATH_INFO: `/` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:45:33.789605 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 643/1288] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:45:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:45:33.795726 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db43380-a88a-489b-a5ea-612139476ff0 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:45:33.796241 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db43380-a88a-489b-a5ea-612139476ff0 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:45:33.796349 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db43380-a88a-489b-a5ea-612139476ff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:45:33.817326 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-3db43380-a88a-489b-a5ea-612139476ff0 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:45:33.818834 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-3db43380-a88a-489b-a5ea-612139476ff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:45:33.852923 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:45:33.894634 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 646/1289] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:45:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 21:45:34.165235 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2896cd5-9e7f-4f6b-aed8-eddc1242c345 None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:45:34.275337 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2896cd5-9e7f-4f6b-aed8-eddc1242c345 None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:45:34.287770 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:45:34.315357 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77950da2-f5e7-4c43-95ad-5e93ea30350e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:45:34.315985 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77950da2-f5e7-4c43-95ad-5e93ea30350e None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:45:34.316357 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77950da2-f5e7-4c43-95ad-5e93ea30350e None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:45:34.316683 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77950da2-f5e7-4c43-95ad-5e93ea30350e None admin] PATH_INFO: `/v3/services/placement` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:45:34.317351 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77950da2-f5e7-4c43-95ad-5e93ea30350e None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:45:34.318941 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77950da2-f5e7-4c43-95ad-5e93ea30350e None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:45:34.328051 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application [None req-77950da2-f5e7-4c43-95ad-5e93ea30350e None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 18 21:45:34.328051 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:45:34.328051 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 21:45:34.328051 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 21:45:34.328051 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 21:45:34.328051 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 21:45:34.328051 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 21:45:34.328051 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 21:45:34.328051 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 18 21:45:34.328051 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:45:34.328051 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 21:45:34.328051 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:45:34.328051 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:45:34.328051 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:45:34.328051 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:45:34.328051 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:45:34.328051 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:45:34.329306 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:45:34.329306 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:45:34.329306 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:45:34.329306 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:45:34.329306 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:45:34.329306 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:45:34.329306 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 21:45:34.329306 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 21:45:34.329306 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 21:45:34.329306 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 21:45:34.329306 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:45:34.329306 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:45:34.329306 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:45:34.329306 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:45:34.329306 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:45:34.329306 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:45:34.330188 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:45:34.330188 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application with Lock( Aug 18 21:45:34.330188 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:45:34.330188 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:45:34.330188 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:45:34.330188 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:45:34.330188 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:45:34.330188 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:45:34.330188 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:45:34.330188 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:45:34.330188 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 21:45:34.330188 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 21:45:34.330188 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 18 21:45:34.330188 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:45:34.330188 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 644/1290] 10.222.0.27 () {56 vars in 1117 bytes} [Thu Aug 18 21:45:34 2022] GET /identity/v3/services/placement => generated 90 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:45:34.335396 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db43380-a88a-489b-a5ea-612139476ff0 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:45:34.437012 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db43380-a88a-489b-a5ea-612139476ff0 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:45:34.471016 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ecd422-91b8-46f4-a6bc-5cc62c814ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:45:34.471619 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ecd422-91b8-46f4-a6bc-5cc62c814ede None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:45:34.471903 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ecd422-91b8-46f4-a6bc-5cc62c814ede None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:45:34.472182 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ecd422-91b8-46f4-a6bc-5cc62c814ede None admin] PATH_INFO: `/v3/services` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:45:34.472848 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ecd422-91b8-46f4-a6bc-5cc62c814ede None admin] RBAC: Adding query filter params (name=placement) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:45:34.473154 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ecd422-91b8-46f4-a6bc-5cc62c814ede None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:45:34.474528 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ecd422-91b8-46f4-a6bc-5cc62c814ede None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:45:34.479251 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 647/1291] 10.222.0.27 () {56 vars in 1116 bytes} [Thu Aug 18 21:45:34 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:45:34.486141 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77950da2-f5e7-4c43-95ad-5e93ea30350e None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:45:34.590569 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77950da2-f5e7-4c43-95ad-5e93ea30350e None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:45:34.625009 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e41db3a-1c02-4873-af00-86ab374761a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:45:34.625606 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e41db3a-1c02-4873-af00-86ab374761a5 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:45:34.625912 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e41db3a-1c02-4873-af00-86ab374761a5 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:45:34.626176 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e41db3a-1c02-4873-af00-86ab374761a5 None admin] PATH_INFO: `/v3/services` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:45:34.626796 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e41db3a-1c02-4873-af00-86ab374761a5 None admin] RBAC: Adding query filter params (type=placement) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:45:34.627093 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e41db3a-1c02-4873-af00-86ab374761a5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:45:34.628437 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e41db3a-1c02-4873-af00-86ab374761a5 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:45:34.633473 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 645/1292] 10.222.0.27 () {56 vars in 1116 bytes} [Thu Aug 18 21:45:34 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:45:36.555713 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812c4596-df7f-48ee-9040-de11f20e31c8 None None] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:45:36.556272 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812c4596-df7f-48ee-9040-de11f20e31c8 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:45:36.556272 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812c4596-df7f-48ee-9040-de11f20e31c8 None None] PATH_INFO: `/` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:45:36.557538 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 648/1293] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:45:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:45:36.562829 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabecc1e-69fb-4384-ba03-522cab29835d None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:45:36.563369 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabecc1e-69fb-4384-ba03-522cab29835d None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:45:36.564289 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabecc1e-69fb-4384-ba03-522cab29835d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:45:36.582619 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-eabecc1e-69fb-4384-ba03-522cab29835d None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:45:36.583982 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-eabecc1e-69fb-4384-ba03-522cab29835d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:45:36.620011 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:45:36.656972 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 646/1294] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:45:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 21:45:36.922297 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812c4596-df7f-48ee-9040-de11f20e31c8 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:45:36.955164 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:45:37.025207 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812c4596-df7f-48ee-9040-de11f20e31c8 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:45:37.060521 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d9ba3d-8a16-414f-8e57-8055a330f184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:45:37.061159 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d9ba3d-8a16-414f-8e57-8055a330f184 None admin] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:45:37.061433 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d9ba3d-8a16-414f-8e57-8055a330f184 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:45:37.061702 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d9ba3d-8a16-414f-8e57-8055a330f184 None admin] PATH_INFO: `/v3/services` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:45:37.062343 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d9ba3d-8a16-414f-8e57-8055a330f184 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:45:37.064494 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d9ba3d-8a16-414f-8e57-8055a330f184 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:45:37.160717 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 649/1295] 10.222.0.27 () {60 vars in 1141 bytes} [Thu Aug 18 21:45:36 2022] POST /identity/v3/services => generated 246 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:45:39.141893 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30954704-6afe-4be0-8db9-6c08c5da4dc6 None None] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:45:39.142501 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30954704-6afe-4be0-8db9-6c08c5da4dc6 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:45:39.142501 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30954704-6afe-4be0-8db9-6c08c5da4dc6 None None] PATH_INFO: `/` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:45:39.143792 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 647/1296] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:45:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:45:39.149757 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e6cc5a-573c-438b-add0-62a46d320e73 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:45:39.150276 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e6cc5a-573c-438b-add0-62a46d320e73 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:45:39.150377 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e6cc5a-573c-438b-add0-62a46d320e73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:45:39.169181 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-27e6cc5a-573c-438b-add0-62a46d320e73 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:45:39.170421 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-27e6cc5a-573c-438b-add0-62a46d320e73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:45:39.247083 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 650/1297] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:45:39 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 21:45:39.519106 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30954704-6afe-4be0-8db9-6c08c5da4dc6 None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:45:39.622718 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30954704-6afe-4be0-8db9-6c08c5da4dc6 None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:45:39.657787 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a800709-67d1-4bee-9e35-4c016b8f89db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:45:39.658419 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a800709-67d1-4bee-9e35-4c016b8f89db None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:45:39.658713 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a800709-67d1-4bee-9e35-4c016b8f89db None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:45:39.658984 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a800709-67d1-4bee-9e35-4c016b8f89db None admin] PATH_INFO: `/v3/services/placement` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:45:39.659580 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a800709-67d1-4bee-9e35-4c016b8f89db None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:45:39.660988 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a800709-67d1-4bee-9e35-4c016b8f89db None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:45:39.670222 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application [None req-3a800709-67d1-4bee-9e35-4c016b8f89db None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 18 21:45:39.670222 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:45:39.670222 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 21:45:39.670222 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 21:45:39.670222 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 21:45:39.670222 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 21:45:39.670222 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 21:45:39.670222 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 21:45:39.670222 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 18 21:45:39.670222 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:45:39.670222 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 21:45:39.670222 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:45:39.670222 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:45:39.670222 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:45:39.670222 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:45:39.670222 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:45:39.670222 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:45:39.672303 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:45:39.672303 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:45:39.672303 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:45:39.672303 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:45:39.672303 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:45:39.672303 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:45:39.672303 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 21:45:39.672303 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 21:45:39.672303 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 21:45:39.672303 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 21:45:39.672303 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:45:39.672303 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:45:39.672303 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:45:39.672303 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:45:39.672303 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:45:39.672303 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:45:39.674394 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:45:39.674394 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application with Lock( Aug 18 21:45:39.674394 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:45:39.674394 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:45:39.674394 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:45:39.674394 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:45:39.674394 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:45:39.674394 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:45:39.674394 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:45:39.674394 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:45:39.674394 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 21:45:39.674394 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 21:45:39.674394 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 18 21:45:39.674394 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:45:39.674394 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 648/1298] 10.222.0.27 () {56 vars in 1117 bytes} [Thu Aug 18 21:45:39 2022] GET /identity/v3/services/placement => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:45:39.679534 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e6cc5a-573c-438b-add0-62a46d320e73 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:45:39.700935 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:45:39.782686 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e6cc5a-573c-438b-add0-62a46d320e73 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:45:39.820545 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc29a83c-b240-4e13-ab63-692a2825502e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:45:39.821188 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc29a83c-b240-4e13-ab63-692a2825502e None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:45:39.821468 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc29a83c-b240-4e13-ab63-692a2825502e None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:45:39.821741 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc29a83c-b240-4e13-ab63-692a2825502e None admin] PATH_INFO: `/v3/services` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:45:39.822377 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc29a83c-b240-4e13-ab63-692a2825502e None admin] RBAC: Adding query filter params (name=placement) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:45:39.822680 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc29a83c-b240-4e13-ab63-692a2825502e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:45:39.824065 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc29a83c-b240-4e13-ab63-692a2825502e None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:45:39.829646 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 651/1299] 10.222.0.27 () {56 vars in 1116 bytes} [Thu Aug 18 21:45:39 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:45:39.835675 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a800709-67d1-4bee-9e35-4c016b8f89db None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:45:39.869775 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:45:39.942590 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a800709-67d1-4bee-9e35-4c016b8f89db None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:45:39.977498 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bb5b21-e90b-4114-aad0-f61a54a89bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:45:39.978114 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bb5b21-e90b-4114-aad0-f61a54a89bc2 None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:45:39.978386 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bb5b21-e90b-4114-aad0-f61a54a89bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:45:39.978655 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bb5b21-e90b-4114-aad0-f61a54a89bc2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:45:39.979349 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bb5b21-e90b-4114-aad0-f61a54a89bc2 None admin] RBAC: Adding query filter params (interface=public, service_id=0333e480753340479a359e70b6de0dcf, region_id=RegionOne) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:45:39.979652 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bb5b21-e90b-4114-aad0-f61a54a89bc2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:45:39.981049 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bb5b21-e90b-4114-aad0-f61a54a89bc2 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:45:39.986539 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 649/1300] 10.222.0.27 () {56 vars in 1251 bytes} [Thu Aug 18 21:45:39 2022] GET /identity/v3/endpoints?service_id=0333e480753340479a359e70b6de0dcf&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:45:39.992490 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc29a83c-b240-4e13-ab63-692a2825502e None admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:45:40.077839 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:45:40.096954 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc29a83c-b240-4e13-ab63-692a2825502e None admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:45:40.133286 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf2a54a-6c44-4594-a7d4-52116646878b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:45:40.133934 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf2a54a-6c44-4594-a7d4-52116646878b None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:45:40.134240 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf2a54a-6c44-4594-a7d4-52116646878b None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:45:40.134571 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf2a54a-6c44-4594-a7d4-52116646878b None admin] PATH_INFO: `/v3/services` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:45:40.135206 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf2a54a-6c44-4594-a7d4-52116646878b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:45:40.136627 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf2a54a-6c44-4594-a7d4-52116646878b None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:45:40.144578 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 652/1301] 10.222.0.27 () {56 vars in 1087 bytes} [Thu Aug 18 21:45:39 2022] GET /identity/v3/services => generated 2191 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:45:42.059731 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47abb267-fc0f-45b8-a3d9-6e0ffa09549f None None] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:45:42.060315 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47abb267-fc0f-45b8-a3d9-6e0ffa09549f None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:45:42.060315 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47abb267-fc0f-45b8-a3d9-6e0ffa09549f None None] PATH_INFO: `/` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:45:42.061729 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 650/1302] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:45:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:45:42.068060 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b0292d-3b18-4a36-9571-805ad2e8253f None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:45:42.068531 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b0292d-3b18-4a36-9571-805ad2e8253f None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:45:42.068736 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b0292d-3b18-4a36-9571-805ad2e8253f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:45:42.088030 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-c3b0292d-3b18-4a36-9571-805ad2e8253f None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:45:42.089281 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-c3b0292d-3b18-4a36-9571-805ad2e8253f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:45:42.159031 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 653/1303] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:45:42 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 21:45:42.426220 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47abb267-fc0f-45b8-a3d9-6e0ffa09549f None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:45:42.524084 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:45:42.530851 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47abb267-fc0f-45b8-a3d9-6e0ffa09549f None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:45:42.566258 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6d43f9-1eec-472a-8fc3-9eede92fc85c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:45:42.566885 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6d43f9-1eec-472a-8fc3-9eede92fc85c None admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:45:42.567160 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6d43f9-1eec-472a-8fc3-9eede92fc85c None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:45:42.567427 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6d43f9-1eec-472a-8fc3-9eede92fc85c None admin] PATH_INFO: `/v3/services/placement` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:45:42.568131 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6d43f9-1eec-472a-8fc3-9eede92fc85c None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:45:42.569509 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6d43f9-1eec-472a-8fc3-9eede92fc85c None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:45:42.577955 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application [None req-fb6d43f9-1eec-472a-8fc3-9eede92fc85c None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 18 21:45:42.577955 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:45:42.577955 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 21:45:42.577955 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 21:45:42.577955 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 21:45:42.577955 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 21:45:42.577955 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 21:45:42.577955 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 21:45:42.577955 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 18 21:45:42.577955 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:45:42.577955 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 21:45:42.577955 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:45:42.577955 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 21:45:42.577955 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 21:45:42.577955 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 21:45:42.577955 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 21:45:42.577955 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 21:45:42.579124 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 21:45:42.579124 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 21:45:42.579124 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 21:45:42.579124 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 21:45:42.579124 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 21:45:42.579124 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 21:45:42.579124 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 21:45:42.579124 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 21:45:42.579124 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 21:45:42.579124 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 21:45:42.579124 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 21:45:42.579124 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 21:45:42.579124 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 21:45:42.579124 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 21:45:42.579124 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 21:45:42.579124 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 21:45:42.580122 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 21:45:42.580122 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application with Lock( Aug 18 21:45:42.580122 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 21:45:42.580122 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self._enter() Aug 18 21:45:42.580122 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 21:45:42.580122 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 21:45:42.580122 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 21:45:42.580122 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application return self.creator() Aug 18 21:45:42.580122 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 21:45:42.580122 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application created_value = creator( Aug 18 21:45:42.580122 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 21:45:42.580122 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 21:45:42.580122 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 18 21:45:42.580122 dv-cinder-853678-3-smb devstack@keystone.service[88096]: ERROR keystone.server.flask.application Aug 18 21:45:42.580122 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 651/1304] 10.222.0.27 () {56 vars in 1117 bytes} [Thu Aug 18 21:45:42 2022] GET /identity/v3/services/placement => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 21:45:42.587053 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b0292d-3b18-4a36-9571-805ad2e8253f None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:45:42.666582 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:45:42.690710 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b0292d-3b18-4a36-9571-805ad2e8253f None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:45:42.724825 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b449c9c4-846c-42dc-8057-38988bfb2b67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:45:42.725429 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b449c9c4-846c-42dc-8057-38988bfb2b67 None admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:45:42.729848 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b449c9c4-846c-42dc-8057-38988bfb2b67 None admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:45:42.729848 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b449c9c4-846c-42dc-8057-38988bfb2b67 None admin] PATH_INFO: `/v3/services` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:45:42.729848 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b449c9c4-846c-42dc-8057-38988bfb2b67 None admin] RBAC: Adding query filter params (name=placement) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:45:42.729848 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b449c9c4-846c-42dc-8057-38988bfb2b67 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:45:42.729848 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b449c9c4-846c-42dc-8057-38988bfb2b67 None admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:45:42.733625 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 654/1305] 10.222.0.27 () {56 vars in 1116 bytes} [Thu Aug 18 21:45:42 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:45:42.740151 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6d43f9-1eec-472a-8fc3-9eede92fc85c None admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:45:42.840518 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6d43f9-1eec-472a-8fc3-9eede92fc85c None admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:45:42.874739 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06325a7d-a2ba-4db1-b254-037ba93d1d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:45:42.875322 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06325a7d-a2ba-4db1-b254-037ba93d1d55 None admin] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:45:42.875597 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06325a7d-a2ba-4db1-b254-037ba93d1d55 None admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:45:42.875861 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06325a7d-a2ba-4db1-b254-037ba93d1d55 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:45:42.876712 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06325a7d-a2ba-4db1-b254-037ba93d1d55 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:45:42.878059 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06325a7d-a2ba-4db1-b254-037ba93d1d55 None admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:45:42.955090 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 652/1306] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 18 21:45:42 2022] POST /identity/v3/endpoints => generated 331 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:45:52.746575 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=30 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:45:52.942614 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:52:00.665784 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26d0787-9603-414e-88ef-627c791f27c1 None None] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:52:00.666346 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26d0787-9603-414e-88ef-627c791f27c1 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:52:00.666346 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26d0787-9603-414e-88ef-627c791f27c1 None None] PATH_INFO: `/` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:52:00.667737 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 655/1307] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:52:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:52:00.673123 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2871114-729c-457a-b272-e6e2d9dec58d None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:52:00.673578 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2871114-729c-457a-b272-e6e2d9dec58d None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:52:00.673666 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2871114-729c-457a-b272-e6e2d9dec58d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:52:00.856217 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-b2871114-729c-457a-b272-e6e2d9dec58d None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:52:00.857488 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-b2871114-729c-457a-b272-e6e2d9dec58d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:52:01.008294 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 653/1308] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:52:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 21:52:01.323410 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a267c88-2ab1-465a-97a0-f79be023bb64 None None] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:52:01.323685 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a267c88-2ab1-465a-97a0-f79be023bb64 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:52:01.323961 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a267c88-2ab1-465a-97a0-f79be023bb64 None None] PATH_INFO: `/` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:52:01.325472 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 656/1309] 10.222.0.27 () {54 vars in 965 bytes} [Thu Aug 18 21:52:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:52:01.334623 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6951646e-675f-45c5-981f-d485dd984888 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:52:01.335179 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6951646e-675f-45c5-981f-d485dd984888 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:52:01.335597 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6951646e-675f-45c5-981f-d485dd984888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:52:01.432553 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-6951646e-675f-45c5-981f-d485dd984888 None None] MFA Rules not processed for user `6a937971ad1a4b0c8697c764f214d446`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:52:01.434143 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-6951646e-675f-45c5-981f-d485dd984888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:52:01.459611 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:52:01.530103 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 654/1310] 10.222.0.27 () {58 vars in 1062 bytes} [Thu Aug 18 21:52:01 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:52:01.540461 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a267c88-2ab1-465a-97a0-f79be023bb64 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:52:01.543097 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-2a267c88-2ab1-465a-97a0-f79be023bb64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:52:01.693607 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a267c88-2ab1-465a-97a0-f79be023bb64 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:52:01.782550 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d04abd2-95c5-4cbc-8088-882f93bf682c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a937971ad1a4b0c8697c764f214d446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:52:01.783161 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d04abd2-95c5-4cbc-8088-882f93bf682c service neutron] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:52:01.783434 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d04abd2-95c5-4cbc-8088-882f93bf682c service neutron] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:52:01.783701 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d04abd2-95c5-4cbc-8088-882f93bf682c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:52:01.785671 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-0d04abd2-95c5-4cbc-8088-882f93bf682c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:52:01.849852 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:52:01.913045 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d04abd2-95c5-4cbc-8088-882f93bf682c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:52:01.914500 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d04abd2-95c5-4cbc-8088-882f93bf682c service neutron] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:52:01.935743 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 657/1311] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 21:52:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:52:04.191183 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d327c818-450b-4aca-b65c-5c0a420fb9e4 None None] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:52:04.191748 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d327c818-450b-4aca-b65c-5c0a420fb9e4 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:52:04.191748 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d327c818-450b-4aca-b65c-5c0a420fb9e4 None None] PATH_INFO: `/` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:52:04.193126 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 655/1312] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:52:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:52:04.198946 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba834aa3-b817-4313-a0aa-deb522d3ca47 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:52:04.199490 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba834aa3-b817-4313-a0aa-deb522d3ca47 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:52:04.199490 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba834aa3-b817-4313-a0aa-deb522d3ca47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:52:04.275363 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-ba834aa3-b817-4313-a0aa-deb522d3ca47 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:52:04.277038 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-ba834aa3-b817-4313-a0aa-deb522d3ca47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:52:04.374351 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 658/1313] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:52:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:52:04.685800 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbea2a96-31e9-4f79-9362-bcd42b31b2ad None None] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:52:04.686095 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbea2a96-31e9-4f79-9362-bcd42b31b2ad None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:52:04.686370 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbea2a96-31e9-4f79-9362-bcd42b31b2ad None None] PATH_INFO: `/` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:52:04.687716 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 656/1314] 10.222.0.27 () {54 vars in 965 bytes} [Thu Aug 18 21:52:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:52:04.693381 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afef45fd-deea-43fe-baad-1c4e57c9f267 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:52:04.693670 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afef45fd-deea-43fe-baad-1c4e57c9f267 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:52:04.693948 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afef45fd-deea-43fe-baad-1c4e57c9f267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:52:04.706132 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:52:04.770117 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-afef45fd-deea-43fe-baad-1c4e57c9f267 None None] MFA Rules not processed for user `6a937971ad1a4b0c8697c764f214d446`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:52:04.771248 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-afef45fd-deea-43fe-baad-1c4e57c9f267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:52:04.844697 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 659/1315] 10.222.0.27 () {58 vars in 1062 bytes} [Thu Aug 18 21:52:04 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:52:04.853704 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbea2a96-31e9-4f79-9362-bcd42b31b2ad None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:52:04.855918 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-bbea2a96-31e9-4f79-9362-bcd42b31b2ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:52:04.958068 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbea2a96-31e9-4f79-9362-bcd42b31b2ad None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:52:05.028463 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:52:05.031018 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bad4b48-165e-4262-8b12-1a0d0c158d95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a937971ad1a4b0c8697c764f214d446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:52:05.031609 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bad4b48-165e-4262-8b12-1a0d0c158d95 service neutron] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:52:05.031881 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bad4b48-165e-4262-8b12-1a0d0c158d95 service neutron] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:52:05.032148 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bad4b48-165e-4262-8b12-1a0d0c158d95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:52:05.033781 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-3bad4b48-165e-4262-8b12-1a0d0c158d95 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:52:05.138551 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bad4b48-165e-4262-8b12-1a0d0c158d95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:52:05.140043 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bad4b48-165e-4262-8b12-1a0d0c158d95 service neutron] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:52:05.158187 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 657/1316] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 21:52:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:52:07.804732 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20ba2a3-5d0f-43bb-85a7-11c4af19bf91 None None] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:52:07.805336 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20ba2a3-5d0f-43bb-85a7-11c4af19bf91 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:52:07.805336 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20ba2a3-5d0f-43bb-85a7-11c4af19bf91 None None] PATH_INFO: `/` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:52:07.806616 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 660/1317] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:52:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:52:07.811908 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2946b8-c565-46a8-828b-9d94899cd172 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:52:07.812315 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2946b8-c565-46a8-828b-9d94899cd172 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:52:07.812428 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2946b8-c565-46a8-828b-9d94899cd172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:52:07.879038 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-8e2946b8-c565-46a8-828b-9d94899cd172 None None] MFA Rules not processed for user `5935b35ad1844f5c827a7303ed74c83d`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:52:07.880234 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-8e2946b8-c565-46a8-828b-9d94899cd172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:52:07.931581 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:52:07.978320 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 658/1318] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:52:07 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:52:08.266973 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20ba2a3-5d0f-43bb-85a7-11c4af19bf91 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:52:08.268520 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-d20ba2a3-5d0f-43bb-85a7-11c4af19bf91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:52:08.372715 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20ba2a3-5d0f-43bb-85a7-11c4af19bf91 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:52:08.375522 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:52:08.444744 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d3e4c3-05cc-435e-afb6-b08114ba560a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a937971ad1a4b0c8697c764f214d446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:52:08.445336 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d3e4c3-05cc-435e-afb6-b08114ba560a service neutron] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:52:08.445616 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d3e4c3-05cc-435e-afb6-b08114ba560a service neutron] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:52:08.445889 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d3e4c3-05cc-435e-afb6-b08114ba560a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:52:08.447480 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-02d3e4c3-05cc-435e-afb6-b08114ba560a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:52:08.555674 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d3e4c3-05cc-435e-afb6-b08114ba560a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:52:08.557072 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d3e4c3-05cc-435e-afb6-b08114ba560a service neutron] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:52:08.575939 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 661/1319] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 21:52:08 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:52:11.275798 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1d742d-b558-40f7-9de8-7576e3d5687c None None] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:52:11.276940 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1d742d-b558-40f7-9de8-7576e3d5687c None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:52:11.277070 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1d742d-b558-40f7-9de8-7576e3d5687c None None] PATH_INFO: `/` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:52:11.278340 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 659/1320] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:52:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:52:11.283423 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8dfbb2-1a51-4654-b0e2-474d7eb1e927 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:52:11.283876 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8dfbb2-1a51-4654-b0e2-474d7eb1e927 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:52:11.283986 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8dfbb2-1a51-4654-b0e2-474d7eb1e927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:52:11.324610 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:52:11.349470 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-3e8dfbb2-1a51-4654-b0e2-474d7eb1e927 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:52:11.350671 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-3e8dfbb2-1a51-4654-b0e2-474d7eb1e927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:52:11.445260 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 662/1321] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:52:11 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:52:11.738324 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1d742d-b558-40f7-9de8-7576e3d5687c None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:52:11.739894 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-7e1d742d-b558-40f7-9de8-7576e3d5687c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:52:11.841784 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1d742d-b558-40f7-9de8-7576e3d5687c None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:52:11.913314 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b99f17-3aaf-4a5c-af98-398b8fc5dd38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a937971ad1a4b0c8697c764f214d446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:52:11.913910 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b99f17-3aaf-4a5c-af98-398b8fc5dd38 service neutron] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:52:11.914186 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b99f17-3aaf-4a5c-af98-398b8fc5dd38 service neutron] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:52:11.914451 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b99f17-3aaf-4a5c-af98-398b8fc5dd38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:52:11.916041 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-f6b99f17-3aaf-4a5c-af98-398b8fc5dd38 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:52:11.923455 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:52:12.022359 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b99f17-3aaf-4a5c-af98-398b8fc5dd38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:52:12.023769 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b99f17-3aaf-4a5c-af98-398b8fc5dd38 service neutron] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:52:12.042573 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 660/1322] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 21:52:11 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:52:15.233696 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a4cfc5-3b5a-4316-a20b-09eb9bad9d16 None None] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:52:15.234341 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a4cfc5-3b5a-4316-a20b-09eb9bad9d16 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:52:15.234341 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a4cfc5-3b5a-4316-a20b-09eb9bad9d16 None None] PATH_INFO: `/` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:52:15.235702 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 663/1323] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:52:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:52:15.240847 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650d0719-1fd7-43d3-a343-fee75632192f None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:52:15.241272 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650d0719-1fd7-43d3-a343-fee75632192f None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:52:15.241411 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650d0719-1fd7-43d3-a343-fee75632192f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:52:15.310796 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-650d0719-1fd7-43d3-a343-fee75632192f None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:52:15.312023 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-650d0719-1fd7-43d3-a343-fee75632192f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:52:15.370678 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:52:15.409907 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 661/1324] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:52:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:52:15.691478 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a4cfc5-3b5a-4316-a20b-09eb9bad9d16 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:52:15.693071 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-87a4cfc5-3b5a-4316-a20b-09eb9bad9d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:52:15.797448 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a4cfc5-3b5a-4316-a20b-09eb9bad9d16 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:52:15.810384 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:52:15.872710 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d905a6-6629-4e7e-8f21-77b0840b2e8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a937971ad1a4b0c8697c764f214d446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:52:15.873310 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d905a6-6629-4e7e-8f21-77b0840b2e8b service neutron] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:52:15.873587 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d905a6-6629-4e7e-8f21-77b0840b2e8b service neutron] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:52:15.873859 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d905a6-6629-4e7e-8f21-77b0840b2e8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:52:15.875455 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-96d905a6-6629-4e7e-8f21-77b0840b2e8b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:52:15.990366 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d905a6-6629-4e7e-8f21-77b0840b2e8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:52:15.990366 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d905a6-6629-4e7e-8f21-77b0840b2e8b service neutron] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:52:16.007570 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 664/1325] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 21:52:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:52:17.985308 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e44fc5e-90de-476a-b7af-12f7f3db874c None None] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:52:17.985841 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e44fc5e-90de-476a-b7af-12f7f3db874c None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:52:17.985841 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e44fc5e-90de-476a-b7af-12f7f3db874c None None] PATH_INFO: `/` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:52:17.987240 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 662/1326] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:52:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:52:17.992577 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c28eed-be44-470b-8a6a-184c900f7761 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:52:17.993008 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c28eed-be44-470b-8a6a-184c900f7761 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:52:17.993120 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c28eed-be44-470b-8a6a-184c900f7761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:52:18.041194 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:52:18.059615 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-a2c28eed-be44-470b-8a6a-184c900f7761 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:52:18.060861 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-a2c28eed-be44-470b-8a6a-184c900f7761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:52:18.160355 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 665/1327] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:52:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:52:18.442968 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e44fc5e-90de-476a-b7af-12f7f3db874c None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:52:18.444505 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-7e44fc5e-90de-476a-b7af-12f7f3db874c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:52:18.550301 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e44fc5e-90de-476a-b7af-12f7f3db874c None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:52:18.634929 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717cf986-9605-4aab-9bd4-226ab1106e06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a937971ad1a4b0c8697c764f214d446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:52:18.636172 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717cf986-9605-4aab-9bd4-226ab1106e06 service neutron] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:52:18.636494 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717cf986-9605-4aab-9bd4-226ab1106e06 service neutron] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:52:18.636869 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717cf986-9605-4aab-9bd4-226ab1106e06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:52:18.638862 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-717cf986-9605-4aab-9bd4-226ab1106e06 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:52:18.657503 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:52:18.750470 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717cf986-9605-4aab-9bd4-226ab1106e06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:52:18.751904 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717cf986-9605-4aab-9bd4-226ab1106e06 service neutron] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:52:18.770447 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 663/1328] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 21:52:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:52:20.736171 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeb1944-f3f2-4d73-8a8a-804e5666c6f6 None None] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:52:20.736759 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeb1944-f3f2-4d73-8a8a-804e5666c6f6 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:52:20.736759 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeb1944-f3f2-4d73-8a8a-804e5666c6f6 None None] PATH_INFO: `/` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:52:20.738107 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 666/1329] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:52:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:52:20.743618 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951a436d-d115-4164-b678-495b9d2f3733 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:52:20.744106 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951a436d-d115-4164-b678-495b9d2f3733 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:52:20.744198 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951a436d-d115-4164-b678-495b9d2f3733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:52:20.812866 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-951a436d-d115-4164-b678-495b9d2f3733 None None] MFA Rules not processed for user `5935b35ad1844f5c827a7303ed74c83d`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:52:20.814077 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-951a436d-d115-4164-b678-495b9d2f3733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:52:20.882366 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:52:20.915564 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 664/1330] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:52:20 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:52:21.204954 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeb1944-f3f2-4d73-8a8a-804e5666c6f6 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:52:21.206740 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-deeb1944-f3f2-4d73-8a8a-804e5666c6f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:52:21.341214 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeb1944-f3f2-4d73-8a8a-804e5666c6f6 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:52:21.362626 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:52:21.416002 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb2280c-6f2a-45de-b0fc-bbb32207bce5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a937971ad1a4b0c8697c764f214d446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:52:21.417217 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb2280c-6f2a-45de-b0fc-bbb32207bce5 service neutron] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:52:21.417551 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb2280c-6f2a-45de-b0fc-bbb32207bce5 service neutron] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:52:21.417818 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb2280c-6f2a-45de-b0fc-bbb32207bce5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:52:21.419419 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-dcb2280c-6f2a-45de-b0fc-bbb32207bce5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:52:21.529159 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb2280c-6f2a-45de-b0fc-bbb32207bce5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:52:21.530535 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb2280c-6f2a-45de-b0fc-bbb32207bce5 service neutron] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:52:21.549009 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 667/1331] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 21:52:21 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:52:23.867028 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d71ca7-8793-454a-aeab-e83c11d537ac None None] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:52:23.867602 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d71ca7-8793-454a-aeab-e83c11d537ac None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:52:23.867602 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d71ca7-8793-454a-aeab-e83c11d537ac None None] PATH_INFO: `/` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:52:23.868985 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 665/1332] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:52:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:52:23.874811 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588cda92-8ffc-4ba0-9367-387a49054a3d None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:52:23.875219 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588cda92-8ffc-4ba0-9367-387a49054a3d None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:52:23.875369 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588cda92-8ffc-4ba0-9367-387a49054a3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:52:23.938275 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:52:23.940903 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-588cda92-8ffc-4ba0-9367-387a49054a3d None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:52:23.942149 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-588cda92-8ffc-4ba0-9367-387a49054a3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:52:24.037435 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 668/1333] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:52:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:52:24.319184 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d71ca7-8793-454a-aeab-e83c11d537ac None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:52:24.320774 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-40d71ca7-8793-454a-aeab-e83c11d537ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:52:24.423704 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d71ca7-8793-454a-aeab-e83c11d537ac None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:52:24.496846 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1e4360-2bfa-4e1c-9ce6-d915a0e3f2e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a937971ad1a4b0c8697c764f214d446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:52:24.497454 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1e4360-2bfa-4e1c-9ce6-d915a0e3f2e5 service neutron] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:52:24.497733 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1e4360-2bfa-4e1c-9ce6-d915a0e3f2e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:52:24.498007 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1e4360-2bfa-4e1c-9ce6-d915a0e3f2e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:52:24.499623 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-1e1e4360-2bfa-4e1c-9ce6-d915a0e3f2e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:52:24.529020 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:52:24.622759 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1e4360-2bfa-4e1c-9ce6-d915a0e3f2e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:52:24.624306 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1e4360-2bfa-4e1c-9ce6-d915a0e3f2e5 service neutron] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:52:24.644638 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 666/1334] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 21:52:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:52:26.593610 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6899bbd8-67c3-4423-a7c7-2b0444914263 None None] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:52:26.594134 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6899bbd8-67c3-4423-a7c7-2b0444914263 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:52:26.594244 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6899bbd8-67c3-4423-a7c7-2b0444914263 None None] PATH_INFO: `/` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:52:26.595556 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 669/1335] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:52:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:52:26.600831 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f50caa5-0951-4408-89af-acf4d6a9703a None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:52:26.601236 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f50caa5-0951-4408-89af-acf4d6a9703a None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:52:26.601383 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f50caa5-0951-4408-89af-acf4d6a9703a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:52:26.682169 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-9f50caa5-0951-4408-89af-acf4d6a9703a None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:52:26.683715 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-9f50caa5-0951-4408-89af-acf4d6a9703a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:52:26.758129 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:52:26.782082 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 667/1336] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:52:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:52:27.076381 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6899bbd8-67c3-4423-a7c7-2b0444914263 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:52:27.077986 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-6899bbd8-67c3-4423-a7c7-2b0444914263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:52:27.180155 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6899bbd8-67c3-4423-a7c7-2b0444914263 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:52:27.208026 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:52:27.252527 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c480d8-bbb2-4616-a4e0-159675310c28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a937971ad1a4b0c8697c764f214d446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:52:27.253154 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c480d8-bbb2-4616-a4e0-159675310c28 service neutron] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:52:27.253432 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c480d8-bbb2-4616-a4e0-159675310c28 service neutron] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:52:27.253703 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c480d8-bbb2-4616-a4e0-159675310c28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:52:27.255296 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-79c480d8-bbb2-4616-a4e0-159675310c28 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:52:27.361817 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c480d8-bbb2-4616-a4e0-159675310c28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:52:27.363261 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c480d8-bbb2-4616-a4e0-159675310c28 service neutron] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:52:27.380945 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 670/1337] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 21:52:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:52:29.950529 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dde7403-16ac-4049-b858-4c7fba2430f6 None None] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:52:29.951121 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dde7403-16ac-4049-b858-4c7fba2430f6 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:52:29.951121 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dde7403-16ac-4049-b858-4c7fba2430f6 None None] PATH_INFO: `/` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:52:29.952434 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 668/1338] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:52:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:52:29.957602 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45b004f-b0a1-41a8-85d5-8b73d74aadd9 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:52:29.958031 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45b004f-b0a1-41a8-85d5-8b73d74aadd9 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:52:29.958178 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45b004f-b0a1-41a8-85d5-8b73d74aadd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:52:30.024187 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-f45b004f-b0a1-41a8-85d5-8b73d74aadd9 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:52:30.025421 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-f45b004f-b0a1-41a8-85d5-8b73d74aadd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:52:30.034201 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:52:30.121137 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 671/1339] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:52:29 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:52:30.403688 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dde7403-16ac-4049-b858-4c7fba2430f6 None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:52:30.405275 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-1dde7403-16ac-4049-b858-4c7fba2430f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:52:30.509743 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dde7403-16ac-4049-b858-4c7fba2430f6 None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:52:30.585383 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88109abd-4d65-4b83-8bfe-bd211e7d0e85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a937971ad1a4b0c8697c764f214d446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:52:30.585988 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88109abd-4d65-4b83-8bfe-bd211e7d0e85 service neutron] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:52:30.586265 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88109abd-4d65-4b83-8bfe-bd211e7d0e85 service neutron] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:52:30.586535 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88109abd-4d65-4b83-8bfe-bd211e7d0e85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:52:30.588148 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-88109abd-4d65-4b83-8bfe-bd211e7d0e85 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:52:30.623921 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:52:30.708877 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88109abd-4d65-4b83-8bfe-bd211e7d0e85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:52:30.710230 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88109abd-4d65-4b83-8bfe-bd211e7d0e85 service neutron] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:52:30.728719 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 669/1340] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 21:52:30 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:52:35.005334 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07dfef8-24ca-4514-9264-a2394ef173d2 None None] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:52:35.005865 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07dfef8-24ca-4514-9264-a2394ef173d2 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:52:35.005865 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07dfef8-24ca-4514-9264-a2394ef173d2 None None] PATH_INFO: `/` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:52:35.007208 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 672/1341] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:52:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:52:35.013544 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e781c2d7-0066-412a-b6f5-7d7e93b813b9 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:52:35.014000 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e781c2d7-0066-412a-b6f5-7d7e93b813b9 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:52:35.014094 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e781c2d7-0066-412a-b6f5-7d7e93b813b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:52:35.081778 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-e781c2d7-0066-412a-b6f5-7d7e93b813b9 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:52:35.083012 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-e781c2d7-0066-412a-b6f5-7d7e93b813b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:52:35.171982 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:52:35.183867 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 670/1342] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:52:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 21:52:35.465913 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07dfef8-24ca-4514-9264-a2394ef173d2 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:52:35.467452 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-c07dfef8-24ca-4514-9264-a2394ef173d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:52:35.572942 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07dfef8-24ca-4514-9264-a2394ef173d2 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:52:35.610196 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:52:35.647861 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45438659-1da3-4f76-8847-5dc1c796681c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a937971ad1a4b0c8697c764f214d446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:52:35.648527 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45438659-1da3-4f76-8847-5dc1c796681c service neutron] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:52:35.648843 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45438659-1da3-4f76-8847-5dc1c796681c service neutron] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:52:35.649121 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45438659-1da3-4f76-8847-5dc1c796681c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:52:35.650754 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-45438659-1da3-4f76-8847-5dc1c796681c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:52:35.760265 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45438659-1da3-4f76-8847-5dc1c796681c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:52:35.761661 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45438659-1da3-4f76-8847-5dc1c796681c service neutron] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:52:35.780384 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 673/1343] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 21:52:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:52:38.594255 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9fb81b-da46-4e4c-ba80-f5692162ad5b None None] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:52:38.594769 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9fb81b-da46-4e4c-ba80-f5692162ad5b None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:52:38.594769 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9fb81b-da46-4e4c-ba80-f5692162ad5b None None] PATH_INFO: `/` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:52:38.596158 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 671/1344] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:52:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:52:38.601599 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10f911f-ff73-4b50-9fc1-dcb8c4960e6c None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:52:38.602091 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10f911f-ff73-4b50-9fc1-dcb8c4960e6c None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:52:38.602285 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10f911f-ff73-4b50-9fc1-dcb8c4960e6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:52:38.672005 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-a10f911f-ff73-4b50-9fc1-dcb8c4960e6c None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:52:38.673261 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-a10f911f-ff73-4b50-9fc1-dcb8c4960e6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:52:38.692162 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:52:38.776368 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 674/1345] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:52:38 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:52:39.056908 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9fb81b-da46-4e4c-ba80-f5692162ad5b None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:52:39.059019 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-df9fb81b-da46-4e4c-ba80-f5692162ad5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:52:39.169983 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9fb81b-da46-4e4c-ba80-f5692162ad5b None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:52:39.245647 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb4821f-102b-4fbf-8586-37d19c2e61c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a937971ad1a4b0c8697c764f214d446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:52:39.246249 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb4821f-102b-4fbf-8586-37d19c2e61c3 service neutron] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:52:39.246526 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb4821f-102b-4fbf-8586-37d19c2e61c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:52:39.246794 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb4821f-102b-4fbf-8586-37d19c2e61c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:52:39.248408 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-9cb4821f-102b-4fbf-8586-37d19c2e61c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:52:39.293103 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:52:39.363123 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb4821f-102b-4fbf-8586-37d19c2e61c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:52:39.364577 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb4821f-102b-4fbf-8586-37d19c2e61c3 service neutron] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:52:39.384275 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 672/1346] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 21:52:39 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:52:43.698340 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb888d34-ffc6-44e3-9742-60cb769059dd None None] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:52:43.698804 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb888d34-ffc6-44e3-9742-60cb769059dd None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:52:43.698895 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb888d34-ffc6-44e3-9742-60cb769059dd None None] PATH_INFO: `/` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:52:43.700556 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 675/1347] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:52:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:52:43.705955 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e79d0-03c0-4d20-9720-09612edd75fc None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:52:43.706494 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e79d0-03c0-4d20-9720-09612edd75fc None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:52:43.706494 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e79d0-03c0-4d20-9720-09612edd75fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:52:43.776220 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-777e79d0-03c0-4d20-9720-09612edd75fc None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:52:43.777469 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-777e79d0-03c0-4d20-9720-09612edd75fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:52:43.877710 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:52:43.880459 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 673/1348] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:52:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:52:44.166394 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb888d34-ffc6-44e3-9742-60cb769059dd None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:52:44.168167 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-fb888d34-ffc6-44e3-9742-60cb769059dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:52:44.274716 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb888d34-ffc6-44e3-9742-60cb769059dd None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:52:44.321501 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:52:44.347813 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b4e5a1-97a1-4384-a72a-55986588d54b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a937971ad1a4b0c8697c764f214d446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:52:44.348407 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b4e5a1-97a1-4384-a72a-55986588d54b service neutron] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:52:44.348715 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b4e5a1-97a1-4384-a72a-55986588d54b service neutron] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:52:44.348986 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b4e5a1-97a1-4384-a72a-55986588d54b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:52:44.350579 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-e0b4e5a1-97a1-4384-a72a-55986588d54b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:52:44.458517 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b4e5a1-97a1-4384-a72a-55986588d54b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:52:44.459961 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b4e5a1-97a1-4384-a72a-55986588d54b service neutron] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:52:44.479538 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 676/1349] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 21:52:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:52:49.478751 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b48b53-132c-4c8c-a75b-58f57d12036d None None] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:52:49.479861 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b48b53-132c-4c8c-a75b-58f57d12036d None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:52:49.479861 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b48b53-132c-4c8c-a75b-58f57d12036d None None] PATH_INFO: `/` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:52:49.481490 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 674/1350] 10.222.0.27 () {54 vars in 921 bytes} [Thu Aug 18 21:52:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:52:49.486983 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5fa770-1a1f-4c2a-ab64-ed6678424a42 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:52:49.487391 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5fa770-1a1f-4c2a-ab64-ed6678424a42 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:52:49.487567 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5fa770-1a1f-4c2a-ab64-ed6678424a42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:52:49.645524 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-4d5fa770-1a1f-4c2a-ab64-ed6678424a42 None None] MFA Rules not processed for user `b44c0cf2d8b34f3e81c59d19eedbdfcc`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:52:49.647088 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-4d5fa770-1a1f-4c2a-ab64-ed6678424a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:52:49.669888 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:52:49.778357 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 677/1351] 10.222.0.27 () {58 vars in 1018 bytes} [Thu Aug 18 21:52:49 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:52:54.042787 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c98e3f-3081-4034-a541-0c7df3313401 None None] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:52:54.043372 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c98e3f-3081-4034-a541-0c7df3313401 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:52:54.043372 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c98e3f-3081-4034-a541-0c7df3313401 None None] PATH_INFO: `/` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:52:54.045361 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 675/1352] 10.222.0.27 () {54 vars in 921 bytes} [Thu Aug 18 21:52:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:52:54.050859 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b591a956-189d-4199-a3de-eeaaf58126c6 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:52:54.051712 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b591a956-189d-4199-a3de-eeaaf58126c6 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:52:54.052207 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b591a956-189d-4199-a3de-eeaaf58126c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:52:54.137196 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-b591a956-189d-4199-a3de-eeaaf58126c6 None None] MFA Rules not processed for user `b44c0cf2d8b34f3e81c59d19eedbdfcc`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:52:54.139476 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-b591a956-189d-4199-a3de-eeaaf58126c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:52:54.225377 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:52:54.277440 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 678/1353] 10.222.0.27 () {58 vars in 1018 bytes} [Thu Aug 18 21:52:54 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:52:55.473336 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5965c2e-4ad3-4d97-b3be-0a9d12ed9bc8 None None] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:52:55.474309 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5965c2e-4ad3-4d97-b3be-0a9d12ed9bc8 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:52:55.474586 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5965c2e-4ad3-4d97-b3be-0a9d12ed9bc8 None None] PATH_INFO: `/` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:52:55.475949 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 676/1354] 10.222.0.27 () {54 vars in 921 bytes} [Thu Aug 18 21:52:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:52:55.482118 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf0146-a144-4bec-9bbc-94b5b4219670 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:52:55.482586 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf0146-a144-4bec-9bbc-94b5b4219670 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:52:55.482680 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf0146-a144-4bec-9bbc-94b5b4219670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:52:55.560927 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-ffdf0146-a144-4bec-9bbc-94b5b4219670 None None] MFA Rules not processed for user `b44c0cf2d8b34f3e81c59d19eedbdfcc`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:52:55.562047 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-ffdf0146-a144-4bec-9bbc-94b5b4219670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:52:55.669608 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 679/1355] 10.222.0.27 () {58 vars in 1018 bytes} [Thu Aug 18 21:52:55 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:52:59.145692 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892a0015-4fba-453e-ba3f-1d0bc5f6ee05 None None] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:52:59.146249 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892a0015-4fba-453e-ba3f-1d0bc5f6ee05 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:52:59.146249 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892a0015-4fba-453e-ba3f-1d0bc5f6ee05 None None] PATH_INFO: `/` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:52:59.147582 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 677/1356] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:52:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:52:59.152971 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a2695e-1226-4b66-ad63-8f16540e5d6a None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:52:59.153419 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a2695e-1226-4b66-ad63-8f16540e5d6a None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:52:59.153650 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a2695e-1226-4b66-ad63-8f16540e5d6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:52:59.193838 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:52:59.240829 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-b9a2695e-1226-4b66-ad63-8f16540e5d6a None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:52:59.242066 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-b9a2695e-1226-4b66-ad63-8f16540e5d6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:52:59.385606 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 680/1357] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:52:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 21:52:59.688737 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e5a2b1-b317-4a40-84d1-8e6f0b1090b0 None None] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:52:59.689300 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e5a2b1-b317-4a40-84d1-8e6f0b1090b0 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:52:59.689572 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e5a2b1-b317-4a40-84d1-8e6f0b1090b0 None None] PATH_INFO: `/` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:52:59.690900 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 678/1358] 10.222.0.27 () {54 vars in 962 bytes} [Thu Aug 18 21:52:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:52:59.698564 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f275c85-e68f-42a0-a5d9-99a4ecc1cb93 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:52:59.698855 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f275c85-e68f-42a0-a5d9-99a4ecc1cb93 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:52:59.699132 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f275c85-e68f-42a0-a5d9-99a4ecc1cb93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:52:59.787643 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-5f275c85-e68f-42a0-a5d9-99a4ecc1cb93 None None] MFA Rules not processed for user `a39cd50340184779ac589bbcb7cac9aa`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:52:59.788924 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-5f275c85-e68f-42a0-a5d9-99a4ecc1cb93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:52:59.842783 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:52:59.924992 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 681/1359] 10.222.0.27 () {58 vars in 1059 bytes} [Thu Aug 18 21:52:59 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:52:59.929463 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e5a2b1-b317-4a40-84d1-8e6f0b1090b0 None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:52:59.931101 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-54e5a2b1-b317-4a40-84d1-8e6f0b1090b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:53:00.092694 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e5a2b1-b317-4a40-84d1-8e6f0b1090b0 None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:53:00.169937 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:53:00.216075 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e33e939-0672-4bbe-aa8b-d2fb8ea656c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a39cd50340184779ac589bbcb7cac9aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:53:00.216817 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e33e939-0672-4bbe-aa8b-d2fb8ea656c9 service nova] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:53:00.217188 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e33e939-0672-4bbe-aa8b-d2fb8ea656c9 service nova] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:53:00.217557 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e33e939-0672-4bbe-aa8b-d2fb8ea656c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:53:00.219302 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-4e33e939-0672-4bbe-aa8b-d2fb8ea656c9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:53:00.313440 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e33e939-0672-4bbe-aa8b-d2fb8ea656c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:53:00.315148 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e33e939-0672-4bbe-aa8b-d2fb8ea656c9 service nova] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:53:00.333922 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 679/1360] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 21:52:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:53:02.464938 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f42dc81-677f-41be-aa02-fc497612bd63 None None] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:53:02.465480 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f42dc81-677f-41be-aa02-fc497612bd63 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:53:02.465480 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f42dc81-677f-41be-aa02-fc497612bd63 None None] PATH_INFO: `/` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:53:02.466955 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 682/1361] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:53:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:53:02.472004 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a348cc-ec67-4099-9c6a-3f184e391906 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:53:02.472419 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a348cc-ec67-4099-9c6a-3f184e391906 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:53:02.473608 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a348cc-ec67-4099-9c6a-3f184e391906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:53:02.542427 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-f8a348cc-ec67-4099-9c6a-3f184e391906 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:53:02.543632 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-f8a348cc-ec67-4099-9c6a-3f184e391906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:53:02.582702 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:53:02.643671 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 680/1362] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:53:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:53:02.932086 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f42dc81-677f-41be-aa02-fc497612bd63 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:53:02.933996 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-5f42dc81-677f-41be-aa02-fc497612bd63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:53:03.106230 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f42dc81-677f-41be-aa02-fc497612bd63 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:53:03.116711 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:53:03.232047 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f6a890-44ff-4129-8d50-3c2b0acaea0a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a39cd50340184779ac589bbcb7cac9aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:53:03.232690 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f6a890-44ff-4129-8d50-3c2b0acaea0a service nova] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:53:03.232975 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f6a890-44ff-4129-8d50-3c2b0acaea0a service nova] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:53:03.233253 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f6a890-44ff-4129-8d50-3c2b0acaea0a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:53:03.235003 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-33f6a890-44ff-4129-8d50-3c2b0acaea0a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:53:03.332458 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f6a890-44ff-4129-8d50-3c2b0acaea0a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:53:03.334128 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f6a890-44ff-4129-8d50-3c2b0acaea0a service nova] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:53:03.353648 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 683/1363] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 21:53:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:53:05.705415 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2102498c-b1ea-4e77-9dbf-fb9eff9fc678 None None] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:53:05.705969 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2102498c-b1ea-4e77-9dbf-fb9eff9fc678 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:53:05.705969 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2102498c-b1ea-4e77-9dbf-fb9eff9fc678 None None] PATH_INFO: `/` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:53:05.707596 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 681/1364] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:53:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:53:05.712900 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c3327d-7389-411c-a289-90fc8c64a7a5 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:53:05.713941 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c3327d-7389-411c-a289-90fc8c64a7a5 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:53:05.714251 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c3327d-7389-411c-a289-90fc8c64a7a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:53:05.733010 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:53:05.795622 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-30c3327d-7389-411c-a289-90fc8c64a7a5 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:53:05.797251 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-30c3327d-7389-411c-a289-90fc8c64a7a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:53:05.912985 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 684/1365] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:53:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:53:06.206489 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eeae42-bc58-4d62-92f7-5abb3770d061 None None] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:53:06.206840 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eeae42-bc58-4d62-92f7-5abb3770d061 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:53:06.207192 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eeae42-bc58-4d62-92f7-5abb3770d061 None None] PATH_INFO: `/` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:53:06.208636 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 682/1366] 10.222.0.27 () {54 vars in 962 bytes} [Thu Aug 18 21:53:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:53:06.214772 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11386b71-f006-4962-9f11-38ea0eb3425b None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:53:06.215076 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11386b71-f006-4962-9f11-38ea0eb3425b None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:53:06.215333 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11386b71-f006-4962-9f11-38ea0eb3425b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:53:06.315835 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-11386b71-f006-4962-9f11-38ea0eb3425b None None] MFA Rules not processed for user `a39cd50340184779ac589bbcb7cac9aa`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:53:06.317104 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-11386b71-f006-4962-9f11-38ea0eb3425b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:53:06.357795 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:53:06.444717 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 685/1367] 10.222.0.27 () {58 vars in 1059 bytes} [Thu Aug 18 21:53:06 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 21:53:06.452955 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eeae42-bc58-4d62-92f7-5abb3770d061 None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:53:06.454650 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-88eeae42-bc58-4d62-92f7-5abb3770d061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:53:06.620559 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eeae42-bc58-4d62-92f7-5abb3770d061 None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:53:06.642511 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:53:06.748196 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aa2d86-b49b-4196-8592-971b8571a7fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a39cd50340184779ac589bbcb7cac9aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:53:06.748882 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aa2d86-b49b-4196-8592-971b8571a7fd service nova] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:53:06.749154 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aa2d86-b49b-4196-8592-971b8571a7fd service nova] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:53:06.749353 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aa2d86-b49b-4196-8592-971b8571a7fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:53:06.750958 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-a3aa2d86-b49b-4196-8592-971b8571a7fd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:53:06.845627 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3aa2d86-b49b-4196-8592-971b8571a7fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:53:06.847388 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3aa2d86-b49b-4196-8592-971b8571a7fd service nova] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:53:06.866876 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 683/1368] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 21:53:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:53:07.565910 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1f14b9-bd5d-441d-9bda-d363dee46551 None None] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:53:07.566453 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1f14b9-bd5d-441d-9bda-d363dee46551 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:53:07.566453 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1f14b9-bd5d-441d-9bda-d363dee46551 None None] PATH_INFO: `/` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:53:07.567869 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 686/1369] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:53:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:53:07.572997 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebe9c30-83dd-41f0-b9e5-366d20699dd0 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:53:07.573584 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebe9c30-83dd-41f0-b9e5-366d20699dd0 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:53:07.573703 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebe9c30-83dd-41f0-b9e5-366d20699dd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:53:07.608915 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:53:07.645010 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-cebe9c30-83dd-41f0-b9e5-366d20699dd0 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:53:07.646234 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-cebe9c30-83dd-41f0-b9e5-366d20699dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:53:07.750086 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 684/1370] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:53:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:53:08.340236 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed89661-1be3-4d54-9f4c-3db6e21f3887 None None] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:53:08.340236 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed89661-1be3-4d54-9f4c-3db6e21f3887 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:53:08.340236 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed89661-1be3-4d54-9f4c-3db6e21f3887 None None] PATH_INFO: `/` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:53:08.344634 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 687/1371] 10.222.0.27 () {54 vars in 964 bytes} [Thu Aug 18 21:53:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:53:08.346746 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fd3b34-f54e-4b8e-8fec-c616b0afe4e8 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:53:08.347035 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fd3b34-f54e-4b8e-8fec-c616b0afe4e8 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:53:08.347312 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fd3b34-f54e-4b8e-8fec-c616b0afe4e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:53:08.428245 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-14fd3b34-f54e-4b8e-8fec-c616b0afe4e8 None None] MFA Rules not processed for user `22b6a7c36f8a4795a75271b8079821c7`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:53:08.429492 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-14fd3b34-f54e-4b8e-8fec-c616b0afe4e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:53:08.479627 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:53:08.512125 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 685/1372] 10.222.0.27 () {58 vars in 1061 bytes} [Thu Aug 18 21:53:08 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:53:08.520711 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed89661-1be3-4d54-9f4c-3db6e21f3887 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:53:08.522399 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-2ed89661-1be3-4d54-9f4c-3db6e21f3887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:53:08.640212 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed89661-1be3-4d54-9f4c-3db6e21f3887 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:53:08.686124 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:53:08.719843 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ff63ea-ca19-41a7-ab08-3e10713462a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22b6a7c36f8a4795a75271b8079821c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:53:08.720448 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ff63ea-ca19-41a7-ab08-3e10713462a6 service cinder] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:53:08.720753 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ff63ea-ca19-41a7-ab08-3e10713462a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:53:08.721031 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ff63ea-ca19-41a7-ab08-3e10713462a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:53:08.722641 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-43ff63ea-ca19-41a7-ab08-3e10713462a6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:53:08.855449 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ff63ea-ca19-41a7-ab08-3e10713462a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:53:08.856923 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ff63ea-ca19-41a7-ab08-3e10713462a6 service cinder] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:53:08.879377 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 688/1373] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 21:53:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:53:09.062887 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b9f449-3b80-4bff-8753-116d31f7457b None None] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:53:09.063376 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b9f449-3b80-4bff-8753-116d31f7457b None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:53:09.064169 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b9f449-3b80-4bff-8753-116d31f7457b None None] PATH_INFO: `/` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:53:09.065766 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 686/1374] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:53:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:53:09.071230 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0d8fda-0daf-4ad5-bb26-221d962e0346 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:53:09.071528 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0d8fda-0daf-4ad5-bb26-221d962e0346 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:53:09.071959 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0d8fda-0daf-4ad5-bb26-221d962e0346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:53:09.147119 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-2e0d8fda-0daf-4ad5-bb26-221d962e0346 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:53:09.148260 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-2e0d8fda-0daf-4ad5-bb26-221d962e0346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:53:09.169097 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:53:09.249119 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 689/1375] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:53:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:53:09.544096 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b9f449-3b80-4bff-8753-116d31f7457b None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:53:09.545697 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-c7b9f449-3b80-4bff-8753-116d31f7457b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:53:09.699102 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b9f449-3b80-4bff-8753-116d31f7457b None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:53:09.760881 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:53:09.822378 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69947bfc-7ee1-4e66-ac0f-bb24bd1860b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a39cd50340184779ac589bbcb7cac9aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:53:09.822949 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69947bfc-7ee1-4e66-ac0f-bb24bd1860b8 service nova] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:53:09.823225 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69947bfc-7ee1-4e66-ac0f-bb24bd1860b8 service nova] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:53:09.823482 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69947bfc-7ee1-4e66-ac0f-bb24bd1860b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:53:09.825115 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-69947bfc-7ee1-4e66-ac0f-bb24bd1860b8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:53:09.928933 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69947bfc-7ee1-4e66-ac0f-bb24bd1860b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:53:09.930549 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69947bfc-7ee1-4e66-ac0f-bb24bd1860b8 service nova] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:53:09.950585 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 687/1376] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 21:53:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:53:12.042744 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb8c32d-b033-44d6-9130-c4d0a4793323 None None] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:53:12.043147 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb8c32d-b033-44d6-9130-c4d0a4793323 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:53:12.043293 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb8c32d-b033-44d6-9130-c4d0a4793323 None None] PATH_INFO: `/` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:53:12.044688 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 690/1377] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:53:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:53:12.049819 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b419ea62-7e7b-4401-8849-e9a38a92a1cc None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:53:12.050225 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b419ea62-7e7b-4401-8849-e9a38a92a1cc None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:53:12.050379 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b419ea62-7e7b-4401-8849-e9a38a92a1cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:53:12.123016 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-b419ea62-7e7b-4401-8849-e9a38a92a1cc None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:53:12.124237 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-b419ea62-7e7b-4401-8849-e9a38a92a1cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:53:12.143009 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:53:12.270359 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 688/1378] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:53:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:53:12.570443 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb8c32d-b033-44d6-9130-c4d0a4793323 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:53:12.572001 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-6fb8c32d-b033-44d6-9130-c4d0a4793323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:53:12.758025 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb8c32d-b033-44d6-9130-c4d0a4793323 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:53:12.763113 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:53:12.882879 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961237a9-dd3a-4467-bfe9-0e4e60de27d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a39cd50340184779ac589bbcb7cac9aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:53:12.883482 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961237a9-dd3a-4467-bfe9-0e4e60de27d4 service nova] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:53:12.883834 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961237a9-dd3a-4467-bfe9-0e4e60de27d4 service nova] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:53:12.884232 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961237a9-dd3a-4467-bfe9-0e4e60de27d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:53:12.886092 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-961237a9-dd3a-4467-bfe9-0e4e60de27d4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:53:13.014650 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961237a9-dd3a-4467-bfe9-0e4e60de27d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:53:13.016008 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961237a9-dd3a-4467-bfe9-0e4e60de27d4 service nova] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:53:13.058717 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 691/1379] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 21:53:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:53:15.225781 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6443ee58-5a9a-49c4-a168-31190078419b None None] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:53:15.226313 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6443ee58-5a9a-49c4-a168-31190078419b None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:53:15.226313 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6443ee58-5a9a-49c4-a168-31190078419b None None] PATH_INFO: `/` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:53:15.227739 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 689/1380] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:53:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 21:53:15.233208 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86336e9-0521-492c-8711-05466dc0e1aa None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:53:15.233638 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86336e9-0521-492c-8711-05466dc0e1aa None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:53:15.233774 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86336e9-0521-492c-8711-05466dc0e1aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:53:15.245622 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:53:15.311104 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-a86336e9-0521-492c-8711-05466dc0e1aa None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:53:15.312320 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-a86336e9-0521-492c-8711-05466dc0e1aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:53:15.417412 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 692/1381] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:53:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:53:15.719700 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6443ee58-5a9a-49c4-a168-31190078419b None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:53:15.721245 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-6443ee58-5a9a-49c4-a168-31190078419b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:53:15.869292 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:53:15.880410 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6443ee58-5a9a-49c4-a168-31190078419b None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:53:16.005904 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6639d0-bbc6-4d54-b61d-005ea48e746c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a39cd50340184779ac589bbcb7cac9aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:53:16.006432 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6639d0-bbc6-4d54-b61d-005ea48e746c service nova] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:53:16.006720 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6639d0-bbc6-4d54-b61d-005ea48e746c service nova] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:53:16.006977 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6639d0-bbc6-4d54-b61d-005ea48e746c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:53:16.008576 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-7e6639d0-bbc6-4d54-b61d-005ea48e746c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:53:16.106183 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6639d0-bbc6-4d54-b61d-005ea48e746c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:53:16.107801 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6639d0-bbc6-4d54-b61d-005ea48e746c service nova] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:53:16.118503 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:53:16.128173 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 690/1382] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 21:53:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:53:18.212286 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b715c78-0224-4598-9d65-ddab82377d5f None None] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:53:18.212907 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b715c78-0224-4598-9d65-ddab82377d5f None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:53:18.212907 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b715c78-0224-4598-9d65-ddab82377d5f None None] PATH_INFO: `/` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:53:18.214399 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 693/1383] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:53:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:53:18.220078 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b36a669-1cce-40ea-ac02-2aa4bc5c9129 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:53:18.220554 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b36a669-1cce-40ea-ac02-2aa4bc5c9129 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:53:18.220875 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b36a669-1cce-40ea-ac02-2aa4bc5c9129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:53:18.308204 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-4b36a669-1cce-40ea-ac02-2aa4bc5c9129 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:53:18.309621 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-4b36a669-1cce-40ea-ac02-2aa4bc5c9129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:53:18.418420 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 691/1384] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:53:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:53:18.817970 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b715c78-0224-4598-9d65-ddab82377d5f None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:53:18.820124 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-4b715c78-0224-4598-9d65-ddab82377d5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:53:18.911831 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:53:18.978324 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b715c78-0224-4598-9d65-ddab82377d5f None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:53:19.103249 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690daf96-31cd-4e6b-943d-c0056fbfa4d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a39cd50340184779ac589bbcb7cac9aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:53:19.104555 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690daf96-31cd-4e6b-943d-c0056fbfa4d5 service nova] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:53:19.104968 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690daf96-31cd-4e6b-943d-c0056fbfa4d5 service nova] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:53:19.105320 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690daf96-31cd-4e6b-943d-c0056fbfa4d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:53:19.107118 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-690daf96-31cd-4e6b-943d-c0056fbfa4d5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:53:19.158517 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:53:19.201427 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690daf96-31cd-4e6b-943d-c0056fbfa4d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:53:19.203024 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690daf96-31cd-4e6b-943d-c0056fbfa4d5 service nova] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:53:19.221415 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 694/1385] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 21:53:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:53:21.427164 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbea7238-4983-4edb-b1ff-6f5ce0b0383e None None] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:53:21.427803 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbea7238-4983-4edb-b1ff-6f5ce0b0383e None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:53:21.427803 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbea7238-4983-4edb-b1ff-6f5ce0b0383e None None] PATH_INFO: `/` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:53:21.429175 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 692/1386] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:53:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:53:21.435968 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eadf139-6bf8-484f-92ca-a6ffcd847acd None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:53:21.436539 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eadf139-6bf8-484f-92ca-a6ffcd847acd None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:53:21.436539 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eadf139-6bf8-484f-92ca-a6ffcd847acd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:53:21.515941 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-8eadf139-6bf8-484f-92ca-a6ffcd847acd None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:53:21.517517 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-8eadf139-6bf8-484f-92ca-a6ffcd847acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:53:21.626147 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 695/1387] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:53:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:53:21.970897 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbea7238-4983-4edb-b1ff-6f5ce0b0383e None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:53:21.973206 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-bbea7238-4983-4edb-b1ff-6f5ce0b0383e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:53:22.080874 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:53:22.158765 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbea7238-4983-4edb-b1ff-6f5ce0b0383e None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:53:22.285989 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084eca55-b201-484d-902c-3b697b2f3a58 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a39cd50340184779ac589bbcb7cac9aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:53:22.286866 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084eca55-b201-484d-902c-3b697b2f3a58 service nova] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:53:22.287298 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084eca55-b201-484d-902c-3b697b2f3a58 service nova] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:53:22.287751 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084eca55-b201-484d-902c-3b697b2f3a58 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:53:22.289409 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-084eca55-b201-484d-902c-3b697b2f3a58 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:53:22.331679 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:53:22.389933 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084eca55-b201-484d-902c-3b697b2f3a58 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:53:22.391561 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084eca55-b201-484d-902c-3b697b2f3a58 service nova] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:53:22.410693 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 693/1388] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 21:53:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:53:24.402813 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb43a080-073e-4a9b-b652-d209affcd38a None None] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:53:24.403434 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb43a080-073e-4a9b-b652-d209affcd38a None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:53:24.403434 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb43a080-073e-4a9b-b652-d209affcd38a None None] PATH_INFO: `/` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:53:24.404890 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 696/1389] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:53:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 21:53:24.410110 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736894ac-01f7-422f-976a-31cca995903a None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:53:24.410552 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736894ac-01f7-422f-976a-31cca995903a None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:53:24.410668 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736894ac-01f7-422f-976a-31cca995903a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:53:24.477822 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-736894ac-01f7-422f-976a-31cca995903a None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:53:24.479381 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3e8190-e9de-43a4-83c1-5d03826d9131 None None] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:53:24.479574 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-736894ac-01f7-422f-976a-31cca995903a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:53:24.479781 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3e8190-e9de-43a4-83c1-5d03826d9131 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:53:24.480192 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3e8190-e9de-43a4-83c1-5d03826d9131 None None] PATH_INFO: `/` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:53:24.481722 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 697/1390] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:53:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 21:53:24.486817 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9de207-3a4a-4f17-b9db-eeba5e2a2d0b None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:53:24.487288 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9de207-3a4a-4f17-b9db-eeba5e2a2d0b None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:53:24.487633 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9de207-3a4a-4f17-b9db-eeba5e2a2d0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:53:24.524343 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:53:24.558515 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-bd9de207-3a4a-4f17-b9db-eeba5e2a2d0b None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:53:24.559739 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-bd9de207-3a4a-4f17-b9db-eeba5e2a2d0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:53:24.584647 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 694/1391] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:53:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 21:53:24.658544 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 698/1392] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:53:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 21:53:24.884890 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e17d99-7717-469e-8d3c-ece605aa9222 None None] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:53:24.885216 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e17d99-7717-469e-8d3c-ece605aa9222 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:53:24.885564 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e17d99-7717-469e-8d3c-ece605aa9222 None None] PATH_INFO: `/` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:53:24.886917 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 695/1393] 10.222.0.27 () {54 vars in 967 bytes} [Thu Aug 18 21:53:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:53:24.892381 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0590e359-9694-402b-b5b4-68dfcb82a897 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:53:24.892771 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0590e359-9694-402b-b5b4-68dfcb82a897 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:53:24.893109 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0590e359-9694-402b-b5b4-68dfcb82a897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:53:24.948774 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e17d99-7717-469e-8d3c-ece605aa9222 None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:53:24.950387 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-c3e17d99-7717-469e-8d3c-ece605aa9222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:53:24.964768 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:53:24.973134 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-0590e359-9694-402b-b5b4-68dfcb82a897 None None] MFA Rules not processed for user `85dfef6a910547da9706d294e7d40fd0`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:53:24.980905 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-0590e359-9694-402b-b5b4-68dfcb82a897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:53:25.023571 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:53:25.054966 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 699/1394] 10.222.0.27 () {58 vars in 1064 bytes} [Thu Aug 18 21:53:24 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:53:25.062595 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0590e359-9694-402b-b5b4-68dfcb82a897 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:53:25.070096 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0590e359-9694-402b-b5b4-68dfcb82a897 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:53:25.099736 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e17d99-7717-469e-8d3c-ece605aa9222 None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:53:25.147530 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1cc096-d288-4446-87ef-451e451f4021 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85dfef6a910547da9706d294e7d40fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:53:25.148130 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1cc096-d288-4446-87ef-451e451f4021 service glance] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:53:25.148411 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1cc096-d288-4446-87ef-451e451f4021 service glance] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:53:25.148707 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1cc096-d288-4446-87ef-451e451f4021 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:53:25.150307 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-2d1cc096-d288-4446-87ef-451e451f4021 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:53:25.188614 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:53:25.217311 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133550d3-90ef-460c-97af-bbcc05edb89e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a39cd50340184779ac589bbcb7cac9aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:53:25.218104 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133550d3-90ef-460c-97af-bbcc05edb89e service nova] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:53:25.218547 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133550d3-90ef-460c-97af-bbcc05edb89e service nova] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:53:25.219147 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133550d3-90ef-460c-97af-bbcc05edb89e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:53:25.220849 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-133550d3-90ef-460c-97af-bbcc05edb89e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:53:25.263140 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1cc096-d288-4446-87ef-451e451f4021 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:53:25.264902 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1cc096-d288-4446-87ef-451e451f4021 service glance] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:53:25.279944 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:53:25.284346 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 700/1395] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 21:53:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 21:53:25.316642 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133550d3-90ef-460c-97af-bbcc05edb89e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:53:25.318252 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133550d3-90ef-460c-97af-bbcc05edb89e service nova] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:53:25.336947 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 696/1396] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 21:53:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:53:26.224070 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524717e3-2a3f-4f50-b67e-f6b8a0df052e None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:53:26.224536 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524717e3-2a3f-4f50-b67e-f6b8a0df052e None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:53:26.224721 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524717e3-2a3f-4f50-b67e-f6b8a0df052e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:53:26.295909 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-524717e3-2a3f-4f50-b67e-f6b8a0df052e None None] MFA Rules not processed for user `f079aa6ed5594a4982172b51b93ac54f`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:53:26.297179 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-524717e3-2a3f-4f50-b67e-f6b8a0df052e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:53:26.384239 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 701/1397] 10.222.0.27 () {58 vars in 1009 bytes} [Thu Aug 18 21:53:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:53:26.426719 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c703b5d-1195-4c7a-8b94-2869cc1daf05 None None] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:53:26.427182 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c703b5d-1195-4c7a-8b94-2869cc1daf05 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:53:26.427271 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c703b5d-1195-4c7a-8b94-2869cc1daf05 None None] PATH_INFO: `/` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:53:26.428643 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 697/1398] 10.222.0.27 () {54 vars in 943 bytes} [Thu Aug 18 21:53:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:53:26.435332 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102bcd69-adf9-4f87-9708-a3b7d3933c4c None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:53:26.435628 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102bcd69-adf9-4f87-9708-a3b7d3933c4c None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:53:26.435910 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102bcd69-adf9-4f87-9708-a3b7d3933c4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:53:26.516615 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-102bcd69-adf9-4f87-9708-a3b7d3933c4c None None] MFA Rules not processed for user `9ae59e6dca304c949942ae769acedc74`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:53:26.517761 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-102bcd69-adf9-4f87-9708-a3b7d3933c4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:53:26.549089 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:53:26.630871 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 702/1399] 10.222.0.27 () {58 vars in 1040 bytes} [Thu Aug 18 21:53:26 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:53:26.640524 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c703b5d-1195-4c7a-8b94-2869cc1daf05 None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:53:26.642116 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-6c703b5d-1195-4c7a-8b94-2869cc1daf05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:53:26.737281 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:53:26.778822 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c703b5d-1195-4c7a-8b94-2869cc1daf05 None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:53:26.882512 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a90945-adf5-4cf3-9730-32515b2baac5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae59e6dca304c949942ae769acedc74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:53:26.883150 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a90945-adf5-4cf3-9730-32515b2baac5 service swift] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:53:26.883438 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a90945-adf5-4cf3-9730-32515b2baac5 service swift] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:53:26.883703 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a90945-adf5-4cf3-9730-32515b2baac5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:53:26.885407 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-24a90945-adf5-4cf3-9730-32515b2baac5 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:53:26.969997 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a90945-adf5-4cf3-9730-32515b2baac5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:53:26.971628 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a90945-adf5-4cf3-9730-32515b2baac5 service swift] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:53:26.975408 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:53:26.981071 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 698/1400] 10.222.0.27 () {60 vars in 1384 bytes} [Thu Aug 18 21:53:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 18 21:53:27.452228 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5aa775-781d-481b-8b23-8e7513ec1735 None None] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:53:27.452814 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5aa775-781d-481b-8b23-8e7513ec1735 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:53:27.452908 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5aa775-781d-481b-8b23-8e7513ec1735 None None] PATH_INFO: `/` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:53:27.454451 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 703/1401] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:53:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:53:27.459654 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73218763-ec1e-47fe-b70d-28f340f0707a None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:53:27.462409 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73218763-ec1e-47fe-b70d-28f340f0707a None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:53:27.462409 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73218763-ec1e-47fe-b70d-28f340f0707a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:53:27.534154 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-73218763-ec1e-47fe-b70d-28f340f0707a None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:53:27.535421 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-73218763-ec1e-47fe-b70d-28f340f0707a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:53:27.642019 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 699/1402] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:53:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:53:27.940385 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5aa775-781d-481b-8b23-8e7513ec1735 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:53:27.941924 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-7b5aa775-781d-481b-8b23-8e7513ec1735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:53:28.113381 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5aa775-781d-481b-8b23-8e7513ec1735 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:53:28.116384 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:53:28.312709 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9540c3-3a25-4548-b1e7-e90695b0dc7b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a39cd50340184779ac589bbcb7cac9aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:53:28.312709 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9540c3-3a25-4548-b1e7-e90695b0dc7b service nova] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:53:28.312709 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9540c3-3a25-4548-b1e7-e90695b0dc7b service nova] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:53:28.312709 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9540c3-3a25-4548-b1e7-e90695b0dc7b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:53:28.313799 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-4c9540c3-3a25-4548-b1e7-e90695b0dc7b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:53:28.373260 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9540c3-3a25-4548-b1e7-e90695b0dc7b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:53:28.375638 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9540c3-3a25-4548-b1e7-e90695b0dc7b service nova] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:53:28.395204 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 704/1403] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 21:53:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:53:30.857914 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2aae08-f217-4c86-b774-e3bd36ae6041 None None] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:53:30.858488 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2aae08-f217-4c86-b774-e3bd36ae6041 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:53:30.858488 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2aae08-f217-4c86-b774-e3bd36ae6041 None None] PATH_INFO: `/` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:53:30.860063 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 700/1404] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:53:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:53:30.865353 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2e8733-82ce-4ad0-98f9-c5e24c937f3f None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:53:30.865775 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2e8733-82ce-4ad0-98f9-c5e24c937f3f None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:53:30.865971 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2e8733-82ce-4ad0-98f9-c5e24c937f3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:53:30.876631 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:53:30.942513 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-fd2e8733-82ce-4ad0-98f9-c5e24c937f3f None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:53:30.943748 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-fd2e8733-82ce-4ad0-98f9-c5e24c937f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:53:31.052232 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 705/1405] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:53:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:53:31.360606 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2aae08-f217-4c86-b774-e3bd36ae6041 None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:53:31.362382 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-6b2aae08-f217-4c86-b774-e3bd36ae6041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:53:31.453032 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:53:31.534442 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2aae08-f217-4c86-b774-e3bd36ae6041 None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:53:31.659649 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5292d6-e9e4-448a-ab46-199b9eccbbcd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a39cd50340184779ac589bbcb7cac9aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:53:31.660251 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5292d6-e9e4-448a-ab46-199b9eccbbcd service nova] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:53:31.660537 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5292d6-e9e4-448a-ab46-199b9eccbbcd service nova] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:53:31.660835 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5292d6-e9e4-448a-ab46-199b9eccbbcd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:53:31.662444 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-dd5292d6-e9e4-448a-ab46-199b9eccbbcd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:53:31.705259 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:53:31.761972 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5292d6-e9e4-448a-ab46-199b9eccbbcd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:53:31.763834 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5292d6-e9e4-448a-ab46-199b9eccbbcd service nova] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:53:31.782568 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 701/1406] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 21:53:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:53:33.892979 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2105f6-2aad-413a-83ed-d6f230792f6d None None] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:53:33.893624 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2105f6-2aad-413a-83ed-d6f230792f6d None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:53:33.893624 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2105f6-2aad-413a-83ed-d6f230792f6d None None] PATH_INFO: `/` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:53:33.894871 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 706/1407] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:53:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:53:33.900241 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9e7ce9-7e60-4611-8bc0-ac97458bd168 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:53:33.900696 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9e7ce9-7e60-4611-8bc0-ac97458bd168 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:53:33.900921 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9e7ce9-7e60-4611-8bc0-ac97458bd168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:53:33.982461 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-5e9e7ce9-7e60-4611-8bc0-ac97458bd168 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:53:33.983700 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-5e9e7ce9-7e60-4611-8bc0-ac97458bd168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:53:34.095143 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 702/1408] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:53:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 21:53:34.412175 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2105f6-2aad-413a-83ed-d6f230792f6d None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:53:34.414200 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-0c2105f6-2aad-413a-83ed-d6f230792f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:53:34.508386 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:53:34.583575 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2105f6-2aad-413a-83ed-d6f230792f6d None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:53:34.716560 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c9d87f-6674-4663-ba08-7e4dd5f0dfb6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a39cd50340184779ac589bbcb7cac9aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:53:34.717188 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c9d87f-6674-4663-ba08-7e4dd5f0dfb6 service nova] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:53:34.717462 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c9d87f-6674-4663-ba08-7e4dd5f0dfb6 service nova] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:53:34.717727 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c9d87f-6674-4663-ba08-7e4dd5f0dfb6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:53:34.719408 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-24c9d87f-6674-4663-ba08-7e4dd5f0dfb6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:53:34.773895 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:53:34.822467 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c9d87f-6674-4663-ba08-7e4dd5f0dfb6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:53:34.824454 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c9d87f-6674-4663-ba08-7e4dd5f0dfb6 service nova] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:53:34.846215 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 707/1409] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 21:53:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:53:44.093204 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=93 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:53:44.843864 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=24 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:53:50.973728 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d72992-6c85-4c1f-a000-6b928d21330f None None] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:53:50.974281 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d72992-6c85-4c1f-a000-6b928d21330f None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:53:50.974281 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d72992-6c85-4c1f-a000-6b928d21330f None None] PATH_INFO: `/` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:53:50.975634 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 703/1410] 10.222.0.27 () {54 vars in 918 bytes} [Thu Aug 18 21:53:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:53:50.980775 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7090ecc8-c4b4-4b91-ac58-e8e0de2f0c58 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:53:50.981228 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7090ecc8-c4b4-4b91-ac58-e8e0de2f0c58 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:53:50.981335 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7090ecc8-c4b4-4b91-ac58-e8e0de2f0c58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:53:51.056568 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-7090ecc8-c4b4-4b91-ac58-e8e0de2f0c58 None None] MFA Rules not processed for user `b44c0cf2d8b34f3e81c59d19eedbdfcc`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:53:51.058381 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-7090ecc8-c4b4-4b91-ac58-e8e0de2f0c58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:53:51.164847 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 708/1411] 10.222.0.27 () {58 vars in 1015 bytes} [Thu Aug 18 21:53:50 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:53:51.179678 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed017afc-df1c-4923-a222-a382b8d4adcb None None] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:53:51.179959 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed017afc-df1c-4923-a222-a382b8d4adcb None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:53:51.180233 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed017afc-df1c-4923-a222-a382b8d4adcb None None] PATH_INFO: `/` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:53:51.181596 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 704/1412] 10.222.0.27 () {54 vars in 918 bytes} [Thu Aug 18 21:53:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:53:51.186905 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f48d052-131b-4875-82a4-1ca9133c2904 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:53:51.187219 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f48d052-131b-4875-82a4-1ca9133c2904 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:53:51.187519 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f48d052-131b-4875-82a4-1ca9133c2904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:53:51.260104 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:53:51.263619 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-8f48d052-131b-4875-82a4-1ca9133c2904 None None] MFA Rules not processed for user `a39cd50340184779ac589bbcb7cac9aa`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:53:51.265134 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-8f48d052-131b-4875-82a4-1ca9133c2904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:53:51.384476 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 709/1413] 10.222.0.27 () {58 vars in 1015 bytes} [Thu Aug 18 21:53:51 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:53:53.768385 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954863e8-0c1b-4cda-a3f3-c8d36b0aebbb None None] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:53:53.768975 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954863e8-0c1b-4cda-a3f3-c8d36b0aebbb None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:53:53.768975 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954863e8-0c1b-4cda-a3f3-c8d36b0aebbb None None] PATH_INFO: `/` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:53:53.770300 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 705/1414] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 21:53:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:53:53.775635 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7806afa4-569b-4472-8c76-069dc08626e8 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:53:53.776168 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7806afa4-569b-4472-8c76-069dc08626e8 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:53:53.776168 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7806afa4-569b-4472-8c76-069dc08626e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:53:53.842031 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-7806afa4-569b-4472-8c76-069dc08626e8 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:53:53.843157 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-7806afa4-569b-4472-8c76-069dc08626e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:53:53.896497 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:53:53.938659 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 710/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 21:53:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:53:54.227380 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954863e8-0c1b-4cda-a3f3-c8d36b0aebbb None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:53:54.229543 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-954863e8-0c1b-4cda-a3f3-c8d36b0aebbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:53:54.378043 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954863e8-0c1b-4cda-a3f3-c8d36b0aebbb None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:53:54.451110 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:53:54.491647 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a640b2ca-80ff-4c31-ae8d-d3e185f894bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a39cd50340184779ac589bbcb7cac9aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:53:54.492177 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a640b2ca-80ff-4c31-ae8d-d3e185f894bb service nova] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:53:54.492460 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a640b2ca-80ff-4c31-ae8d-d3e185f894bb service nova] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:53:54.492769 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a640b2ca-80ff-4c31-ae8d-d3e185f894bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:53:54.494382 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-a640b2ca-80ff-4c31-ae8d-d3e185f894bb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:53:54.584221 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a640b2ca-80ff-4c31-ae8d-d3e185f894bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:53:54.585851 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a640b2ca-80ff-4c31-ae8d-d3e185f894bb service nova] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:53:54.605491 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 706/1416] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 21:53:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:53:55.497938 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba701bea-b17c-451a-ba08-cb3865dbc736 None None] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:53:55.498426 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba701bea-b17c-451a-ba08-cb3865dbc736 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:53:55.498589 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba701bea-b17c-451a-ba08-cb3865dbc736 None None] PATH_INFO: `/` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:53:55.499872 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 711/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 18 21:53:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:53:55.504825 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8b45aa-bdae-424d-afe4-394cc46bef8e None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:53:55.510170 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8b45aa-bdae-424d-afe4-394cc46bef8e None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:53:55.510170 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8b45aa-bdae-424d-afe4-394cc46bef8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:53:55.582318 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-1c8b45aa-bdae-424d-afe4-394cc46bef8e None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:53:55.583452 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-1c8b45aa-bdae-424d-afe4-394cc46bef8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:53:55.609803 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:53:55.678370 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 707/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 18 21:53:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 21:53:55.830754 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba701bea-b17c-451a-ba08-cb3865dbc736 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:53:55.832267 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-ba701bea-b17c-451a-ba08-cb3865dbc736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:53:55.974783 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba701bea-b17c-451a-ba08-cb3865dbc736 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:53:56.015864 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:53:56.087696 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898e990d-ec5b-435c-8cab-55b0391bfa2f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a39cd50340184779ac589bbcb7cac9aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:53:56.088828 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898e990d-ec5b-435c-8cab-55b0391bfa2f service nova] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:53:56.089114 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898e990d-ec5b-435c-8cab-55b0391bfa2f service nova] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:53:56.089474 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898e990d-ec5b-435c-8cab-55b0391bfa2f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:53:56.091070 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-898e990d-ec5b-435c-8cab-55b0391bfa2f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:53:56.182186 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898e990d-ec5b-435c-8cab-55b0391bfa2f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:53:56.183778 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898e990d-ec5b-435c-8cab-55b0391bfa2f service nova] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:53:56.201626 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 712/1419] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 21:53:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:53:57.091182 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13cffcc-0934-4d5f-89a6-186f929cefc7 None None] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:53:57.091760 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13cffcc-0934-4d5f-89a6-186f929cefc7 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:53:57.091760 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13cffcc-0934-4d5f-89a6-186f929cefc7 None None] PATH_INFO: `/` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:53:57.093162 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 708/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 18 21:53:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:53:57.098219 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92a9c1f-edc2-4632-a201-d26088b0d322 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:53:57.098644 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92a9c1f-edc2-4632-a201-d26088b0d322 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:53:57.098772 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92a9c1f-edc2-4632-a201-d26088b0d322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:53:57.154005 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:53:57.174907 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-a92a9c1f-edc2-4632-a201-d26088b0d322 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:53:57.176140 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-a92a9c1f-edc2-4632-a201-d26088b0d322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:53:57.277894 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 713/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 18 21:53:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:53:57.428866 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13cffcc-0934-4d5f-89a6-186f929cefc7 None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:53:57.430535 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-f13cffcc-0934-4d5f-89a6-186f929cefc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:53:57.578759 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13cffcc-0934-4d5f-89a6-186f929cefc7 None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:53:57.591511 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:53:57.693408 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958843d5-a99e-48dc-9772-e14e2b7f2316 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a39cd50340184779ac589bbcb7cac9aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:53:57.693933 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958843d5-a99e-48dc-9772-e14e2b7f2316 service nova] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:53:57.694211 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958843d5-a99e-48dc-9772-e14e2b7f2316 service nova] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:53:57.694483 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958843d5-a99e-48dc-9772-e14e2b7f2316 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:53:57.696116 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-958843d5-a99e-48dc-9772-e14e2b7f2316 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:53:57.786689 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958843d5-a99e-48dc-9772-e14e2b7f2316 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:53:57.788270 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958843d5-a99e-48dc-9772-e14e2b7f2316 service nova] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:53:57.806880 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 709/1422] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 21:53:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:53:58.673986 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23815462-20d0-4d6a-b7dc-968c7258fc11 None None] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:53:58.674558 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23815462-20d0-4d6a-b7dc-968c7258fc11 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:53:58.674558 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23815462-20d0-4d6a-b7dc-968c7258fc11 None None] PATH_INFO: `/` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:53:58.675901 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 714/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 18 21:53:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:53:58.680773 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295b01e6-2abe-40c1-8446-37270390a0d6 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:53:58.681223 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295b01e6-2abe-40c1-8446-37270390a0d6 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:53:58.681328 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295b01e6-2abe-40c1-8446-37270390a0d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:53:58.701973 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:53:58.757989 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-295b01e6-2abe-40c1-8446-37270390a0d6 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:53:58.759193 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-295b01e6-2abe-40c1-8446-37270390a0d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:53:58.854769 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 710/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 18 21:53:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 21:53:59.005361 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23815462-20d0-4d6a-b7dc-968c7258fc11 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:53:59.006870 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-23815462-20d0-4d6a-b7dc-968c7258fc11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:53:59.115826 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:53:59.154127 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23815462-20d0-4d6a-b7dc-968c7258fc11 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:53:59.265821 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fd7a10-e431-4362-be36-5c9c845e76f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a39cd50340184779ac589bbcb7cac9aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:53:59.266432 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fd7a10-e431-4362-be36-5c9c845e76f2 service nova] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:53:59.266713 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fd7a10-e431-4362-be36-5c9c845e76f2 service nova] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:53:59.266987 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fd7a10-e431-4362-be36-5c9c845e76f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:53:59.268620 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-e8fd7a10-e431-4362-be36-5c9c845e76f2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:53:59.353843 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:53:59.367251 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fd7a10-e431-4362-be36-5c9c845e76f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:53:59.368834 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fd7a10-e431-4362-be36-5c9c845e76f2 service nova] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:53:59.388810 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 715/1425] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 21:53:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:54:00.254820 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85325d6-ac20-486d-92be-e6b964990301 None None] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:54:00.255388 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85325d6-ac20-486d-92be-e6b964990301 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:54:00.255388 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85325d6-ac20-486d-92be-e6b964990301 None None] PATH_INFO: `/` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:54:00.256745 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 711/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 18 21:54:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:54:00.262149 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9d7776-5b16-4d35-98ae-9c1fc98a8334 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:54:00.262577 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9d7776-5b16-4d35-98ae-9c1fc98a8334 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:54:00.262682 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9d7776-5b16-4d35-98ae-9c1fc98a8334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:54:00.339308 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-2e9d7776-5b16-4d35-98ae-9c1fc98a8334 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:54:00.340458 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-2e9d7776-5b16-4d35-98ae-9c1fc98a8334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:54:00.435302 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 716/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 18 21:54:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:54:00.587709 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85325d6-ac20-486d-92be-e6b964990301 None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:54:00.589735 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-f85325d6-ac20-486d-92be-e6b964990301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:54:00.673536 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:54:00.735489 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85325d6-ac20-486d-92be-e6b964990301 None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:54:00.849438 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520cfbaa-0ea0-448e-9680-2b728e929ecc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a39cd50340184779ac589bbcb7cac9aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:54:00.849963 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520cfbaa-0ea0-448e-9680-2b728e929ecc service nova] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:54:00.850244 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520cfbaa-0ea0-448e-9680-2b728e929ecc service nova] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:54:00.850516 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520cfbaa-0ea0-448e-9680-2b728e929ecc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:54:00.852138 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-520cfbaa-0ea0-448e-9680-2b728e929ecc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:54:00.901387 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:54:00.944170 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520cfbaa-0ea0-448e-9680-2b728e929ecc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:54:00.945790 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520cfbaa-0ea0-448e-9680-2b728e929ecc service nova] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:54:00.964215 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 712/1428] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 21:54:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:54:01.862450 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad46f66-7672-456c-bd10-105a32a6a6f2 None None] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:54:01.862989 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad46f66-7672-456c-bd10-105a32a6a6f2 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:54:01.862989 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad46f66-7672-456c-bd10-105a32a6a6f2 None None] PATH_INFO: `/` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:54:01.864343 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 717/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 18 21:54:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:54:01.869356 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14242e22-bb71-4cb3-a4e2-f45f8a06e753 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:54:01.870473 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14242e22-bb71-4cb3-a4e2-f45f8a06e753 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:54:01.870612 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14242e22-bb71-4cb3-a4e2-f45f8a06e753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:54:01.946806 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-14242e22-bb71-4cb3-a4e2-f45f8a06e753 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:54:01.948043 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-14242e22-bb71-4cb3-a4e2-f45f8a06e753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:54:02.043140 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 713/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 18 21:54:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:54:02.196679 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad46f66-7672-456c-bd10-105a32a6a6f2 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:54:02.198748 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-dad46f66-7672-456c-bd10-105a32a6a6f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:54:02.246340 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:54:02.342617 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad46f66-7672-456c-bd10-105a32a6a6f2 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:54:02.454994 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ffceb5-1012-4f98-9671-170c906bd225 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a39cd50340184779ac589bbcb7cac9aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:54:02.455518 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ffceb5-1012-4f98-9671-170c906bd225 service nova] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:54:02.455804 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ffceb5-1012-4f98-9671-170c906bd225 service nova] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:54:02.456077 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ffceb5-1012-4f98-9671-170c906bd225 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:54:02.457718 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-a3ffceb5-1012-4f98-9671-170c906bd225 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:54:02.464828 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:54:02.550353 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ffceb5-1012-4f98-9671-170c906bd225 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:54:02.551968 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ffceb5-1012-4f98-9671-170c906bd225 service nova] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:54:02.570415 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 718/1431] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 21:54:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:54:03.428225 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ab8452-c70a-475c-870e-bd74efdc227f None None] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:54:03.428798 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ab8452-c70a-475c-870e-bd74efdc227f None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:54:03.428798 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ab8452-c70a-475c-870e-bd74efdc227f None None] PATH_INFO: `/` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:54:03.430190 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 714/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 18 21:54:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:54:03.435006 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26118523-97ab-45db-9390-348ecb21fe32 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:54:03.435458 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26118523-97ab-45db-9390-348ecb21fe32 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:54:03.435555 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26118523-97ab-45db-9390-348ecb21fe32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:54:03.509818 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-26118523-97ab-45db-9390-348ecb21fe32 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:54:03.511012 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-26118523-97ab-45db-9390-348ecb21fe32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:54:03.579702 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:54:03.607198 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 719/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 18 21:54:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:54:03.757988 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ab8452-c70a-475c-870e-bd74efdc227f None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:54:03.759578 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-05ab8452-c70a-475c-870e-bd74efdc227f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:54:03.778026 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:54:03.911473 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ab8452-c70a-475c-870e-bd74efdc227f None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:54:04.001194 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:54:04.026517 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16fdd23-fd9f-40ce-b57e-17f1fa16d877 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a39cd50340184779ac589bbcb7cac9aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:54:04.027117 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16fdd23-fd9f-40ce-b57e-17f1fa16d877 service nova] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:54:04.027393 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16fdd23-fd9f-40ce-b57e-17f1fa16d877 service nova] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:54:04.027713 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16fdd23-fd9f-40ce-b57e-17f1fa16d877 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:54:04.029524 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-b16fdd23-fd9f-40ce-b57e-17f1fa16d877 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:54:04.120299 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16fdd23-fd9f-40ce-b57e-17f1fa16d877 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:54:04.122545 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16fdd23-fd9f-40ce-b57e-17f1fa16d877 service nova] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:54:04.140558 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 715/1434] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 21:54:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:54:05.002898 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5519bb4f-b84a-4a20-a933-3b790447a754 None None] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:54:05.003440 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5519bb4f-b84a-4a20-a933-3b790447a754 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:54:05.003440 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5519bb4f-b84a-4a20-a933-3b790447a754 None None] PATH_INFO: `/` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:54:05.004797 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 720/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 18 21:54:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:54:05.009731 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44450504-7c70-4bc2-a16a-21355faf1498 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:54:05.010158 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44450504-7c70-4bc2-a16a-21355faf1498 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:54:05.010289 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44450504-7c70-4bc2-a16a-21355faf1498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:54:05.092221 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-44450504-7c70-4bc2-a16a-21355faf1498 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:54:05.094211 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-44450504-7c70-4bc2-a16a-21355faf1498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:54:05.143787 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:54:05.198798 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 716/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 18 21:54:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:54:05.359328 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5519bb4f-b84a-4a20-a933-3b790447a754 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:54:05.361005 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-5519bb4f-b84a-4a20-a933-3b790447a754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:54:05.507662 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5519bb4f-b84a-4a20-a933-3b790447a754 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:54:05.562370 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:54:05.619965 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6126528a-b100-4bcb-bf9b-5eda2308d0eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a39cd50340184779ac589bbcb7cac9aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:54:05.620565 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6126528a-b100-4bcb-bf9b-5eda2308d0eb service nova] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:54:05.620872 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6126528a-b100-4bcb-bf9b-5eda2308d0eb service nova] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:54:05.621143 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6126528a-b100-4bcb-bf9b-5eda2308d0eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:54:05.623587 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-6126528a-b100-4bcb-bf9b-5eda2308d0eb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:54:05.711282 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6126528a-b100-4bcb-bf9b-5eda2308d0eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:54:05.712904 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6126528a-b100-4bcb-bf9b-5eda2308d0eb service nova] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:54:05.731311 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 721/1437] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 21:54:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:54:06.594020 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38391038-ee30-4f2a-89a1-7dfcf6e083ea None None] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:54:06.594512 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38391038-ee30-4f2a-89a1-7dfcf6e083ea None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:54:06.594622 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38391038-ee30-4f2a-89a1-7dfcf6e083ea None None] PATH_INFO: `/` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:54:06.595916 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 717/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 18 21:54:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:54:06.600983 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615d9be2-f18d-4acd-957f-8e7400d7a681 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:54:06.601412 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615d9be2-f18d-4acd-957f-8e7400d7a681 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:54:06.601536 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615d9be2-f18d-4acd-957f-8e7400d7a681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:54:06.676460 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-615d9be2-f18d-4acd-957f-8e7400d7a681 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:54:06.677788 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-615d9be2-f18d-4acd-957f-8e7400d7a681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:54:06.679830 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:54:06.774394 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 722/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 18 21:54:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:54:06.927089 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38391038-ee30-4f2a-89a1-7dfcf6e083ea None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:54:06.928649 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-38391038-ee30-4f2a-89a1-7dfcf6e083ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:54:07.072214 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38391038-ee30-4f2a-89a1-7dfcf6e083ea None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:54:07.099334 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:54:07.185814 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d52e95-83d5-4f8e-9328-f06dcfe3cb4a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a39cd50340184779ac589bbcb7cac9aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:54:07.186340 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d52e95-83d5-4f8e-9328-f06dcfe3cb4a service nova] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:54:07.186622 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d52e95-83d5-4f8e-9328-f06dcfe3cb4a service nova] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:54:07.186898 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d52e95-83d5-4f8e-9328-f06dcfe3cb4a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:54:07.188506 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-79d52e95-83d5-4f8e-9328-f06dcfe3cb4a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:54:07.280286 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d52e95-83d5-4f8e-9328-f06dcfe3cb4a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:54:07.281924 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d52e95-83d5-4f8e-9328-f06dcfe3cb4a service nova] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:54:07.300512 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 718/1440] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 21:54:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:54:09.112940 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80192323-a42a-464a-ac9d-0e3f8cbe3542 None None] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:54:09.113503 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80192323-a42a-464a-ac9d-0e3f8cbe3542 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:54:09.113503 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80192323-a42a-464a-ac9d-0e3f8cbe3542 None None] PATH_INFO: `/` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:54:09.114823 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 723/1441] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 21:54:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:54:09.120246 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae540043-f4b8-4da9-a5c4-677091d33272 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:54:09.120721 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae540043-f4b8-4da9-a5c4-677091d33272 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:54:09.120857 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae540043-f4b8-4da9-a5c4-677091d33272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:54:09.161748 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:54:09.186575 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-ae540043-f4b8-4da9-a5c4-677091d33272 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:54:09.187775 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-ae540043-f4b8-4da9-a5c4-677091d33272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:54:09.284804 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 719/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 21:54:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 21:54:09.580555 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80192323-a42a-464a-ac9d-0e3f8cbe3542 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:54:09.582189 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-80192323-a42a-464a-ac9d-0e3f8cbe3542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:54:09.685612 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80192323-a42a-464a-ac9d-0e3f8cbe3542 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:54:09.717443 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:54:09.757884 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49bbe01-1af7-44df-a41a-71f9ef3a999d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a937971ad1a4b0c8697c764f214d446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:54:09.758482 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49bbe01-1af7-44df-a41a-71f9ef3a999d service neutron] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:54:09.758760 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49bbe01-1af7-44df-a41a-71f9ef3a999d service neutron] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:54:09.759029 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49bbe01-1af7-44df-a41a-71f9ef3a999d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:54:09.760637 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-f49bbe01-1af7-44df-a41a-71f9ef3a999d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:54:09.868030 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49bbe01-1af7-44df-a41a-71f9ef3a999d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:54:09.869500 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49bbe01-1af7-44df-a41a-71f9ef3a999d service neutron] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:54:09.887831 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 724/1443] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 21:54:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:54:12.059691 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8aaf7d-bca1-4aae-999d-ca0c560ef05c None None] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:54:12.060258 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8aaf7d-bca1-4aae-999d-ca0c560ef05c None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:54:12.060359 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8aaf7d-bca1-4aae-999d-ca0c560ef05c None None] PATH_INFO: `/` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:54:12.061712 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 720/1444] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 21:54:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:54:12.067098 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38563e02-6e6e-46a7-82cd-93475a1a2d7d None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:54:12.067553 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38563e02-6e6e-46a7-82cd-93475a1a2d7d None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:54:12.067664 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38563e02-6e6e-46a7-82cd-93475a1a2d7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:54:12.132655 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-38563e02-6e6e-46a7-82cd-93475a1a2d7d None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:54:12.133867 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-38563e02-6e6e-46a7-82cd-93475a1a2d7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:54:12.147476 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:54:12.231509 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 725/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 21:54:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:54:12.516955 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8aaf7d-bca1-4aae-999d-ca0c560ef05c None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:54:12.518528 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-9e8aaf7d-bca1-4aae-999d-ca0c560ef05c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:54:12.624537 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8aaf7d-bca1-4aae-999d-ca0c560ef05c None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:54:12.636705 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:54:12.698818 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f85804-2e6d-484b-aef6-c32e776a96ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a937971ad1a4b0c8697c764f214d446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:54:12.700140 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f85804-2e6d-484b-aef6-c32e776a96ea service neutron] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:54:12.700518 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f85804-2e6d-484b-aef6-c32e776a96ea service neutron] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:54:12.700815 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f85804-2e6d-484b-aef6-c32e776a96ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:54:12.702415 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-67f85804-2e6d-484b-aef6-c32e776a96ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:54:12.807528 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f85804-2e6d-484b-aef6-c32e776a96ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:54:12.809474 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f85804-2e6d-484b-aef6-c32e776a96ea service neutron] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:54:12.827422 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 721/1446] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 21:54:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:54:15.099266 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371b23e5-00ce-40ff-8781-49f8aa04d6d1 None None] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:54:15.099831 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371b23e5-00ce-40ff-8781-49f8aa04d6d1 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:54:15.099831 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371b23e5-00ce-40ff-8781-49f8aa04d6d1 None None] PATH_INFO: `/` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:54:15.101235 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 726/1447] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 21:54:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:54:15.106572 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eb59df-cd24-4701-a4da-d31013f313cd None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:54:15.106975 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eb59df-cd24-4701-a4da-d31013f313cd None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:54:15.107113 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eb59df-cd24-4701-a4da-d31013f313cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:54:15.154762 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:54:15.172303 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-d7eb59df-cd24-4701-a4da-d31013f313cd None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:54:15.173514 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-d7eb59df-cd24-4701-a4da-d31013f313cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:54:15.269792 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 722/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 21:54:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:54:15.560615 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371b23e5-00ce-40ff-8781-49f8aa04d6d1 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:54:15.563040 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-371b23e5-00ce-40ff-8781-49f8aa04d6d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:54:15.666216 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371b23e5-00ce-40ff-8781-49f8aa04d6d1 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:54:15.706405 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:54:15.738852 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e9dd27-dfb1-4518-b14c-9dba6b8aef2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a937971ad1a4b0c8697c764f214d446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:54:15.739298 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e9dd27-dfb1-4518-b14c-9dba6b8aef2a service neutron] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:54:15.739775 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e9dd27-dfb1-4518-b14c-9dba6b8aef2a service neutron] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:54:15.740270 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e9dd27-dfb1-4518-b14c-9dba6b8aef2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:54:15.742261 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-78e9dd27-dfb1-4518-b14c-9dba6b8aef2a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:54:15.850215 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e9dd27-dfb1-4518-b14c-9dba6b8aef2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:54:15.851690 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e9dd27-dfb1-4518-b14c-9dba6b8aef2a service neutron] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:54:15.872155 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 727/1449] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 21:54:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:54:17.890671 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9dcd03-e71a-4550-8eac-7ec2c719ba14 None None] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:54:17.891243 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9dcd03-e71a-4550-8eac-7ec2c719ba14 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:54:17.891243 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9dcd03-e71a-4550-8eac-7ec2c719ba14 None None] PATH_INFO: `/` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:54:17.892573 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 723/1450] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 21:54:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:54:17.897710 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76afb506-f48e-4440-aa46-e2c8f6185ee6 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:54:17.898177 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76afb506-f48e-4440-aa46-e2c8f6185ee6 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:54:17.898283 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76afb506-f48e-4440-aa46-e2c8f6185ee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:54:17.963352 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-76afb506-f48e-4440-aa46-e2c8f6185ee6 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:54:17.964561 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-76afb506-f48e-4440-aa46-e2c8f6185ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:54:17.985958 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:54:18.061597 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 728/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 21:54:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:54:18.348160 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9dcd03-e71a-4550-8eac-7ec2c719ba14 None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:54:18.349756 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-cd9dcd03-e71a-4550-8eac-7ec2c719ba14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:54:18.454069 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9dcd03-e71a-4550-8eac-7ec2c719ba14 None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:54:18.473846 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:54:18.528927 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba534e0-6da1-4276-a761-f974678667d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a937971ad1a4b0c8697c764f214d446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:54:18.529534 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba534e0-6da1-4276-a761-f974678667d5 service neutron] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:54:18.529812 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba534e0-6da1-4276-a761-f974678667d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:54:18.530081 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba534e0-6da1-4276-a761-f974678667d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:54:18.531698 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-8ba534e0-6da1-4276-a761-f974678667d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:54:18.642894 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba534e0-6da1-4276-a761-f974678667d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:54:18.644332 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba534e0-6da1-4276-a761-f974678667d5 service neutron] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:54:18.663770 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 724/1452] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 21:54:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:54:20.623011 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe40c61-ff24-40e3-be00-2d8196d1c984 None None] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:54:20.623554 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe40c61-ff24-40e3-be00-2d8196d1c984 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:54:20.623554 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe40c61-ff24-40e3-be00-2d8196d1c984 None None] PATH_INFO: `/` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:54:20.624962 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 729/1453] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 21:54:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:54:20.630431 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30277270-81bc-475d-a4c8-2fdb92ca6558 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:54:20.630874 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30277270-81bc-475d-a4c8-2fdb92ca6558 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:54:20.630983 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30277270-81bc-475d-a4c8-2fdb92ca6558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:54:20.694613 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:54:20.697538 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-30277270-81bc-475d-a4c8-2fdb92ca6558 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:54:20.698754 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-30277270-81bc-475d-a4c8-2fdb92ca6558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:54:20.798425 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 725/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 21:54:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:54:21.090711 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe40c61-ff24-40e3-be00-2d8196d1c984 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:54:21.092249 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-4fe40c61-ff24-40e3-be00-2d8196d1c984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:54:21.207422 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe40c61-ff24-40e3-be00-2d8196d1c984 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:54:21.256261 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:54:21.282380 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bc4e68-3e72-45c7-87e9-5c7e043d4d50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a937971ad1a4b0c8697c764f214d446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:54:21.282977 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bc4e68-3e72-45c7-87e9-5c7e043d4d50 service neutron] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:54:21.283257 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bc4e68-3e72-45c7-87e9-5c7e043d4d50 service neutron] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:54:21.283525 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bc4e68-3e72-45c7-87e9-5c7e043d4d50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:54:21.285175 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-31bc4e68-3e72-45c7-87e9-5c7e043d4d50 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:54:21.393843 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bc4e68-3e72-45c7-87e9-5c7e043d4d50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:54:21.395286 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bc4e68-3e72-45c7-87e9-5c7e043d4d50 service neutron] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:54:21.414277 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 730/1455] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 21:54:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:54:23.391231 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffbf016-6464-4c1f-bda7-43695285b97b None None] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:54:23.391765 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffbf016-6464-4c1f-bda7-43695285b97b None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:54:23.391765 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffbf016-6464-4c1f-bda7-43695285b97b None None] PATH_INFO: `/` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:54:23.393206 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 726/1456] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 21:54:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:54:23.398727 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0765d5c3-f743-45d9-b603-75e84c5f8a4e None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:54:23.399165 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0765d5c3-f743-45d9-b603-75e84c5f8a4e None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:54:23.399283 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0765d5c3-f743-45d9-b603-75e84c5f8a4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:54:23.465742 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-0765d5c3-f743-45d9-b603-75e84c5f8a4e None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:54:23.466952 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-0765d5c3-f743-45d9-b603-75e84c5f8a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:54:23.495961 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:54:23.564153 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 731/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 21:54:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:54:23.852821 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffbf016-6464-4c1f-bda7-43695285b97b None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:54:23.854397 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-3ffbf016-6464-4c1f-bda7-43695285b97b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:54:23.956578 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffbf016-6464-4c1f-bda7-43695285b97b None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:54:23.986513 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:54:24.031414 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb25b9a0-1afd-412e-8fa6-29d14a9beec8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a937971ad1a4b0c8697c764f214d446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:54:24.032041 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb25b9a0-1afd-412e-8fa6-29d14a9beec8 service neutron] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:54:24.032317 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb25b9a0-1afd-412e-8fa6-29d14a9beec8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:54:24.032604 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb25b9a0-1afd-412e-8fa6-29d14a9beec8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:54:24.034209 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-fb25b9a0-1afd-412e-8fa6-29d14a9beec8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:54:24.141312 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb25b9a0-1afd-412e-8fa6-29d14a9beec8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:54:24.142738 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb25b9a0-1afd-412e-8fa6-29d14a9beec8 service neutron] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:54:24.161377 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 727/1458] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 21:54:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 21:54:26.122168 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcdfc5d-3c5b-4339-8079-5de67e1f51c6 None None] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:54:26.122742 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcdfc5d-3c5b-4339-8079-5de67e1f51c6 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:54:26.122742 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcdfc5d-3c5b-4339-8079-5de67e1f51c6 None None] PATH_INFO: `/` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:54:26.124087 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 732/1459] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 21:54:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:54:26.129525 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf7c190-8499-41ae-9449-3b5910c5b81a None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:54:26.129930 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf7c190-8499-41ae-9449-3b5910c5b81a None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:54:26.130092 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf7c190-8499-41ae-9449-3b5910c5b81a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:54:26.196451 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-0cf7c190-8499-41ae-9449-3b5910c5b81a None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:54:26.197704 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-0cf7c190-8499-41ae-9449-3b5910c5b81a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:54:26.207037 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:54:26.296690 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 728/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 21:54:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:54:26.579644 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcdfc5d-3c5b-4339-8079-5de67e1f51c6 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:54:26.581494 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-8dcdfc5d-3c5b-4339-8079-5de67e1f51c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:54:26.685788 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcdfc5d-3c5b-4339-8079-5de67e1f51c6 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:54:26.740649 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:54:26.758602 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29b1128-406d-4b5f-b343-50d57ad74f76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a937971ad1a4b0c8697c764f214d446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:54:26.759199 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29b1128-406d-4b5f-b343-50d57ad74f76 service neutron] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:54:26.759473 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29b1128-406d-4b5f-b343-50d57ad74f76 service neutron] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:54:26.759740 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29b1128-406d-4b5f-b343-50d57ad74f76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:54:26.761475 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-b29b1128-406d-4b5f-b343-50d57ad74f76 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:54:26.867798 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29b1128-406d-4b5f-b343-50d57ad74f76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:54:26.869277 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29b1128-406d-4b5f-b343-50d57ad74f76 service neutron] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:54:26.888766 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 733/1461] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 21:54:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:54:28.866572 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878ec088-eb41-4590-806f-95bb7bdffe52 None None] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:54:28.867138 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878ec088-eb41-4590-806f-95bb7bdffe52 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:54:28.867138 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878ec088-eb41-4590-806f-95bb7bdffe52 None None] PATH_INFO: `/` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:54:28.868483 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 729/1462] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 21:54:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:54:28.874410 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6444940e-9741-4d9c-be79-8045ee4498c4 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:54:28.874797 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6444940e-9741-4d9c-be79-8045ee4498c4 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:54:28.874975 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6444940e-9741-4d9c-be79-8045ee4498c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:54:28.940929 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-6444940e-9741-4d9c-be79-8045ee4498c4 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:54:28.942149 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-6444940e-9741-4d9c-be79-8045ee4498c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:54:28.979375 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:54:29.038893 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 734/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 21:54:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:54:29.325777 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878ec088-eb41-4590-806f-95bb7bdffe52 None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:54:29.327423 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-878ec088-eb41-4590-806f-95bb7bdffe52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:54:29.433796 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878ec088-eb41-4590-806f-95bb7bdffe52 None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:54:29.478116 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:54:29.515144 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81228f0-4261-40d7-9ae0-6c48de35fd95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a937971ad1a4b0c8697c764f214d446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:54:29.515779 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81228f0-4261-40d7-9ae0-6c48de35fd95 service neutron] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:54:29.516061 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81228f0-4261-40d7-9ae0-6c48de35fd95 service neutron] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:54:29.516335 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81228f0-4261-40d7-9ae0-6c48de35fd95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:54:29.518029 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-d81228f0-4261-40d7-9ae0-6c48de35fd95 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:54:29.749615 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81228f0-4261-40d7-9ae0-6c48de35fd95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:54:29.751052 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81228f0-4261-40d7-9ae0-6c48de35fd95 service neutron] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:54:29.769476 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 730/1464] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 21:54:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:54:31.761899 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72b977f-e75b-48ce-a22e-071b326f7cf4 None None] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:54:31.762732 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72b977f-e75b-48ce-a22e-071b326f7cf4 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:54:31.762853 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72b977f-e75b-48ce-a22e-071b326f7cf4 None None] PATH_INFO: `/` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:54:31.764624 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 735/1465] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 21:54:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:54:31.769941 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21087d36-e293-4b90-bd4e-148053a2ff76 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:54:31.770395 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21087d36-e293-4b90-bd4e-148053a2ff76 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:54:31.770505 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21087d36-e293-4b90-bd4e-148053a2ff76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:54:31.835714 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-21087d36-e293-4b90-bd4e-148053a2ff76 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:54:31.836974 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-21087d36-e293-4b90-bd4e-148053a2ff76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:54:31.855151 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:54:31.938398 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 731/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 21:54:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:54:32.218862 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72b977f-e75b-48ce-a22e-071b326f7cf4 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:54:32.220402 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-e72b977f-e75b-48ce-a22e-071b326f7cf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:54:32.328260 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72b977f-e75b-48ce-a22e-071b326f7cf4 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:54:32.394807 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:54:32.401425 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a99a492-59d9-4480-9229-27ffba7fefa3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a937971ad1a4b0c8697c764f214d446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:54:32.402026 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a99a492-59d9-4480-9229-27ffba7fefa3 service neutron] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:54:32.402316 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a99a492-59d9-4480-9229-27ffba7fefa3 service neutron] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:54:32.402613 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a99a492-59d9-4480-9229-27ffba7fefa3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:54:32.413388 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-8a99a492-59d9-4480-9229-27ffba7fefa3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:54:32.513954 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a99a492-59d9-4480-9229-27ffba7fefa3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:54:32.515603 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a99a492-59d9-4480-9229-27ffba7fefa3 service neutron] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:54:32.533632 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 736/1467] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 21:54:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:54:34.455207 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e8024c-f325-48a9-8cfb-d46863bc993d None None] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:54:34.455767 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e8024c-f325-48a9-8cfb-d46863bc993d None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:54:34.455767 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e8024c-f325-48a9-8cfb-d46863bc993d None None] PATH_INFO: `/` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:54:34.457122 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 732/1468] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 21:54:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:54:34.462181 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2656f53a-e188-4c2b-b6e4-364f30789c2a None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:54:34.462633 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2656f53a-e188-4c2b-b6e4-364f30789c2a None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:54:34.462732 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2656f53a-e188-4c2b-b6e4-364f30789c2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:54:34.530211 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-2656f53a-e188-4c2b-b6e4-364f30789c2a None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:54:34.531416 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-2656f53a-e188-4c2b-b6e4-364f30789c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:54:34.578335 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:54:34.627827 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 737/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 21:54:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:54:34.908747 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e8024c-f325-48a9-8cfb-d46863bc993d None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:54:34.910273 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-63e8024c-f325-48a9-8cfb-d46863bc993d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:54:35.014267 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e8024c-f325-48a9-8cfb-d46863bc993d None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:54:35.062484 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:54:35.087558 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4980c7d-f76b-4a46-9466-5560f057e13d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a937971ad1a4b0c8697c764f214d446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:54:35.088163 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4980c7d-f76b-4a46-9466-5560f057e13d service neutron] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:54:35.088443 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4980c7d-f76b-4a46-9466-5560f057e13d service neutron] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:54:35.088752 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4980c7d-f76b-4a46-9466-5560f057e13d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:54:35.090403 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-f4980c7d-f76b-4a46-9466-5560f057e13d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:54:35.199277 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4980c7d-f76b-4a46-9466-5560f057e13d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:54:35.200901 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4980c7d-f76b-4a46-9466-5560f057e13d service neutron] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:54:35.220473 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 733/1470] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 21:54:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:54:44.626058 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=22 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:54:45.218240 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=66 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:54:54.806464 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee636c6-178c-4854-9bd1-921b5e784a9f None None] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:54:54.807042 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee636c6-178c-4854-9bd1-921b5e784a9f None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:54:54.807042 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee636c6-178c-4854-9bd1-921b5e784a9f None None] PATH_INFO: `/` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:54:54.808341 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 738/1471] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:54:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:54:54.813592 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020a4dfc-c9f8-49e7-a572-73100f1c9dbb None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:54:54.814054 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020a4dfc-c9f8-49e7-a572-73100f1c9dbb None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:54:54.814153 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020a4dfc-c9f8-49e7-a572-73100f1c9dbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:54:54.879469 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-020a4dfc-c9f8-49e7-a572-73100f1c9dbb None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:54:54.880706 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-020a4dfc-c9f8-49e7-a572-73100f1c9dbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:54:54.975990 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 734/1472] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:54:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:54:55.281164 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386d436b-a98b-46f8-814f-1da43efd6e15 None None] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:54:55.281446 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386d436b-a98b-46f8-814f-1da43efd6e15 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:54:55.281749 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386d436b-a98b-46f8-814f-1da43efd6e15 None None] PATH_INFO: `/` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:54:55.283067 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 739/1473] 10.222.0.27 () {54 vars in 967 bytes} [Thu Aug 18 21:54:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:54:55.288140 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055b84c1-fe8d-4faf-ab8f-723570246a7b None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:54:55.288428 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055b84c1-fe8d-4faf-ab8f-723570246a7b None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:54:55.288730 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055b84c1-fe8d-4faf-ab8f-723570246a7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:54:55.362569 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-055b84c1-fe8d-4faf-ab8f-723570246a7b None None] MFA Rules not processed for user `85dfef6a910547da9706d294e7d40fd0`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:54:55.363761 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-055b84c1-fe8d-4faf-ab8f-723570246a7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:54:55.384321 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:54:55.440118 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 735/1474] 10.222.0.27 () {58 vars in 1064 bytes} [Thu Aug 18 21:54:55 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:54:55.447756 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386d436b-a98b-46f8-814f-1da43efd6e15 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:54:55.449339 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-386d436b-a98b-46f8-814f-1da43efd6e15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:54:55.558960 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386d436b-a98b-46f8-814f-1da43efd6e15 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:54:55.644370 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfdd7de-7d66-4322-8691-41defb5140f1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85dfef6a910547da9706d294e7d40fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:54:55.645009 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfdd7de-7d66-4322-8691-41defb5140f1 service glance] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:54:55.645292 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfdd7de-7d66-4322-8691-41defb5140f1 service glance] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:54:55.645565 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfdd7de-7d66-4322-8691-41defb5140f1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:54:55.647170 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-5bfdd7de-7d66-4322-8691-41defb5140f1 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:54:55.702445 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:54:55.758694 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfdd7de-7d66-4322-8691-41defb5140f1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:54:55.760138 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfdd7de-7d66-4322-8691-41defb5140f1 service glance] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:54:55.779404 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 740/1475] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 21:54:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:54:57.830895 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf077381-7d6d-4d20-966c-f53ad0ce588f None None] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:54:57.831475 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf077381-7d6d-4d20-966c-f53ad0ce588f None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:54:57.831475 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf077381-7d6d-4d20-966c-f53ad0ce588f None None] PATH_INFO: `/` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:54:57.832821 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 736/1476] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:54:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:54:57.838211 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97c34b4-8acc-40da-94ce-3d9c21a4294f None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:54:57.838617 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97c34b4-8acc-40da-94ce-3d9c21a4294f None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:54:57.838735 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97c34b4-8acc-40da-94ce-3d9c21a4294f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:54:57.905448 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-e97c34b4-8acc-40da-94ce-3d9c21a4294f None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:54:57.906690 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-e97c34b4-8acc-40da-94ce-3d9c21a4294f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:54:58.004028 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 741/1477] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:54:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:54:58.278839 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf077381-7d6d-4d20-966c-f53ad0ce588f None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:54:58.280436 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-cf077381-7d6d-4d20-966c-f53ad0ce588f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:54:58.405770 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf077381-7d6d-4d20-966c-f53ad0ce588f None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:54:58.455290 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:54:58.498583 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d493521f-6feb-4ded-8d22-f6bc2866efc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:54:58.499207 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d493521f-6feb-4ded-8d22-f6bc2866efc7 admin admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:54:58.499496 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d493521f-6feb-4ded-8d22-f6bc2866efc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:54:58.499954 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d493521f-6feb-4ded-8d22-f6bc2866efc7 admin admin] PATH_INFO: `/v3/projects` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:54:58.500795 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d493521f-6feb-4ded-8d22-f6bc2866efc7 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:54:58.502963 dv-cinder-853678-3-smb devstack@keystone.service[88096]: WARNING py.warnings [None req-d493521f-6feb-4ded-8d22-f6bc2866efc7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 18 21:54:58.502963 dv-cinder-853678-3-smb devstack@keystone.service[88096]: warnings.warn(msg) Aug 18 21:54:58.502963 dv-cinder-853678-3-smb devstack@keystone.service[88096]: Aug 18 21:54:58.504166 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d493521f-6feb-4ded-8d22-f6bc2866efc7 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:54:58.523885 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 737/1478] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 18 21:54:58 2022] GET /identity/v3/projects => generated 2553 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:55:00.435358 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e41c3fe-74a3-403c-9fa2-e67feddbd0b4 None None] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:55:00.435917 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e41c3fe-74a3-403c-9fa2-e67feddbd0b4 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:55:00.436043 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e41c3fe-74a3-403c-9fa2-e67feddbd0b4 None None] PATH_INFO: `/` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:55:00.437414 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 742/1479] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:55:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:55:00.442613 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52aa3e5-0a80-45df-b97b-e773c97e3aa3 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:55:00.443068 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52aa3e5-0a80-45df-b97b-e773c97e3aa3 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:55:00.443181 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52aa3e5-0a80-45df-b97b-e773c97e3aa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:55:00.510019 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-a52aa3e5-0a80-45df-b97b-e773c97e3aa3 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:55:00.511238 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-a52aa3e5-0a80-45df-b97b-e773c97e3aa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:55:00.608671 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 738/1480] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:55:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:55:00.902229 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e41c3fe-74a3-403c-9fa2-e67feddbd0b4 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:55:00.903788 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-2e41c3fe-74a3-403c-9fa2-e67feddbd0b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:55:00.913580 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:55:01.170861 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e41c3fe-74a3-403c-9fa2-e67feddbd0b4 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:55:01.250841 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:55:01.284034 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40ff21a-a384-46de-9379-b2daa812695e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a39cd50340184779ac589bbcb7cac9aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:55:01.284676 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40ff21a-a384-46de-9379-b2daa812695e service nova] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:55:01.284961 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40ff21a-a384-46de-9379-b2daa812695e service nova] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:55:01.285233 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40ff21a-a384-46de-9379-b2daa812695e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:55:01.286934 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-c40ff21a-a384-46de-9379-b2daa812695e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:55:01.378763 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40ff21a-a384-46de-9379-b2daa812695e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:55:01.380371 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40ff21a-a384-46de-9379-b2daa812695e service nova] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:55:01.399054 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 743/1481] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 21:55:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:55:03.519479 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4cb022-c1be-4a38-8ca5-69466a158b92 None None] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:55:03.520045 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4cb022-c1be-4a38-8ca5-69466a158b92 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:55:03.520155 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4cb022-c1be-4a38-8ca5-69466a158b92 None None] PATH_INFO: `/` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:55:03.521594 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 739/1482] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:55:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:55:03.526870 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228f01fe-e96e-4579-84f2-721314f9a47c None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:55:03.527296 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228f01fe-e96e-4579-84f2-721314f9a47c None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:55:03.527413 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228f01fe-e96e-4579-84f2-721314f9a47c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:55:03.599419 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-228f01fe-e96e-4579-84f2-721314f9a47c None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:55:03.600546 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-228f01fe-e96e-4579-84f2-721314f9a47c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:55:03.647215 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:55:03.697795 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 744/1483] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:55:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:55:03.982096 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4cb022-c1be-4a38-8ca5-69466a158b92 None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:55:03.984048 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-9b4cb022-c1be-4a38-8ca5-69466a158b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:55:04.007731 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:55:04.089455 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4cb022-c1be-4a38-8ca5-69466a158b92 None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:55:04.161451 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7d877c-86fd-4dbb-8d16-c054122e0d58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a937971ad1a4b0c8697c764f214d446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:55:04.162051 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7d877c-86fd-4dbb-8d16-c054122e0d58 service neutron] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:55:04.162324 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7d877c-86fd-4dbb-8d16-c054122e0d58 service neutron] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:55:04.162589 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7d877c-86fd-4dbb-8d16-c054122e0d58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:55:04.164183 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-6d7d877c-86fd-4dbb-8d16-c054122e0d58 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:55:04.241867 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:55:04.276897 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7d877c-86fd-4dbb-8d16-c054122e0d58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:55:04.278387 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7d877c-86fd-4dbb-8d16-c054122e0d58 service neutron] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:55:04.298157 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 740/1484] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 21:55:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:55:06.272077 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0124ddc1-1f53-48f0-b647-2236d4f700e3 None None] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:55:06.272637 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0124ddc1-1f53-48f0-b647-2236d4f700e3 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:55:06.272637 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0124ddc1-1f53-48f0-b647-2236d4f700e3 None None] PATH_INFO: `/` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:55:06.274008 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 745/1485] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:55:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:55:06.279974 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926d00ff-88f8-45eb-9b3e-97a5db5281d7 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:55:06.280398 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926d00ff-88f8-45eb-9b3e-97a5db5281d7 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:55:06.280503 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926d00ff-88f8-45eb-9b3e-97a5db5281d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:55:06.345387 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-926d00ff-88f8-45eb-9b3e-97a5db5281d7 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:55:06.346583 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-926d00ff-88f8-45eb-9b3e-97a5db5281d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:55:06.444935 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 741/1486] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:55:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:55:06.736149 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0124ddc1-1f53-48f0-b647-2236d4f700e3 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:55:06.737927 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-0124ddc1-1f53-48f0-b647-2236d4f700e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:55:06.840736 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0124ddc1-1f53-48f0-b647-2236d4f700e3 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:55:06.913296 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:55:06.914911 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91191c2-3899-4ea5-b8b9-4cd871186c6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a937971ad1a4b0c8697c764f214d446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:55:06.915546 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91191c2-3899-4ea5-b8b9-4cd871186c6d service neutron] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:55:06.915827 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91191c2-3899-4ea5-b8b9-4cd871186c6d service neutron] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:55:06.916101 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91191c2-3899-4ea5-b8b9-4cd871186c6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:55:06.917747 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-d91191c2-3899-4ea5-b8b9-4cd871186c6d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:55:07.024638 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91191c2-3899-4ea5-b8b9-4cd871186c6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:55:07.026064 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91191c2-3899-4ea5-b8b9-4cd871186c6d service neutron] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:55:07.044239 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 746/1487] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 21:55:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:55:09.092781 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2513337-645c-48ed-9560-d65aab8b85c4 None None] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:55:09.093405 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2513337-645c-48ed-9560-d65aab8b85c4 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:55:09.093405 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2513337-645c-48ed-9560-d65aab8b85c4 None None] PATH_INFO: `/` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:55:09.094742 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 742/1488] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:55:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:55:09.099883 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee25fb6b-9182-4558-ba9d-095c19b11e82 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:55:09.100295 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee25fb6b-9182-4558-ba9d-095c19b11e82 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:55:09.100439 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee25fb6b-9182-4558-ba9d-095c19b11e82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:55:09.166820 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-ee25fb6b-9182-4558-ba9d-095c19b11e82 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:55:09.168034 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-ee25fb6b-9182-4558-ba9d-095c19b11e82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:55:09.222037 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:55:09.266583 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 747/1489] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:55:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:55:09.562987 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2513337-645c-48ed-9560-d65aab8b85c4 None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:55:09.564554 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-a2513337-645c-48ed-9560-d65aab8b85c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:55:09.600235 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:55:09.668153 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2513337-645c-48ed-9560-d65aab8b85c4 None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:55:09.740402 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3164070-b0cf-45ce-a9c7-0bee2fdfeea4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a937971ad1a4b0c8697c764f214d446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:55:09.741030 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3164070-b0cf-45ce-a9c7-0bee2fdfeea4 service neutron] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:55:09.741309 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3164070-b0cf-45ce-a9c7-0bee2fdfeea4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:55:09.741579 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3164070-b0cf-45ce-a9c7-0bee2fdfeea4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:55:09.743185 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-c3164070-b0cf-45ce-a9c7-0bee2fdfeea4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:55:09.830844 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:55:09.853336 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3164070-b0cf-45ce-a9c7-0bee2fdfeea4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:55:09.854579 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3164070-b0cf-45ce-a9c7-0bee2fdfeea4 service neutron] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:55:09.873543 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 743/1490] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 21:55:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:55:12.171791 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4053ecdf-ab60-43e2-83e3-2c9c9f9cadc9 None None] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:55:12.172357 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4053ecdf-ab60-43e2-83e3-2c9c9f9cadc9 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:55:12.172357 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4053ecdf-ab60-43e2-83e3-2c9c9f9cadc9 None None] PATH_INFO: `/` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:55:12.173727 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 748/1491] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 18 21:55:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:55:12.178931 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89a00be-c595-4c50-8aa8-b018b147925f None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:55:12.179396 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89a00be-c595-4c50-8aa8-b018b147925f None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:55:12.179505 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89a00be-c595-4c50-8aa8-b018b147925f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:55:12.245287 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-c89a00be-c595-4c50-8aa8-b018b147925f None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:55:12.246504 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-c89a00be-c595-4c50-8aa8-b018b147925f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:55:12.344664 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 744/1492] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 18 21:55:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:55:12.632424 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4053ecdf-ab60-43e2-83e3-2c9c9f9cadc9 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:55:12.634036 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-4053ecdf-ab60-43e2-83e3-2c9c9f9cadc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:55:12.740393 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4053ecdf-ab60-43e2-83e3-2c9c9f9cadc9 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:55:12.818734 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3e08d0-29f9-4920-be4f-9889607e6016 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a937971ad1a4b0c8697c764f214d446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:55:12.819332 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3e08d0-29f9-4920-be4f-9889607e6016 service neutron] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:55:12.819613 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3e08d0-29f9-4920-be4f-9889607e6016 service neutron] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:55:12.819886 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3e08d0-29f9-4920-be4f-9889607e6016 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:55:12.821515 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-7b3e08d0-29f9-4920-be4f-9889607e6016 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:55:12.831097 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:55:12.941800 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3e08d0-29f9-4920-be4f-9889607e6016 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:55:12.943287 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3e08d0-29f9-4920-be4f-9889607e6016 service neutron] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:55:12.963075 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 749/1493] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 21:55:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:55:22.342890 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=82 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:55:22.960617 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=50 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:56:43.474006 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4306efc-3b57-445f-99ec-f6f6b4cd9c2e None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:56:43.474597 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4306efc-3b57-445f-99ec-f6f6b4cd9c2e None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:56:43.474597 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4306efc-3b57-445f-99ec-f6f6b4cd9c2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:56:43.549643 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-d4306efc-3b57-445f-99ec-f6f6b4cd9c2e None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:56:43.550767 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-d4306efc-3b57-445f-99ec-f6f6b4cd9c2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:56:43.646435 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 745/1494] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 21:56:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:56:43.654550 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b9665d-d662-4d27-b385-7a7a27ddf329 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:56:43.655044 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b9665d-d662-4d27-b385-7a7a27ddf329 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:56:43.655154 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b9665d-d662-4d27-b385-7a7a27ddf329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:56:43.728352 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-73b9665d-d662-4d27-b385-7a7a27ddf329 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:56:43.729608 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-73b9665d-d662-4d27-b385-7a7a27ddf329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:56:43.829398 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 750/1495] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 21:56:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:56:43.834220 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4306efc-3b57-445f-99ec-f6f6b4cd9c2e None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:56:43.835579 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-d4306efc-3b57-445f-99ec-f6f6b4cd9c2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:56:43.847090 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4306efc-3b57-445f-99ec-f6f6b4cd9c2e None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:56:43.910388 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:56:43.945321 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73fb6c3-7682-4352-b006-7517e86362c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:56:43.945930 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73fb6c3-7682-4352-b006-7517e86362c9 admin admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:56:43.946202 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73fb6c3-7682-4352-b006-7517e86362c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:56:43.946589 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73fb6c3-7682-4352-b006-7517e86362c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:56:43.947153 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73fb6c3-7682-4352-b006-7517e86362c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:56:43.947823 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73fb6c3-7682-4352-b006-7517e86362c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:56:43.949429 dv-cinder-853678-3-smb devstack@keystone.service[88096]: WARNING py.warnings [None req-c73fb6c3-7682-4352-b006-7517e86362c9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 21:56:43.949429 dv-cinder-853678-3-smb devstack@keystone.service[88096]: warnings.warn(msg) Aug 18 21:56:43.949429 dv-cinder-853678-3-smb devstack@keystone.service[88096]: Aug 18 21:56:43.950444 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73fb6c3-7682-4352-b006-7517e86362c9 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:56:43.962293 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 746/1496] 10.222.0.27 () {58 vars in 1153 bytes} [Thu Aug 18 21:56:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:56:43.971126 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b9665d-d662-4d27-b385-7a7a27ddf329 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:56:43.980163 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b9665d-d662-4d27-b385-7a7a27ddf329 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:56:44.040690 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:56:44.074176 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98de6e2d-205a-4338-9f92-5cc7416759e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:56:44.074947 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98de6e2d-205a-4338-9f92-5cc7416759e9 admin admin] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:56:44.075288 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98de6e2d-205a-4338-9f92-5cc7416759e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:56:44.075690 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98de6e2d-205a-4338-9f92-5cc7416759e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:56:44.076393 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98de6e2d-205a-4338-9f92-5cc7416759e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:56:44.078563 dv-cinder-853678-3-smb devstack@keystone.service[88097]: WARNING py.warnings [None req-98de6e2d-205a-4338-9f92-5cc7416759e9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 18 21:56:44.078563 dv-cinder-853678-3-smb devstack@keystone.service[88097]: warnings.warn(msg) Aug 18 21:56:44.078563 dv-cinder-853678-3-smb devstack@keystone.service[88097]: Aug 18 21:56:44.080096 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98de6e2d-205a-4338-9f92-5cc7416759e9 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:56:44.221953 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 751/1497] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 18 21:56:43 2022] POST /identity/v3/projects => generated 377 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:56:44.226178 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73fb6c3-7682-4352-b006-7517e86362c9 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:56:44.227722 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-c73fb6c3-7682-4352-b006-7517e86362c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:56:44.262751 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73fb6c3-7682-4352-b006-7517e86362c9 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:56:44.357276 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9c61a4-d27a-44e5-a966-85a037c86679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:56:44.357811 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9c61a4-d27a-44e5-a966-85a037c86679 admin admin] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:56:44.358089 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9c61a4-d27a-44e5-a966-85a037c86679 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:56:44.358356 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9c61a4-d27a-44e5-a966-85a037c86679 admin admin] PATH_INFO: `/v3/users` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:56:44.358992 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9c61a4-d27a-44e5-a966-85a037c86679 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:56:44.359998 dv-cinder-853678-3-smb devstack@keystone.service[88096]: WARNING py.warnings [None req-cb9c61a4-d27a-44e5-a966-85a037c86679 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 18 21:56:44.359998 dv-cinder-853678-3-smb devstack@keystone.service[88096]: warnings.warn(msg) Aug 18 21:56:44.359998 dv-cinder-853678-3-smb devstack@keystone.service[88096]: Aug 18 21:56:44.361797 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9c61a4-d27a-44e5-a966-85a037c86679 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:56:44.482817 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 747/1498] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 18 21:56:44 2022] POST /identity/v3/users => generated 289 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:56:44.487717 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98de6e2d-205a-4338-9f92-5cc7416759e9 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:56:44.489331 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-98de6e2d-205a-4338-9f92-5cc7416759e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:56:44.552066 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98de6e2d-205a-4338-9f92-5cc7416759e9 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:56:44.632925 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:56:44.643323 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79d08e1-8bc3-483b-a003-5ffb47e76f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:56:44.649600 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79d08e1-8bc3-483b-a003-5ffb47e76f21 admin admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:56:44.649600 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79d08e1-8bc3-483b-a003-5ffb47e76f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:56:44.649600 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79d08e1-8bc3-483b-a003-5ffb47e76f21 admin admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:56:44.649600 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79d08e1-8bc3-483b-a003-5ffb47e76f21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:56:44.649600 dv-cinder-853678-3-smb devstack@keystone.service[88097]: WARNING py.warnings [None req-a79d08e1-8bc3-483b-a003-5ffb47e76f21 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 21:56:44.649600 dv-cinder-853678-3-smb devstack@keystone.service[88097]: warnings.warn(msg) Aug 18 21:56:44.649600 dv-cinder-853678-3-smb devstack@keystone.service[88097]: Aug 18 21:56:44.650173 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79d08e1-8bc3-483b-a003-5ffb47e76f21 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:56:44.659366 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 752/1499] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 21:56:44 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:56:44.663456 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9c61a4-d27a-44e5-a966-85a037c86679 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:56:44.665020 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-cb9c61a4-d27a-44e5-a966-85a037c86679 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:56:44.677262 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9c61a4-d27a-44e5-a966-85a037c86679 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:56:44.702865 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:56:44.773849 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e936fa5-6c52-4561-9a0c-9021c4e50046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:56:44.774491 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e936fa5-6c52-4561-9a0c-9021c4e50046 admin admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:56:44.774768 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e936fa5-6c52-4561-9a0c-9021c4e50046 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:56:44.775034 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e936fa5-6c52-4561-9a0c-9021c4e50046 admin admin] PATH_INFO: `/v3/roles` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:56:44.775672 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e936fa5-6c52-4561-9a0c-9021c4e50046 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:56:44.776706 dv-cinder-853678-3-smb devstack@keystone.service[88096]: WARNING py.warnings [None req-3e936fa5-6c52-4561-9a0c-9021c4e50046 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 21:56:44.776706 dv-cinder-853678-3-smb devstack@keystone.service[88096]: warnings.warn(msg) Aug 18 21:56:44.776706 dv-cinder-853678-3-smb devstack@keystone.service[88096]: Aug 18 21:56:44.777593 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e936fa5-6c52-4561-9a0c-9021c4e50046 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:56:44.790299 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 748/1500] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 21:56:44 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:56:44.794553 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79d08e1-8bc3-483b-a003-5ffb47e76f21 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:56:44.796142 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-a79d08e1-8bc3-483b-a003-5ffb47e76f21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:56:44.831259 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79d08e1-8bc3-483b-a003-5ffb47e76f21 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:56:44.922830 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eabff5-7a8b-42d3-9b10-f1e55c7d24fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:56:44.923503 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eabff5-7a8b-42d3-9b10-f1e55c7d24fb admin admin] REQUEST_METHOD: `PUT` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:56:44.923739 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eabff5-7a8b-42d3-9b10-f1e55c7d24fb admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:56:44.924016 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eabff5-7a8b-42d3-9b10-f1e55c7d24fb admin admin] PATH_INFO: `/v3/projects/a141dae22d094c33b0d4e6add6de50e3/users/916d682d5dc3419bac6e800b3f238c1f/roles/de8f2438056f4af9879423f8a59e0e0b` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:56:44.945921 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9eabff5-7a8b-42d3-9b10-f1e55c7d24fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=a141dae22d094c33b0d4e6add6de50e3, user_id=916d682d5dc3419bac6e800b3f238c1f, role_id=de8f2438056f4af9879423f8a59e0e0b)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:56:44.946950 dv-cinder-853678-3-smb devstack@keystone.service[88097]: WARNING py.warnings [None req-a9eabff5-7a8b-42d3-9b10-f1e55c7d24fb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 18 21:56:44.946950 dv-cinder-853678-3-smb devstack@keystone.service[88097]: warnings.warn(msg) Aug 18 21:56:44.946950 dv-cinder-853678-3-smb devstack@keystone.service[88097]: Aug 18 21:56:44.949011 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9eabff5-7a8b-42d3-9b10-f1e55c7d24fb admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:56:45.022638 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 753/1501] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 18 21:56:44 2022] PUT /identity/v3/projects/a141dae22d094c33b0d4e6add6de50e3/users/916d682d5dc3419bac6e800b3f238c1f/roles/de8f2438056f4af9879423f8a59e0e0b => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:56:45.035406 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aec24a7-5676-40a3-85e4-a8c9454de846 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:56:45.035694 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aec24a7-5676-40a3-85e4-a8c9454de846 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:56:45.035967 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aec24a7-5676-40a3-85e4-a8c9454de846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:56:45.091282 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-6aec24a7-5676-40a3-85e4-a8c9454de846 None None] MFA Rules not processed for user `916d682d5dc3419bac6e800b3f238c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:56:45.092480 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-6aec24a7-5676-40a3-85e4-a8c9454de846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:56:45.172125 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 749/1502] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 21:56:45 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:56:45.185236 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7a1e15-af80-4c7e-92a2-3960b830838c None None] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:56:45.185534 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7a1e15-af80-4c7e-92a2-3960b830838c None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:56:45.185809 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7a1e15-af80-4c7e-92a2-3960b830838c None None] PATH_INFO: `/` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:56:45.187159 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 754/1503] 10.222.0.27 () {54 vars in 964 bytes} [Thu Aug 18 21:56:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:56:45.191936 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8af5db-cf29-4060-99cf-06459548d316 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:56:45.192242 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8af5db-cf29-4060-99cf-06459548d316 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:56:45.192505 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8af5db-cf29-4060-99cf-06459548d316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:56:45.223804 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:56:45.268887 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-1e8af5db-cf29-4060-99cf-06459548d316 None None] MFA Rules not processed for user `22b6a7c36f8a4795a75271b8079821c7`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:56:45.270139 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-1e8af5db-cf29-4060-99cf-06459548d316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:56:45.345722 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 750/1504] 10.222.0.27 () {58 vars in 1061 bytes} [Thu Aug 18 21:56:45 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:56:45.353499 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7a1e15-af80-4c7e-92a2-3960b830838c None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:56:45.355068 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-1e7a1e15-af80-4c7e-92a2-3960b830838c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:56:45.405487 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:56:45.458341 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7a1e15-af80-4c7e-92a2-3960b830838c None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:56:45.533850 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f2b1e5-6a9c-4160-84c6-bf13bddbd170 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22b6a7c36f8a4795a75271b8079821c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:56:45.534478 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f2b1e5-6a9c-4160-84c6-bf13bddbd170 service cinder] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:56:45.534741 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f2b1e5-6a9c-4160-84c6-bf13bddbd170 service cinder] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:56:45.535013 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f2b1e5-6a9c-4160-84c6-bf13bddbd170 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:56:45.536710 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-23f2b1e5-6a9c-4160-84c6-bf13bddbd170 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:56:45.634838 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f2b1e5-6a9c-4160-84c6-bf13bddbd170 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:56:45.636270 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f2b1e5-6a9c-4160-84c6-bf13bddbd170 service cinder] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:56:45.639758 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:56:45.654619 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 755/1505] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 21:56:45 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:56:45.700059 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a96b06-5cb7-41b3-b6fc-7c7abffed084 None None] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:56:45.700457 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a96b06-5cb7-41b3-b6fc-7c7abffed084 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:56:45.700661 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a96b06-5cb7-41b3-b6fc-7c7abffed084 None None] PATH_INFO: `/` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:56:45.701917 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 751/1506] 10.222.0.27 () {52 vars in 830 bytes} [Thu Aug 18 21:56:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:56:45.705663 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f2b1e5-6a9c-4160-84c6-bf13bddbd170 service cinder] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:56:45.706866 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-23f2b1e5-6a9c-4160-84c6-bf13bddbd170 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:56:45.806615 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f2b1e5-6a9c-4160-84c6-bf13bddbd170 service cinder] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:56:45.900199 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab0a4e0-a743-490e-8af7-bffa75e8168f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:56:45.900850 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab0a4e0-a743-490e-8af7-bffa75e8168f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:56:45.901131 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab0a4e0-a743-490e-8af7-bffa75e8168f admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:56:45.901404 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab0a4e0-a743-490e-8af7-bffa75e8168f admin admin] PATH_INFO: `/v3/users/916d682d5dc3419bac6e800b3f238c1f` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:56:45.913969 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab0a4e0-a743-490e-8af7-bffa75e8168f admin admin] RBAC: Authorizing `identity:delete_user(user_id=916d682d5dc3419bac6e800b3f238c1f)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:56:45.915011 dv-cinder-853678-3-smb devstack@keystone.service[88097]: WARNING py.warnings [None req-9ab0a4e0-a743-490e-8af7-bffa75e8168f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 18 21:56:45.915011 dv-cinder-853678-3-smb devstack@keystone.service[88097]: warnings.warn(msg) Aug 18 21:56:45.915011 dv-cinder-853678-3-smb devstack@keystone.service[88097]: Aug 18 21:56:45.916218 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab0a4e0-a743-490e-8af7-bffa75e8168f admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:56:45.925763 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:56:46.120934 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-9ab0a4e0-a743-490e-8af7-bffa75e8168f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '916d682d5dc3419bac6e800b3f238c1f'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:56:46.134516 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-9ab0a4e0-a743-490e-8af7-bffa75e8168f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '916d682d5dc3419bac6e800b3f238c1f'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:56:46.135065 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-9ab0a4e0-a743-490e-8af7-bffa75e8168f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '916d682d5dc3419bac6e800b3f238c1f'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:56:46.163257 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-9ab0a4e0-a743-490e-8af7-bffa75e8168f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '916d682d5dc3419bac6e800b3f238c1f'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:56:46.237400 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-9ab0a4e0-a743-490e-8af7-bffa75e8168f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '916d682d5dc3419bac6e800b3f238c1f'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:56:46.243288 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 756/1507] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 18 21:56:45 2022] DELETE /identity/v3/users/916d682d5dc3419bac6e800b3f238c1f => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:56:46.247718 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cb1e00-5514-4c28-8116-34a04b82ce27 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:56:46.248005 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cb1e00-5514-4c28-8116-34a04b82ce27 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:56:46.248280 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cb1e00-5514-4c28-8116-34a04b82ce27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:56:46.305450 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-d7cb1e00-5514-4c28-8116-34a04b82ce27 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:56:46.306649 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-d7cb1e00-5514-4c28-8116-34a04b82ce27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:56:46.381220 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:56:46.394034 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 752/1508] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 21:56:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 21:56:46.404435 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab0a4e0-a743-490e-8af7-bffa75e8168f admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:56:46.405682 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-9ab0a4e0-a743-490e-8af7-bffa75e8168f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:56:46.508496 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab0a4e0-a743-490e-8af7-bffa75e8168f admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:56:46.563639 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:56:46.583071 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32327ed-299a-46bb-ae12-baf7885c219a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a937971ad1a4b0c8697c764f214d446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:56:46.583684 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32327ed-299a-46bb-ae12-baf7885c219a service neutron] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:56:46.584019 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32327ed-299a-46bb-ae12-baf7885c219a service neutron] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:56:46.584293 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32327ed-299a-46bb-ae12-baf7885c219a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:56:46.585967 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-c32327ed-299a-46bb-ae12-baf7885c219a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:56:46.696265 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32327ed-299a-46bb-ae12-baf7885c219a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:56:46.697756 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32327ed-299a-46bb-ae12-baf7885c219a service neutron] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:56:46.716090 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 757/1509] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 21:56:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:56:47.176883 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cb1e00-5514-4c28-8116-34a04b82ce27 None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:56:47.178192 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-d7cb1e00-5514-4c28-8116-34a04b82ce27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:56:47.190765 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cb1e00-5514-4c28-8116-34a04b82ce27 None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:56:47.291488 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1af83c-be91-4643-b89c-bbec449486df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:56:47.292126 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1af83c-be91-4643-b89c-bbec449486df admin admin] REQUEST_METHOD: `DELETE` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:56:47.292402 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1af83c-be91-4643-b89c-bbec449486df admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:56:47.292695 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1af83c-be91-4643-b89c-bbec449486df admin admin] PATH_INFO: `/v3/projects/a141dae22d094c33b0d4e6add6de50e3` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:56:47.302907 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1af83c-be91-4643-b89c-bbec449486df admin admin] RBAC: Authorizing `identity:delete_project(project_id=a141dae22d094c33b0d4e6add6de50e3)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:56:47.303934 dv-cinder-853678-3-smb devstack@keystone.service[88096]: WARNING py.warnings [None req-7c1af83c-be91-4643-b89c-bbec449486df admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 18 21:56:47.303934 dv-cinder-853678-3-smb devstack@keystone.service[88096]: warnings.warn(msg) Aug 18 21:56:47.303934 dv-cinder-853678-3-smb devstack@keystone.service[88096]: Aug 18 21:56:47.305186 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1af83c-be91-4643-b89c-bbec449486df admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:56:47.412631 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-7c1af83c-be91-4643-b89c-bbec449486df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a141dae22d094c33b0d4e6add6de50e3', 'request_id': 'req-7c1af83c-be91-4643-b89c-bbec449486df'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:56:47.418575 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-7c1af83c-be91-4643-b89c-bbec449486df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a141dae22d094c33b0d4e6add6de50e3', 'request_id': 'req-7c1af83c-be91-4643-b89c-bbec449486df'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:56:47.482239 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-7c1af83c-be91-4643-b89c-bbec449486df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a141dae22d094c33b0d4e6add6de50e3', 'request_id': 'req-7c1af83c-be91-4643-b89c-bbec449486df'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:56:47.514574 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-7c1af83c-be91-4643-b89c-bbec449486df admin admin] The token cache is being invalidate because project a141dae22d094c33b0d4e6add6de50e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88096) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 21:56:47.514859 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-7c1af83c-be91-4643-b89c-bbec449486df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:56:47.515288 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-7c1af83c-be91-4643-b89c-bbec449486df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:56:47.516997 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 753/1510] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 18 21:56:47 2022] DELETE /identity/v3/projects/a141dae22d094c33b0d4e6add6de50e3 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:56:56.713868 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=62 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:56:57.512545 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:58:26.453224 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fd3380-f1b2-4323-a399-2e74d8c49327 None None] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:58:26.453828 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fd3380-f1b2-4323-a399-2e74d8c49327 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:58:26.453828 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fd3380-f1b2-4323-a399-2e74d8c49327 None None] PATH_INFO: `/` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:58:26.455115 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 758/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 18 21:58:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:58:26.460137 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d7918e-69fc-48cc-a48c-27eb7f6acea4 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:58:26.460549 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d7918e-69fc-48cc-a48c-27eb7f6acea4 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:58:26.460712 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d7918e-69fc-48cc-a48c-27eb7f6acea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:58:26.542181 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-65d7918e-69fc-48cc-a48c-27eb7f6acea4 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:58:26.543891 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-65d7918e-69fc-48cc-a48c-27eb7f6acea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:58:26.645348 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 754/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 18 21:58:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:58:26.804617 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fd3380-f1b2-4323-a399-2e74d8c49327 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:58:26.806718 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-24fd3380-f1b2-4323-a399-2e74d8c49327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:58:26.926296 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fd3380-f1b2-4323-a399-2e74d8c49327 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:58:26.932051 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3e5d7d-b98a-456f-8e45-5a3fea598ba2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a39cd50340184779ac589bbcb7cac9aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:58:26.932675 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3e5d7d-b98a-456f-8e45-5a3fea598ba2 service nova] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:58:26.932952 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3e5d7d-b98a-456f-8e45-5a3fea598ba2 service nova] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:58:26.933222 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3e5d7d-b98a-456f-8e45-5a3fea598ba2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:58:26.941645 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3e5d7d-b98a-456f-8e45-5a3fea598ba2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:58:26.943242 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3e5d7d-b98a-456f-8e45-5a3fea598ba2 service nova] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:58:26.953034 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 759/1513] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 21:58:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:58:27.782867 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a6f28c-720b-4b4f-a3f1-af51ef4a29b9 None None] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:58:27.783446 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a6f28c-720b-4b4f-a3f1-af51ef4a29b9 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:58:27.783446 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a6f28c-720b-4b4f-a3f1-af51ef4a29b9 None None] PATH_INFO: `/` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:58:27.784807 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 755/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 18 21:58:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:58:27.789690 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7017882-ecc6-4845-b897-472d96ebc66d None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:58:27.790134 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7017882-ecc6-4845-b897-472d96ebc66d None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:58:27.790245 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7017882-ecc6-4845-b897-472d96ebc66d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:58:27.810071 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-c7017882-ecc6-4845-b897-472d96ebc66d None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:58:27.811279 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-c7017882-ecc6-4845-b897-472d96ebc66d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:58:27.819216 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 760/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 18 21:58:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:58:27.910542 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3555675e-b1e1-4a22-9459-8f881083c8de None None] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:58:27.910858 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3555675e-b1e1-4a22-9459-8f881083c8de None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:58:27.911135 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3555675e-b1e1-4a22-9459-8f881083c8de None None] PATH_INFO: `/v3` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:58:27.912409 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 756/1516] 10.222.0.84 () {54 vars in 925 bytes} [Thu Aug 18 21:58:27 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:58:27.919498 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb4b6b2-473f-4cb8-a6dd-c052d58decff None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:58:27.919782 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb4b6b2-473f-4cb8-a6dd-c052d58decff None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:58:27.920169 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb4b6b2-473f-4cb8-a6dd-c052d58decff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:58:27.971411 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3555675e-b1e1-4a22-9459-8f881083c8de None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:58:27.979194 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-6bb4b6b2-473f-4cb8-a6dd-c052d58decff None None] MFA Rules not processed for user `b44c0cf2d8b34f3e81c59d19eedbdfcc`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:58:27.981291 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-6bb4b6b2-473f-4cb8-a6dd-c052d58decff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:58:27.986468 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3555675e-b1e1-4a22-9459-8f881083c8de None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:58:27.992070 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155822e0-d149-4f3b-971c-2f4aafc7f437 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a39cd50340184779ac589bbcb7cac9aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:58:27.992780 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155822e0-d149-4f3b-971c-2f4aafc7f437 service nova] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:58:27.993127 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155822e0-d149-4f3b-971c-2f4aafc7f437 service nova] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:58:27.993467 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155822e0-d149-4f3b-971c-2f4aafc7f437 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:58:28.002108 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155822e0-d149-4f3b-971c-2f4aafc7f437 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:58:28.003712 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155822e0-d149-4f3b-971c-2f4aafc7f437 service nova] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:58:28.013824 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 757/1517] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 21:58:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:58:28.039575 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:58:28.059074 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 761/1518] 10.222.0.84 () {58 vars in 1015 bytes} [Thu Aug 18 21:58:27 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:58:37.051574 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146657c3-a1a9-4490-841f-01510e8360a2 None None] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:58:37.052087 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146657c3-a1a9-4490-841f-01510e8360a2 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:58:37.052087 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146657c3-a1a9-4490-841f-01510e8360a2 None None] PATH_INFO: `/` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:58:37.053410 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 758/1519] 10.222.0.27 () {54 vars in 961 bytes} [Thu Aug 18 21:58:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:58:37.058378 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019a7bc7-3dcd-4b19-8bee-241af2ae35f8 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:58:37.058790 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019a7bc7-3dcd-4b19-8bee-241af2ae35f8 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:58:37.058939 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019a7bc7-3dcd-4b19-8bee-241af2ae35f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:58:37.078259 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-019a7bc7-3dcd-4b19-8bee-241af2ae35f8 None None] MFA Rules not processed for user `b44c0cf2d8b34f3e81c59d19eedbdfcc`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:58:37.079438 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-019a7bc7-3dcd-4b19-8bee-241af2ae35f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:58:37.087822 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 762/1520] 10.222.0.27 () {58 vars in 1058 bytes} [Thu Aug 18 21:58:37 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:58:37.095099 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146657c3-a1a9-4490-841f-01510e8360a2 None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:58:37.109002 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146657c3-a1a9-4490-841f-01510e8360a2 None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:58:37.113918 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df22557a-7de3-4a29-9d29-4ba92bd56486 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b44c0cf2d8b34f3e81c59d19eedbdfcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:58:37.114508 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df22557a-7de3-4a29-9d29-4ba92bd56486 service placement] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:58:37.114790 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df22557a-7de3-4a29-9d29-4ba92bd56486 service placement] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:58:37.115062 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df22557a-7de3-4a29-9d29-4ba92bd56486 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:58:37.123305 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df22557a-7de3-4a29-9d29-4ba92bd56486 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:58:37.124880 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df22557a-7de3-4a29-9d29-4ba92bd56486 service placement] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:58:37.134559 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 759/1521] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 21:58:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:58:39.245099 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cf9a8a-eaa6-4b01-bf71-51369a4fbd2d None None] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:58:39.245694 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cf9a8a-eaa6-4b01-bf71-51369a4fbd2d None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:58:39.245694 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cf9a8a-eaa6-4b01-bf71-51369a4fbd2d None None] PATH_INFO: `/` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:58:39.246983 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 763/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 18 21:58:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:58:39.251721 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9bd2fc-258c-4304-b221-c9dc9588f093 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:58:39.252122 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9bd2fc-258c-4304-b221-c9dc9588f093 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:58:39.252369 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9bd2fc-258c-4304-b221-c9dc9588f093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:58:39.272539 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-cf9bd2fc-258c-4304-b221-c9dc9588f093 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:58:39.273772 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-cf9bd2fc-258c-4304-b221-c9dc9588f093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:58:39.282227 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 760/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 18 21:58:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:58:39.435216 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cf9a8a-eaa6-4b01-bf71-51369a4fbd2d None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:58:39.449674 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cf9a8a-eaa6-4b01-bf71-51369a4fbd2d None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:58:39.456146 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696d8274-28b9-4b6e-9fca-58eb17b991e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a39cd50340184779ac589bbcb7cac9aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:58:39.456774 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696d8274-28b9-4b6e-9fca-58eb17b991e1 service nova] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:58:39.457057 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696d8274-28b9-4b6e-9fca-58eb17b991e1 service nova] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:58:39.457333 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696d8274-28b9-4b6e-9fca-58eb17b991e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:58:39.465485 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696d8274-28b9-4b6e-9fca-58eb17b991e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:58:39.468049 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696d8274-28b9-4b6e-9fca-58eb17b991e1 service nova] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:58:39.477431 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 764/1524] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 21:58:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:58:40.300529 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c85c9d7-6351-4f67-ac0b-1034f57c9511 None None] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:58:40.301043 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c85c9d7-6351-4f67-ac0b-1034f57c9511 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:58:40.301148 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c85c9d7-6351-4f67-ac0b-1034f57c9511 None None] PATH_INFO: `/` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:58:40.302463 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 761/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 18 21:58:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:58:40.307343 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f124048-1f14-4a9c-b348-4fef56e9ac98 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:58:40.307727 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f124048-1f14-4a9c-b348-4fef56e9ac98 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:58:40.307896 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f124048-1f14-4a9c-b348-4fef56e9ac98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:58:40.328449 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-2f124048-1f14-4a9c-b348-4fef56e9ac98 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:58:40.329728 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-2f124048-1f14-4a9c-b348-4fef56e9ac98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:58:40.337603 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 765/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 18 21:58:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:58:40.489833 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c85c9d7-6351-4f67-ac0b-1034f57c9511 None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:58:40.504640 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c85c9d7-6351-4f67-ac0b-1034f57c9511 None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:58:40.510149 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b7f94e-0141-4d93-b63e-92f716462b76 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a39cd50340184779ac589bbcb7cac9aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:58:40.510745 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b7f94e-0141-4d93-b63e-92f716462b76 service nova] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:58:40.511023 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b7f94e-0141-4d93-b63e-92f716462b76 service nova] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:58:40.511295 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b7f94e-0141-4d93-b63e-92f716462b76 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:58:40.520719 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b7f94e-0141-4d93-b63e-92f716462b76 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:58:40.522305 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b7f94e-0141-4d93-b63e-92f716462b76 service nova] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:58:40.532776 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 762/1527] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 21:58:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:58:44.304154 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304bf1d2-ccfb-4a80-acc3-be8853c809a3 None None] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:58:44.304715 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304bf1d2-ccfb-4a80-acc3-be8853c809a3 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:58:44.304715 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304bf1d2-ccfb-4a80-acc3-be8853c809a3 None None] PATH_INFO: `/` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:58:44.306060 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 766/1528] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 21:58:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:58:44.311203 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5775eb-acd7-4453-991a-56628b457ed6 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:58:44.311612 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5775eb-acd7-4453-991a-56628b457ed6 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:58:44.311759 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5775eb-acd7-4453-991a-56628b457ed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:58:44.330704 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-5b5775eb-acd7-4453-991a-56628b457ed6 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:58:44.331898 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-5b5775eb-acd7-4453-991a-56628b457ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:58:44.339743 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 763/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 21:58:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:58:44.638518 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304bf1d2-ccfb-4a80-acc3-be8853c809a3 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:58:44.640232 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-304bf1d2-ccfb-4a80-acc3-be8853c809a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:58:44.717352 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304bf1d2-ccfb-4a80-acc3-be8853c809a3 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:58:44.720997 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b91dae-11e4-4ffa-9fb3-908c673e897f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a937971ad1a4b0c8697c764f214d446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:58:44.721591 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b91dae-11e4-4ffa-9fb3-908c673e897f service neutron] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:58:44.721866 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b91dae-11e4-4ffa-9fb3-908c673e897f service neutron] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:58:44.722134 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b91dae-11e4-4ffa-9fb3-908c673e897f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:58:44.731141 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b91dae-11e4-4ffa-9fb3-908c673e897f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:58:44.733219 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b91dae-11e4-4ffa-9fb3-908c673e897f service neutron] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:58:44.742434 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 767/1530] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 21:58:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:58:46.634458 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63caa62-0e46-4fbb-a4c4-ed177ebab894 None None] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:58:46.635015 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63caa62-0e46-4fbb-a4c4-ed177ebab894 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:58:46.635015 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63caa62-0e46-4fbb-a4c4-ed177ebab894 None None] PATH_INFO: `/` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:58:46.636476 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 764/1531] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 21:58:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:58:46.642016 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb50ff1d-7ef3-4c96-8d05-a449c23905c5 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:58:46.642426 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb50ff1d-7ef3-4c96-8d05-a449c23905c5 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:58:46.642568 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb50ff1d-7ef3-4c96-8d05-a449c23905c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:58:46.662667 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-bb50ff1d-7ef3-4c96-8d05-a449c23905c5 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:58:46.663861 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-bb50ff1d-7ef3-4c96-8d05-a449c23905c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:58:46.672508 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 768/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 21:58:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:58:46.960074 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63caa62-0e46-4fbb-a4c4-ed177ebab894 None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:58:46.971692 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63caa62-0e46-4fbb-a4c4-ed177ebab894 None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:58:46.975166 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc512624-d815-4571-b335-5e7e11140f17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a937971ad1a4b0c8697c764f214d446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:58:46.975761 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc512624-d815-4571-b335-5e7e11140f17 service neutron] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:58:46.976038 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc512624-d815-4571-b335-5e7e11140f17 service neutron] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:58:46.976307 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc512624-d815-4571-b335-5e7e11140f17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:58:46.985410 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc512624-d815-4571-b335-5e7e11140f17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:58:46.986825 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc512624-d815-4571-b335-5e7e11140f17 service neutron] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:58:46.996053 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 765/1533] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 21:58:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:58:50.510010 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80463a0b-2cd6-4568-8841-de55a6dc331c None None] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:58:50.510696 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80463a0b-2cd6-4568-8841-de55a6dc331c None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:58:50.510696 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80463a0b-2cd6-4568-8841-de55a6dc331c None None] PATH_INFO: `/` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:58:50.511910 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 769/1534] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 21:58:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:58:50.517293 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c99284d-4f16-43df-8aaf-80e83df19e08 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:58:50.517698 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c99284d-4f16-43df-8aaf-80e83df19e08 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:58:50.517848 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c99284d-4f16-43df-8aaf-80e83df19e08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:58:50.525664 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:58:50.537849 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-6c99284d-4f16-43df-8aaf-80e83df19e08 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:58:50.539047 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-6c99284d-4f16-43df-8aaf-80e83df19e08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:58:50.548365 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 766/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 21:58:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:58:51.104322 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80463a0b-2cd6-4568-8841-de55a6dc331c None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:58:51.114285 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-80463a0b-2cd6-4568-8841-de55a6dc331c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:58:51.186450 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80463a0b-2cd6-4568-8841-de55a6dc331c None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:58:51.190107 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90ba838-9506-499d-95b7-5d75f5883b2a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22b6a7c36f8a4795a75271b8079821c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:58:51.190708 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90ba838-9506-499d-95b7-5d75f5883b2a service cinder] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:58:51.190987 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90ba838-9506-499d-95b7-5d75f5883b2a service cinder] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:58:51.191264 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90ba838-9506-499d-95b7-5d75f5883b2a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:58:51.200242 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90ba838-9506-499d-95b7-5d75f5883b2a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:58:51.202612 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90ba838-9506-499d-95b7-5d75f5883b2a service cinder] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:58:51.211913 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 770/1536] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 21:58:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:58:53.132000 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e094b6f1-1cdf-412e-925b-e8fde4ed4022 None None] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:58:53.132562 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e094b6f1-1cdf-412e-925b-e8fde4ed4022 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:58:53.132562 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e094b6f1-1cdf-412e-925b-e8fde4ed4022 None None] PATH_INFO: `/` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:58:53.133941 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 767/1537] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 21:58:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:58:53.140783 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a46d93-1430-48f3-95e9-0e2f7026e8e6 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:58:53.141300 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a46d93-1430-48f3-95e9-0e2f7026e8e6 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:58:53.141612 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a46d93-1430-48f3-95e9-0e2f7026e8e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:58:53.161981 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-41a46d93-1430-48f3-95e9-0e2f7026e8e6 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:58:53.163255 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-41a46d93-1430-48f3-95e9-0e2f7026e8e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:58:53.172043 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 771/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 21:58:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:58:53.726343 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e094b6f1-1cdf-412e-925b-e8fde4ed4022 None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:58:53.728042 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-e094b6f1-1cdf-412e-925b-e8fde4ed4022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:58:53.741179 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e094b6f1-1cdf-412e-925b-e8fde4ed4022 None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:58:53.744741 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3363ad0d-2294-43a9-b120-f1a9795c6b35 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22b6a7c36f8a4795a75271b8079821c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:58:53.745277 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3363ad0d-2294-43a9-b120-f1a9795c6b35 service cinder] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:58:53.745557 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3363ad0d-2294-43a9-b120-f1a9795c6b35 service cinder] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:58:53.745831 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3363ad0d-2294-43a9-b120-f1a9795c6b35 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:58:53.754722 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3363ad0d-2294-43a9-b120-f1a9795c6b35 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:58:53.756136 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3363ad0d-2294-43a9-b120-f1a9795c6b35 service cinder] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:58:53.765960 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 768/1539] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 21:58:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:59:03.156810 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=92 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:59:03.761342 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=8 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:00:20.421679 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a6dd8d-066b-4b53-a35c-038665f6333e None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:20.422866 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a6dd8d-066b-4b53-a35c-038665f6333e None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:20.422866 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a6dd8d-066b-4b53-a35c-038665f6333e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:20.447020 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-33a6dd8d-066b-4b53-a35c-038665f6333e None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:00:20.448287 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-33a6dd8d-066b-4b53-a35c-038665f6333e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:00:20.464980 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 772/1540] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:00:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:00:20.474570 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29e3fde-5fc9-463f-b45a-405155a8485d None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:20.476242 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29e3fde-5fc9-463f-b45a-405155a8485d None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:20.476242 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29e3fde-5fc9-463f-b45a-405155a8485d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:20.510149 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-d29e3fde-5fc9-463f-b45a-405155a8485d None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:00:20.511906 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-d29e3fde-5fc9-463f-b45a-405155a8485d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:00:20.522536 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 769/1541] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:00:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:00:20.527506 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a6dd8d-066b-4b53-a35c-038665f6333e None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:00:20.543332 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a6dd8d-066b-4b53-a35c-038665f6333e None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:00:20.549433 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47f5fc3-7a63-452d-8c50-bc3f52a4cdf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:00:20.550081 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47f5fc3-7a63-452d-8c50-bc3f52a4cdf1 admin admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:20.550365 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47f5fc3-7a63-452d-8c50-bc3f52a4cdf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:20.550642 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47f5fc3-7a63-452d-8c50-bc3f52a4cdf1 admin admin] PATH_INFO: `/v3/domains` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:20.551323 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47f5fc3-7a63-452d-8c50-bc3f52a4cdf1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 22:00:20.551632 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47f5fc3-7a63-452d-8c50-bc3f52a4cdf1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:00:20.552724 dv-cinder-853678-3-smb devstack@keystone.service[88097]: WARNING py.warnings [None req-f47f5fc3-7a63-452d-8c50-bc3f52a4cdf1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 22:00:20.552724 dv-cinder-853678-3-smb devstack@keystone.service[88097]: warnings.warn(msg) Aug 18 22:00:20.552724 dv-cinder-853678-3-smb devstack@keystone.service[88097]: Aug 18 22:00:20.553651 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47f5fc3-7a63-452d-8c50-bc3f52a4cdf1 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:00:20.572157 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 773/1542] 10.222.0.27 () {58 vars in 1153 bytes} [Thu Aug 18 22:00:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 22:00:20.581129 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29e3fde-5fc9-463f-b45a-405155a8485d None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:00:20.592159 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29e3fde-5fc9-463f-b45a-405155a8485d None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:00:20.604765 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697a6259-ed0a-4c90-93a4-32e2987d4b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:00:20.605805 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697a6259-ed0a-4c90-93a4-32e2987d4b9d admin admin] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:20.606306 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697a6259-ed0a-4c90-93a4-32e2987d4b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:20.606806 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697a6259-ed0a-4c90-93a4-32e2987d4b9d admin admin] PATH_INFO: `/v3/projects` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:20.607962 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697a6259-ed0a-4c90-93a4-32e2987d4b9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:00:20.609871 dv-cinder-853678-3-smb devstack@keystone.service[88096]: WARNING py.warnings [None req-697a6259-ed0a-4c90-93a4-32e2987d4b9d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 18 22:00:20.609871 dv-cinder-853678-3-smb devstack@keystone.service[88096]: warnings.warn(msg) Aug 18 22:00:20.609871 dv-cinder-853678-3-smb devstack@keystone.service[88096]: Aug 18 22:00:20.611751 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697a6259-ed0a-4c90-93a4-32e2987d4b9d admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:00:20.734414 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 770/1543] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 18 22:00:20 2022] POST /identity/v3/projects => generated 391 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 22:00:20.739199 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47f5fc3-7a63-452d-8c50-bc3f52a4cdf1 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:00:20.750777 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47f5fc3-7a63-452d-8c50-bc3f52a4cdf1 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:00:20.839744 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d70af4-0704-49c3-9fed-600d7926fe64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:00:20.840292 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d70af4-0704-49c3-9fed-600d7926fe64 admin admin] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:20.840579 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d70af4-0704-49c3-9fed-600d7926fe64 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:20.840875 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d70af4-0704-49c3-9fed-600d7926fe64 admin admin] PATH_INFO: `/v3/users` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:20.841507 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d70af4-0704-49c3-9fed-600d7926fe64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:00:20.842543 dv-cinder-853678-3-smb devstack@keystone.service[88097]: WARNING py.warnings [None req-18d70af4-0704-49c3-9fed-600d7926fe64 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 18 22:00:20.842543 dv-cinder-853678-3-smb devstack@keystone.service[88097]: warnings.warn(msg) Aug 18 22:00:20.842543 dv-cinder-853678-3-smb devstack@keystone.service[88097]: Aug 18 22:00:20.844806 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d70af4-0704-49c3-9fed-600d7926fe64 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:00:20.898513 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2646d6b4-d5b9-443f-9b97-5faec21f280b None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:20.899167 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2646d6b4-d5b9-443f-9b97-5faec21f280b None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:20.899673 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2646d6b4-d5b9-443f-9b97-5faec21f280b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:20.932726 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-2646d6b4-d5b9-443f-9b97-5faec21f280b None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:00:20.934423 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-2646d6b4-d5b9-443f-9b97-5faec21f280b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:00:20.944337 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 771/1544] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:00:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 22:00:20.953248 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d222fdd-40ec-4144-ae9a-ecb3a422727a None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:20.954068 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d222fdd-40ec-4144-ae9a-ecb3a422727a None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:20.954559 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d222fdd-40ec-4144-ae9a-ecb3a422727a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:20.958758 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 774/1545] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 18 22:00:20 2022] POST /identity/v3/users => generated 296 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 22:00:20.966651 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4986c161-27b7-49eb-9924-64f36c25c924 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:20.966930 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4986c161-27b7-49eb-9924-64f36c25c924 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:20.967209 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4986c161-27b7-49eb-9924-64f36c25c924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:20.983566 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-1d222fdd-40ec-4144-ae9a-ecb3a422727a None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:00:20.985761 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-1d222fdd-40ec-4144-ae9a-ecb3a422727a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:00:21.002590 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-4986c161-27b7-49eb-9924-64f36c25c924 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:00:21.003195 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 772/1546] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:00:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 22:00:21.003760 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-4986c161-27b7-49eb-9924-64f36c25c924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:00:21.004675 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d222fdd-40ec-4144-ae9a-ecb3a422727a None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:00:21.017425 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d222fdd-40ec-4144-ae9a-ecb3a422727a None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:00:21.018979 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 775/1547] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:00:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 22:00:21.020280 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3638c7a8-0b95-4774-a377-53317eee6efa None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:21.020586 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3638c7a8-0b95-4774-a377-53317eee6efa None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:21.020858 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3638c7a8-0b95-4774-a377-53317eee6efa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:21.026738 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bebebb0-df1a-4ccd-95e7-3da10674ff39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:00:21.027391 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bebebb0-df1a-4ccd-95e7-3da10674ff39 admin admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:21.027674 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bebebb0-df1a-4ccd-95e7-3da10674ff39 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:21.027947 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bebebb0-df1a-4ccd-95e7-3da10674ff39 admin admin] PATH_INFO: `/v3/roles` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:21.028750 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bebebb0-df1a-4ccd-95e7-3da10674ff39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:00:21.030882 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bebebb0-df1a-4ccd-95e7-3da10674ff39 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:00:21.044860 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 773/1548] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:00:21 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:00:21.045655 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-3638c7a8-0b95-4774-a377-53317eee6efa None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:00:21.046273 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0238de-15b9-4803-a208-e03a87c2e22c None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:21.046740 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0238de-15b9-4803-a208-e03a87c2e22c None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:21.047243 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0238de-15b9-4803-a208-e03a87c2e22c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:21.050380 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-3638c7a8-0b95-4774-a377-53317eee6efa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:00:21.060625 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 776/1549] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:00:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:00:21.062660 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e66a58-eaaf-4d1d-a4bf-8ff6640dc44c None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:21.063055 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e66a58-eaaf-4d1d-a4bf-8ff6640dc44c None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:21.063333 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e66a58-eaaf-4d1d-a4bf-8ff6640dc44c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:21.073153 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-8f0238de-15b9-4803-a208-e03a87c2e22c None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:00:21.075426 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-8f0238de-15b9-4803-a208-e03a87c2e22c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:00:21.085915 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 774/1550] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:00:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:00:21.087231 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c22425a-d956-4aa2-8c2d-0c5cd7057912 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:21.087517 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c22425a-d956-4aa2-8c2d-0c5cd7057912 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:21.087792 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c22425a-d956-4aa2-8c2d-0c5cd7057912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:21.089010 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-b6e66a58-eaaf-4d1d-a4bf-8ff6640dc44c None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:00:21.090518 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-b6e66a58-eaaf-4d1d-a4bf-8ff6640dc44c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:00:21.100893 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 777/1551] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:00:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:00:21.101731 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e66a58-eaaf-4d1d-a4bf-8ff6640dc44c None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:00:21.108126 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-0c22425a-d956-4aa2-8c2d-0c5cd7057912 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:00:21.110753 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-0c22425a-d956-4aa2-8c2d-0c5cd7057912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:00:21.113108 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e66a58-eaaf-4d1d-a4bf-8ff6640dc44c None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:00:21.117973 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db004a02-9262-428b-bac0-eae680c22aca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:00:21.118572 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db004a02-9262-428b-bac0-eae680c22aca admin admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:21.127917 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 775/1552] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:00:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:00:21.128057 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db004a02-9262-428b-bac0-eae680c22aca admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:21.128057 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db004a02-9262-428b-bac0-eae680c22aca admin admin] PATH_INFO: `/v3/domains` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:21.128254 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c22425a-d956-4aa2-8c2d-0c5cd7057912 None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:00:21.128361 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db004a02-9262-428b-bac0-eae680c22aca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 22:00:21.128361 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db004a02-9262-428b-bac0-eae680c22aca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:00:21.128361 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db004a02-9262-428b-bac0-eae680c22aca admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:00:21.130410 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c22425a-d956-4aa2-8c2d-0c5cd7057912 None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:00:21.135586 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8133db5-97ff-491b-857c-db42f566cdda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:00:21.136317 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8133db5-97ff-491b-857c-db42f566cdda admin admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:21.136526 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8133db5-97ff-491b-857c-db42f566cdda admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:21.136805 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8133db5-97ff-491b-857c-db42f566cdda admin admin] PATH_INFO: `/v3/roles` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:21.137461 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8133db5-97ff-491b-857c-db42f566cdda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:00:21.139129 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8133db5-97ff-491b-857c-db42f566cdda admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:00:21.142254 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 778/1553] 10.222.0.27 () {58 vars in 1153 bytes} [Thu Aug 18 22:00:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 22:00:21.144411 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed989dd-774f-4961-944a-7c0304bfe9b3 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:21.144541 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed989dd-774f-4961-944a-7c0304bfe9b3 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:21.144860 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed989dd-774f-4961-944a-7c0304bfe9b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:21.153130 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 776/1554] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:00:21 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:00:21.155086 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9ada43-ab67-4ff8-b9f3-9ea9b3879e00 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:21.155622 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9ada43-ab67-4ff8-b9f3-9ea9b3879e00 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:21.156301 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9ada43-ab67-4ff8-b9f3-9ea9b3879e00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:21.172586 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-bed989dd-774f-4961-944a-7c0304bfe9b3 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:00:21.174079 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-bed989dd-774f-4961-944a-7c0304bfe9b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:00:21.179247 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-7d9ada43-ab67-4ff8-b9f3-9ea9b3879e00 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:00:21.180548 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-7d9ada43-ab67-4ff8-b9f3-9ea9b3879e00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:00:21.186603 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 779/1555] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:00:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:00:21.186603 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8e550b-8283-47a8-9a3c-4c12df4ae6d3 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:21.186603 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8e550b-8283-47a8-9a3c-4c12df4ae6d3 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:21.186603 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8e550b-8283-47a8-9a3c-4c12df4ae6d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:21.192512 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 777/1556] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:00:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:00:21.193800 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13cf89f-f466-40d9-bd23-5b6f9babd4ac None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:21.194225 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13cf89f-f466-40d9-bd23-5b6f9babd4ac None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:21.194401 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13cf89f-f466-40d9-bd23-5b6f9babd4ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:21.207249 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-4c8e550b-8283-47a8-9a3c-4c12df4ae6d3 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:00:21.208457 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-4c8e550b-8283-47a8-9a3c-4c12df4ae6d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:00:21.221629 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 780/1557] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:00:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:00:21.221629 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8e550b-8283-47a8-9a3c-4c12df4ae6d3 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:00:21.223110 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-c13cf89f-f466-40d9-bd23-5b6f9babd4ac None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:00:21.224526 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-c13cf89f-f466-40d9-bd23-5b6f9babd4ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:00:21.231291 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8e550b-8283-47a8-9a3c-4c12df4ae6d3 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:00:21.241169 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 778/1558] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:00:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:00:21.241169 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13cf89f-f466-40d9-bd23-5b6f9babd4ac None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:00:21.241439 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a7a1ac-1aa9-4908-9ee6-c558f8d1affe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:00:21.241439 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a7a1ac-1aa9-4908-9ee6-c558f8d1affe admin admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:21.241439 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a7a1ac-1aa9-4908-9ee6-c558f8d1affe admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:21.241439 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a7a1ac-1aa9-4908-9ee6-c558f8d1affe admin admin] PATH_INFO: `/v3/domains` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:21.241763 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a7a1ac-1aa9-4908-9ee6-c558f8d1affe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 22:00:21.241763 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a7a1ac-1aa9-4908-9ee6-c558f8d1affe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:00:21.243108 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a7a1ac-1aa9-4908-9ee6-c558f8d1affe admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:00:21.252264 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13cf89f-f466-40d9-bd23-5b6f9babd4ac None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:00:21.260627 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 781/1559] 10.222.0.27 () {58 vars in 1153 bytes} [Thu Aug 18 22:00:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 22:00:21.260627 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a7a1ac-1aa9-4908-9ee6-c558f8d1affe admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:00:21.260884 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60608ee9-8851-45b8-a9e7-a4639e6f79e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:00:21.260884 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60608ee9-8851-45b8-a9e7-a4639e6f79e7 admin admin] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:21.260884 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60608ee9-8851-45b8-a9e7-a4639e6f79e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:21.260884 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60608ee9-8851-45b8-a9e7-a4639e6f79e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:21.261243 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60608ee9-8851-45b8-a9e7-a4639e6f79e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:00:21.261243 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60608ee9-8851-45b8-a9e7-a4639e6f79e7 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:00:21.270454 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a7a1ac-1aa9-4908-9ee6-c558f8d1affe admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:00:21.275463 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e4d289-4258-4997-82cd-417c35111731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:00:21.276114 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e4d289-4258-4997-82cd-417c35111731 admin admin] REQUEST_METHOD: `PUT` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:21.276390 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e4d289-4258-4997-82cd-417c35111731 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:21.276685 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e4d289-4258-4997-82cd-417c35111731 admin admin] PATH_INFO: `/v3/projects/bc871498a7ce438f8e3346fedb2f6c1d/users/886cb8649faf4bbdb7e290915b6c275d/roles/de8f2438056f4af9879423f8a59e0e0b` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:21.291992 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e4d289-4258-4997-82cd-417c35111731 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc871498a7ce438f8e3346fedb2f6c1d, user_id=886cb8649faf4bbdb7e290915b6c275d, role_id=de8f2438056f4af9879423f8a59e0e0b)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:00:21.295012 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e4d289-4258-4997-82cd-417c35111731 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:00:21.369776 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 779/1560] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 18 22:00:21 2022] POST /identity/v3/projects => generated 375 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 22:00:21.372202 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60608ee9-8851-45b8-a9e7-a4639e6f79e7 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:00:21.378661 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 782/1561] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 18 22:00:21 2022] PUT /identity/v3/projects/bc871498a7ce438f8e3346fedb2f6c1d/users/886cb8649faf4bbdb7e290915b6c275d/roles/de8f2438056f4af9879423f8a59e0e0b => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:00:21.378661 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174efd9d-0431-47bb-bcf6-8a6652481d5d None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:21.378661 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174efd9d-0431-47bb-bcf6-8a6652481d5d None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:21.378661 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174efd9d-0431-47bb-bcf6-8a6652481d5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:21.396821 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-174efd9d-0431-47bb-bcf6-8a6652481d5d None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:00:21.400878 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-174efd9d-0431-47bb-bcf6-8a6652481d5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:00:21.440896 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:00:21.442691 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60608ee9-8851-45b8-a9e7-a4639e6f79e7 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:00:21.447508 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72b7901-bb40-4dc8-b5c1-f5024ce1d576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:00:21.448149 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72b7901-bb40-4dc8-b5c1-f5024ce1d576 admin admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:21.448427 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72b7901-bb40-4dc8-b5c1-f5024ce1d576 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:21.448726 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72b7901-bb40-4dc8-b5c1-f5024ce1d576 admin admin] PATH_INFO: `/v3/domains` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:21.452561 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72b7901-bb40-4dc8-b5c1-f5024ce1d576 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 22:00:21.452561 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72b7901-bb40-4dc8-b5c1-f5024ce1d576 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:00:21.452561 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72b7901-bb40-4dc8-b5c1-f5024ce1d576 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:00:21.458258 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 783/1562] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:00:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:00:21.459661 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174efd9d-0431-47bb-bcf6-8a6652481d5d None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:00:21.463876 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 780/1563] 10.222.0.27 () {58 vars in 1153 bytes} [Thu Aug 18 22:00:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 22:00:21.464758 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72b7901-bb40-4dc8-b5c1-f5024ce1d576 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:00:21.470897 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174efd9d-0431-47bb-bcf6-8a6652481d5d None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:00:21.475164 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72b7901-bb40-4dc8-b5c1-f5024ce1d576 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:00:21.476756 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb460d00-32b9-4961-9ec0-cb3d95d3f609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:00:21.481228 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb460d00-32b9-4961-9ec0-cb3d95d3f609 admin admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:21.481228 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb460d00-32b9-4961-9ec0-cb3d95d3f609 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:21.481228 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb460d00-32b9-4961-9ec0-cb3d95d3f609 admin admin] PATH_INFO: `/v3/domains` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:21.481228 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb460d00-32b9-4961-9ec0-cb3d95d3f609 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 22:00:21.481228 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb460d00-32b9-4961-9ec0-cb3d95d3f609 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:00:21.481673 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7187dd3-efec-4b87-95d2-ecd650607c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:00:21.481673 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7187dd3-efec-4b87-95d2-ecd650607c4c admin admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:21.481845 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb460d00-32b9-4961-9ec0-cb3d95d3f609 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:00:21.481927 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7187dd3-efec-4b87-95d2-ecd650607c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:21.481927 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7187dd3-efec-4b87-95d2-ecd650607c4c admin admin] PATH_INFO: `/v3/domains` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:21.481927 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7187dd3-efec-4b87-95d2-ecd650607c4c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 22:00:21.481927 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7187dd3-efec-4b87-95d2-ecd650607c4c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:00:21.483389 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7187dd3-efec-4b87-95d2-ecd650607c4c admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:00:21.492766 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 784/1564] 10.222.0.27 () {58 vars in 1153 bytes} [Thu Aug 18 22:00:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 22:00:21.493962 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215d5547-8b4b-413e-a228-36ddd048c0ac None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:21.494248 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215d5547-8b4b-413e-a228-36ddd048c0ac None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:21.494508 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215d5547-8b4b-413e-a228-36ddd048c0ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:21.503921 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 781/1565] 10.222.0.27 () {58 vars in 1153 bytes} [Thu Aug 18 22:00:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 22:00:21.503921 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7187dd3-efec-4b87-95d2-ecd650607c4c admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:00:21.513091 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7187dd3-efec-4b87-95d2-ecd650607c4c admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:00:21.518211 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5a9799-38b1-4854-a076-9e11dffc675c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:00:21.518808 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5a9799-38b1-4854-a076-9e11dffc675c admin admin] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:21.519086 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5a9799-38b1-4854-a076-9e11dffc675c admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:21.519359 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5a9799-38b1-4854-a076-9e11dffc675c admin admin] PATH_INFO: `/v3/projects` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:21.519980 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5a9799-38b1-4854-a076-9e11dffc675c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:00:21.520542 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-215d5547-8b4b-413e-a228-36ddd048c0ac None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:00:21.522016 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-215d5547-8b4b-413e-a228-36ddd048c0ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:00:21.522160 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5a9799-38b1-4854-a076-9e11dffc675c admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:00:21.530062 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 785/1566] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:00:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:00:21.531414 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215d5547-8b4b-413e-a228-36ddd048c0ac None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:00:21.542609 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215d5547-8b4b-413e-a228-36ddd048c0ac None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:00:21.547223 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accf64bd-bb00-4d31-bbb4-bda2c1308fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:00:21.551754 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accf64bd-bb00-4d31-bbb4-bda2c1308fd7 admin admin] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:21.551754 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accf64bd-bb00-4d31-bbb4-bda2c1308fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:21.551754 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accf64bd-bb00-4d31-bbb4-bda2c1308fd7 admin admin] PATH_INFO: `/v3/users` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:21.551754 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accf64bd-bb00-4d31-bbb4-bda2c1308fd7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:00:21.551754 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accf64bd-bb00-4d31-bbb4-bda2c1308fd7 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:00:21.600730 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:00:21.607956 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 782/1567] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 18 22:00:21 2022] POST /identity/v3/projects => generated 371 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 22:00:21.612264 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f9c068-ee50-442d-916f-6a520188c567 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:21.612264 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f9c068-ee50-442d-916f-6a520188c567 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:21.612264 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f9c068-ee50-442d-916f-6a520188c567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:21.632796 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-c4f9c068-ee50-442d-916f-6a520188c567 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:00:21.632959 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 786/1568] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 18 22:00:21 2022] POST /identity/v3/users => generated 288 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 22:00:21.632959 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accf64bd-bb00-4d31-bbb4-bda2c1308fd7 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:00:21.633155 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-c4f9c068-ee50-442d-916f-6a520188c567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:00:21.640580 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accf64bd-bb00-4d31-bbb4-bda2c1308fd7 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:00:21.690240 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 783/1569] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:00:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:00:21.691284 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f9c068-ee50-442d-916f-6a520188c567 None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:00:21.707965 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f9c068-ee50-442d-916f-6a520188c567 None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:00:21.708110 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215fbccc-e78f-4761-836f-6ac91c337f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:00:21.708110 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215fbccc-e78f-4761-836f-6ac91c337f9b admin admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:21.708110 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215fbccc-e78f-4761-836f-6ac91c337f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:21.708110 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215fbccc-e78f-4761-836f-6ac91c337f9b admin admin] PATH_INFO: `/v3/domains` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:21.708698 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db15337b-7d5a-481e-b2c6-47ffe1d95a3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:00:21.708802 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215fbccc-e78f-4761-836f-6ac91c337f9b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 22:00:21.708902 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db15337b-7d5a-481e-b2c6-47ffe1d95a3d admin admin] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:21.708997 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215fbccc-e78f-4761-836f-6ac91c337f9b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:00:21.709099 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db15337b-7d5a-481e-b2c6-47ffe1d95a3d admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:21.709099 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db15337b-7d5a-481e-b2c6-47ffe1d95a3d admin admin] PATH_INFO: `/v3/projects` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:21.709099 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db15337b-7d5a-481e-b2c6-47ffe1d95a3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:00:21.709387 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215fbccc-e78f-4761-836f-6ac91c337f9b admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:00:21.710215 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db15337b-7d5a-481e-b2c6-47ffe1d95a3d admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:00:21.722856 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 787/1570] 10.222.0.27 () {58 vars in 1153 bytes} [Thu Aug 18 22:00:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 22:00:21.723795 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215fbccc-e78f-4761-836f-6ac91c337f9b admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:00:21.733876 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215fbccc-e78f-4761-836f-6ac91c337f9b admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:00:21.738505 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9496de-660e-43d0-bca8-315ae7b4e079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:00:21.739092 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9496de-660e-43d0-bca8-315ae7b4e079 admin admin] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:21.739371 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9496de-660e-43d0-bca8-315ae7b4e079 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:21.739643 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9496de-660e-43d0-bca8-315ae7b4e079 admin admin] PATH_INFO: `/v3/projects` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:21.740255 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9496de-660e-43d0-bca8-315ae7b4e079 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:00:21.742246 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9496de-660e-43d0-bca8-315ae7b4e079 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:00:21.781187 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 784/1571] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 18 22:00:21 2022] POST /identity/v3/projects => generated 371 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 22:00:21.782671 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db15337b-7d5a-481e-b2c6-47ffe1d95a3d admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:00:21.844570 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db15337b-7d5a-481e-b2c6-47ffe1d95a3d admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:00:21.849234 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6f9fe8-e346-4ee2-9ed5-1401154e6aca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:00:21.852759 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6f9fe8-e346-4ee2-9ed5-1401154e6aca admin admin] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:21.852870 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 788/1572] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 18 22:00:21 2022] POST /identity/v3/projects => generated 387 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 22:00:21.852975 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6f9fe8-e346-4ee2-9ed5-1401154e6aca admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:21.852975 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6f9fe8-e346-4ee2-9ed5-1401154e6aca admin admin] PATH_INFO: `/v3/projects` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:21.852975 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6f9fe8-e346-4ee2-9ed5-1401154e6aca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:00:21.853230 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e427d72-ad6e-4f9e-b85f-ec1d34959fdf None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:21.853230 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e427d72-ad6e-4f9e-b85f-ec1d34959fdf None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:21.853230 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e427d72-ad6e-4f9e-b85f-ec1d34959fdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:21.853572 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6f9fe8-e346-4ee2-9ed5-1401154e6aca admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:00:21.870859 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-8e427d72-ad6e-4f9e-b85f-ec1d34959fdf None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:00:21.872292 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-8e427d72-ad6e-4f9e-b85f-ec1d34959fdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:00:21.938064 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 785/1573] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 18 22:00:21 2022] POST /identity/v3/projects => generated 375 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 22:00:21.938064 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6f9fe8-e346-4ee2-9ed5-1401154e6aca admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:00:21.938403 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 789/1574] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:00:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:00:21.938403 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e427d72-ad6e-4f9e-b85f-ec1d34959fdf None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:00:21.943047 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e427d72-ad6e-4f9e-b85f-ec1d34959fdf None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:00:21.961599 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:00:22.000147 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841b31a0-504c-4211-a89a-4ff200edaa20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:00:22.001008 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841b31a0-504c-4211-a89a-4ff200edaa20 admin admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:22.001291 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841b31a0-504c-4211-a89a-4ff200edaa20 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:22.001562 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841b31a0-504c-4211-a89a-4ff200edaa20 admin admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:22.002252 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841b31a0-504c-4211-a89a-4ff200edaa20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:00:22.003856 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841b31a0-504c-4211-a89a-4ff200edaa20 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:00:22.004159 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6f9fe8-e346-4ee2-9ed5-1401154e6aca admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:00:22.008985 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6ced1b-3279-4554-9fbd-629fa3dad467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:00:22.009589 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6ced1b-3279-4554-9fbd-629fa3dad467 admin admin] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:22.009866 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6ced1b-3279-4554-9fbd-629fa3dad467 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:22.010138 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6ced1b-3279-4554-9fbd-629fa3dad467 admin admin] PATH_INFO: `/v3/users` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:22.010756 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6ced1b-3279-4554-9fbd-629fa3dad467 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:00:22.012787 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6ced1b-3279-4554-9fbd-629fa3dad467 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:00:22.013594 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 790/1575] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:00:21 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:00:22.014387 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841b31a0-504c-4211-a89a-4ff200edaa20 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:00:22.022545 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:00:22.069156 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841b31a0-504c-4211-a89a-4ff200edaa20 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:00:22.072767 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61eb0e6-8a46-4ee7-a4e8-6b91fd33ee9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a937971ad1a4b0c8697c764f214d446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:00:22.073366 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61eb0e6-8a46-4ee7-a4e8-6b91fd33ee9e service neutron] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:22.073648 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61eb0e6-8a46-4ee7-a4e8-6b91fd33ee9e service neutron] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:22.073923 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61eb0e6-8a46-4ee7-a4e8-6b91fd33ee9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:22.083682 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61eb0e6-8a46-4ee7-a4e8-6b91fd33ee9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:00:22.087475 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61eb0e6-8a46-4ee7-a4e8-6b91fd33ee9e service neutron] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:00:22.088496 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 786/1576] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 18 22:00:21 2022] POST /identity/v3/users => generated 286 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 22:00:22.089707 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6ced1b-3279-4554-9fbd-629fa3dad467 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:00:22.097336 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 791/1577] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:00:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:00:22.098507 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61eb0e6-8a46-4ee7-a4e8-6b91fd33ee9e service neutron] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:00:22.099896 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6ced1b-3279-4554-9fbd-629fa3dad467 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:00:22.104847 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8995c2af-e8be-4883-acc6-d4884530a0bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:00:22.105557 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8995c2af-e8be-4883-acc6-d4884530a0bc admin admin] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:22.105802 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8995c2af-e8be-4883-acc6-d4884530a0bc admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:22.106090 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8995c2af-e8be-4883-acc6-d4884530a0bc admin admin] PATH_INFO: `/v3/projects` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:22.106705 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8995c2af-e8be-4883-acc6-d4884530a0bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:00:22.109214 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61eb0e6-8a46-4ee7-a4e8-6b91fd33ee9e service neutron] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:00:22.109520 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8995c2af-e8be-4883-acc6-d4884530a0bc admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:00:22.114475 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1583704f-19ff-475e-b90c-23cdec2bf4a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:00:22.115195 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1583704f-19ff-475e-b90c-23cdec2bf4a0 admin admin] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:22.115465 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1583704f-19ff-475e-b90c-23cdec2bf4a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:22.115743 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1583704f-19ff-475e-b90c-23cdec2bf4a0 admin admin] PATH_INFO: `/v3/users` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:22.116380 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1583704f-19ff-475e-b90c-23cdec2bf4a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:00:22.118382 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1583704f-19ff-475e-b90c-23cdec2bf4a0 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:00:22.198834 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 787/1578] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 18 22:00:22 2022] POST /identity/v3/projects => generated 379 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 22:00:22.199586 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8995c2af-e8be-4883-acc6-d4884530a0bc admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:00:22.221400 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 792/1579] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 18 22:00:22 2022] POST /identity/v3/users => generated 286 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 22:00:22.221400 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1583704f-19ff-475e-b90c-23cdec2bf4a0 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:00:22.230814 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1583704f-19ff-475e-b90c-23cdec2bf4a0 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:00:22.269543 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8995c2af-e8be-4883-acc6-d4884530a0bc admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:00:22.274566 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67530fb1-70ce-4be0-b46c-e6332ecdabbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:00:22.275180 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67530fb1-70ce-4be0-b46c-e6332ecdabbb admin admin] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:22.275500 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67530fb1-70ce-4be0-b46c-e6332ecdabbb admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:22.275782 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67530fb1-70ce-4be0-b46c-e6332ecdabbb admin admin] PATH_INFO: `/v3/users` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:22.276458 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67530fb1-70ce-4be0-b46c-e6332ecdabbb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:00:22.278492 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67530fb1-70ce-4be0-b46c-e6332ecdabbb admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:00:22.294515 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104e88c3-4498-4a7b-9950-c9535e81e180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:00:22.295179 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104e88c3-4498-4a7b-9950-c9535e81e180 admin admin] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:22.295469 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104e88c3-4498-4a7b-9950-c9535e81e180 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:22.295705 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104e88c3-4498-4a7b-9950-c9535e81e180 admin admin] PATH_INFO: `/v3/users` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:22.296975 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104e88c3-4498-4a7b-9950-c9535e81e180 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:00:22.299323 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104e88c3-4498-4a7b-9950-c9535e81e180 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:00:22.371975 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 788/1580] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 18 22:00:22 2022] POST /identity/v3/users => generated 294 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 22:00:22.371975 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67530fb1-70ce-4be0-b46c-e6332ecdabbb admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:00:22.380568 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67530fb1-70ce-4be0-b46c-e6332ecdabbb admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:00:22.385271 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f16203c-bbf8-4bbd-931f-4040d7df97f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:00:22.385865 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f16203c-bbf8-4bbd-931f-4040d7df97f0 admin admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:22.386141 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f16203c-bbf8-4bbd-931f-4040d7df97f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:22.386457 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f16203c-bbf8-4bbd-931f-4040d7df97f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:22.387096 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f16203c-bbf8-4bbd-931f-4040d7df97f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 22:00:22.387395 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f16203c-bbf8-4bbd-931f-4040d7df97f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:00:22.389023 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f16203c-bbf8-4bbd-931f-4040d7df97f0 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:00:22.401702 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 789/1581] 10.222.0.27 () {58 vars in 1153 bytes} [Thu Aug 18 22:00:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 22:00:22.403707 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f16203c-bbf8-4bbd-931f-4040d7df97f0 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:00:22.403828 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 793/1582] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 18 22:00:22 2022] POST /identity/v3/users => generated 288 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 22:00:22.407059 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104e88c3-4498-4a7b-9950-c9535e81e180 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:00:22.412367 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f16203c-bbf8-4bbd-931f-4040d7df97f0 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:00:22.417016 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f270c1f5-a026-44a6-bbc8-a8cd8733f72e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:00:22.417610 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f270c1f5-a026-44a6-bbc8-a8cd8733f72e admin admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:22.417835 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104e88c3-4498-4a7b-9950-c9535e81e180 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:00:22.417951 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f270c1f5-a026-44a6-bbc8-a8cd8733f72e admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:22.418141 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f270c1f5-a026-44a6-bbc8-a8cd8733f72e admin admin] PATH_INFO: `/v3/roles` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:22.418763 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f270c1f5-a026-44a6-bbc8-a8cd8733f72e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:00:22.420383 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f270c1f5-a026-44a6-bbc8-a8cd8733f72e admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:00:22.423830 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb1ebab-0424-4328-b7b3-e4d50db68fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:00:22.424425 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb1ebab-0424-4328-b7b3-e4d50db68fc2 admin admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:22.424732 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb1ebab-0424-4328-b7b3-e4d50db68fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:22.425008 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb1ebab-0424-4328-b7b3-e4d50db68fc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:22.425681 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb1ebab-0424-4328-b7b3-e4d50db68fc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:00:22.427240 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb1ebab-0424-4328-b7b3-e4d50db68fc2 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:00:22.431041 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 790/1583] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:00:22 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:00:22.432322 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f270c1f5-a026-44a6-bbc8-a8cd8733f72e admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:00:22.439055 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 794/1584] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:00:22 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:00:22.440222 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb1ebab-0424-4328-b7b3-e4d50db68fc2 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:00:22.442263 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f270c1f5-a026-44a6-bbc8-a8cd8733f72e admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:00:22.446864 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67b9b19-b0f6-4179-85e2-d988f67dbc72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:00:22.447454 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67b9b19-b0f6-4179-85e2-d988f67dbc72 admin admin] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:22.447733 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67b9b19-b0f6-4179-85e2-d988f67dbc72 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:22.448000 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67b9b19-b0f6-4179-85e2-d988f67dbc72 admin admin] PATH_INFO: `/v3/users` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:22.448636 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67b9b19-b0f6-4179-85e2-d988f67dbc72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:00:22.455383 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb1ebab-0424-4328-b7b3-e4d50db68fc2 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:00:22.456160 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67b9b19-b0f6-4179-85e2-d988f67dbc72 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:00:22.457658 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20beb805-9cae-4694-979a-27782ad8d600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:00:22.458503 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20beb805-9cae-4694-979a-27782ad8d600 admin admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:22.458668 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20beb805-9cae-4694-979a-27782ad8d600 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:22.458962 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20beb805-9cae-4694-979a-27782ad8d600 admin admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:22.459664 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20beb805-9cae-4694-979a-27782ad8d600 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:00:22.461921 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20beb805-9cae-4694-979a-27782ad8d600 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:00:22.475066 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 795/1585] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:00:22 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:00:22.482980 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20beb805-9cae-4694-979a-27782ad8d600 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:00:22.487130 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20beb805-9cae-4694-979a-27782ad8d600 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:00:22.491887 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14dabf8-3bf2-411d-9145-a773ff2e9af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:00:22.492620 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14dabf8-3bf2-411d-9145-a773ff2e9af6 admin admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:22.492823 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14dabf8-3bf2-411d-9145-a773ff2e9af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:22.493109 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14dabf8-3bf2-411d-9145-a773ff2e9af6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:22.493760 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14dabf8-3bf2-411d-9145-a773ff2e9af6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:00:22.495440 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14dabf8-3bf2-411d-9145-a773ff2e9af6 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:00:22.510172 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:00:22.510172 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 796/1586] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:00:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:00:22.510172 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14dabf8-3bf2-411d-9145-a773ff2e9af6 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:00:22.519994 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14dabf8-3bf2-411d-9145-a773ff2e9af6 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:00:22.526125 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5e9382-b8a1-4ab2-8986-7912a5b51491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:00:22.526874 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5e9382-b8a1-4ab2-8986-7912a5b51491 admin admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:22.527299 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5e9382-b8a1-4ab2-8986-7912a5b51491 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:22.527422 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5e9382-b8a1-4ab2-8986-7912a5b51491 admin admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:22.528075 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5e9382-b8a1-4ab2-8986-7912a5b51491 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:00:22.529868 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5e9382-b8a1-4ab2-8986-7912a5b51491 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:00:22.541213 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 797/1587] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:00:22 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:00:22.542066 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5e9382-b8a1-4ab2-8986-7912a5b51491 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:00:22.552635 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5e9382-b8a1-4ab2-8986-7912a5b51491 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:00:22.557622 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5b0f5d-e0d7-4288-80a8-3dbc662217b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:00:22.562652 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5b0f5d-e0d7-4288-80a8-3dbc662217b5 admin admin] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:22.562652 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5b0f5d-e0d7-4288-80a8-3dbc662217b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:22.562652 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5b0f5d-e0d7-4288-80a8-3dbc662217b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:22.562652 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5b0f5d-e0d7-4288-80a8-3dbc662217b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:00:22.562652 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5b0f5d-e0d7-4288-80a8-3dbc662217b5 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:00:22.567706 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 791/1588] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 18 22:00:22 2022] POST /identity/v3/users => generated 290 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 22:00:22.567706 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67b9b19-b0f6-4179-85e2-d988f67dbc72 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:00:22.579234 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67b9b19-b0f6-4179-85e2-d988f67dbc72 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:00:22.584400 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521996f3-efd2-41f8-813b-b8c1bec09ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:00:22.585123 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521996f3-efd2-41f8-813b-b8c1bec09ad0 admin admin] REQUEST_METHOD: `PUT` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:22.585403 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521996f3-efd2-41f8-813b-b8c1bec09ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:22.585680 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521996f3-efd2-41f8-813b-b8c1bec09ad0 admin admin] PATH_INFO: `/v3/projects/68be025940154d63992a4805f1be8b64/users/4ca7e9098815480f89b2a9a8a222ae5e/roles/de8f2438056f4af9879423f8a59e0e0b` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:22.601298 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521996f3-efd2-41f8-813b-b8c1bec09ad0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68be025940154d63992a4805f1be8b64, user_id=4ca7e9098815480f89b2a9a8a222ae5e, role_id=de8f2438056f4af9879423f8a59e0e0b)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:00:22.602326 dv-cinder-853678-3-smb devstack@keystone.service[88096]: WARNING py.warnings [None req-521996f3-efd2-41f8-813b-b8c1bec09ad0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 18 22:00:22.602326 dv-cinder-853678-3-smb devstack@keystone.service[88096]: warnings.warn(msg) Aug 18 22:00:22.602326 dv-cinder-853678-3-smb devstack@keystone.service[88096]: Aug 18 22:00:22.604353 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521996f3-efd2-41f8-813b-b8c1bec09ad0 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:00:22.647512 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 798/1589] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 18 22:00:22 2022] POST /identity/v3/projects => generated 379 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 22:00:22.648503 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5b0f5d-e0d7-4288-80a8-3dbc662217b5 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:00:22.670271 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 792/1590] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 18 22:00:22 2022] PUT /identity/v3/projects/68be025940154d63992a4805f1be8b64/users/4ca7e9098815480f89b2a9a8a222ae5e/roles/de8f2438056f4af9879423f8a59e0e0b => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:00:22.672176 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521996f3-efd2-41f8-813b-b8c1bec09ad0 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:00:22.720606 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5b0f5d-e0d7-4288-80a8-3dbc662217b5 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:00:22.736914 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:INSERT=10,keystone:SELECT=90 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:00:22.748901 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521996f3-efd2-41f8-813b-b8c1bec09ad0 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:00:22.754791 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c8007b-8ee8-467a-bfba-5cd577ff473c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:00:22.756930 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c8007b-8ee8-467a-bfba-5cd577ff473c admin admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:22.756930 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c8007b-8ee8-467a-bfba-5cd577ff473c admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:22.756930 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c8007b-8ee8-467a-bfba-5cd577ff473c admin admin] PATH_INFO: `/v3/roles` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:22.757535 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c8007b-8ee8-467a-bfba-5cd577ff473c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:00:22.759848 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c8007b-8ee8-467a-bfba-5cd577ff473c admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:00:22.772647 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 793/1591] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:00:22 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:00:22.772647 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c8007b-8ee8-467a-bfba-5cd577ff473c admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:00:22.787060 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c8007b-8ee8-467a-bfba-5cd577ff473c admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:00:22.792921 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456ac71b-74af-4d41-ad87-e58e12e69640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:00:22.793725 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456ac71b-74af-4d41-ad87-e58e12e69640 admin admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:22.794125 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456ac71b-74af-4d41-ad87-e58e12e69640 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:22.794534 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456ac71b-74af-4d41-ad87-e58e12e69640 admin admin] PATH_INFO: `/v3/roles` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:22.795330 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456ac71b-74af-4d41-ad87-e58e12e69640 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:00:22.797421 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456ac71b-74af-4d41-ad87-e58e12e69640 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:00:22.802317 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be59f5f-6afa-4a20-bd63-279ff4cbe75e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:00:22.802944 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be59f5f-6afa-4a20-bd63-279ff4cbe75e admin admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:22.803228 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be59f5f-6afa-4a20-bd63-279ff4cbe75e admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:22.804084 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be59f5f-6afa-4a20-bd63-279ff4cbe75e admin admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:22.804208 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be59f5f-6afa-4a20-bd63-279ff4cbe75e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:00:22.806454 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be59f5f-6afa-4a20-bd63-279ff4cbe75e admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:00:22.811558 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 794/1592] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:00:22 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:00:22.812780 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456ac71b-74af-4d41-ad87-e58e12e69640 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:00:22.824646 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 799/1593] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:00:22 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:00:22.824646 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be59f5f-6afa-4a20-bd63-279ff4cbe75e admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:00:22.824945 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456ac71b-74af-4d41-ad87-e58e12e69640 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:00:22.830949 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efd367c-4a36-485e-bf80-3fa43439e963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:00:22.831586 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efd367c-4a36-485e-bf80-3fa43439e963 admin admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:22.831909 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efd367c-4a36-485e-bf80-3fa43439e963 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:22.832180 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efd367c-4a36-485e-bf80-3fa43439e963 admin admin] PATH_INFO: `/v3/roles` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:22.832890 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efd367c-4a36-485e-bf80-3fa43439e963 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:00:22.834568 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efd367c-4a36-485e-bf80-3fa43439e963 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:00:22.836739 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be59f5f-6afa-4a20-bd63-279ff4cbe75e admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:00:22.841530 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3100d3d-ebb3-4020-8198-aab0108c923f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:00:22.842118 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3100d3d-ebb3-4020-8198-aab0108c923f admin admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:22.842391 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3100d3d-ebb3-4020-8198-aab0108c923f admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:22.842662 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3100d3d-ebb3-4020-8198-aab0108c923f admin admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:22.843349 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3100d3d-ebb3-4020-8198-aab0108c923f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:00:22.844992 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3100d3d-ebb3-4020-8198-aab0108c923f admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:00:22.845590 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 795/1594] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:00:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:00:22.849176 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efd367c-4a36-485e-bf80-3fa43439e963 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:00:22.856639 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 800/1595] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:00:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:00:22.856823 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efd367c-4a36-485e-bf80-3fa43439e963 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:00:22.856955 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7012ff8f-fcf9-457c-b4fc-77f321573a47 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:22.856955 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7012ff8f-fcf9-457c-b4fc-77f321573a47 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:22.857114 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7012ff8f-fcf9-457c-b4fc-77f321573a47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:22.864924 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f775a3-706b-4da5-a7bc-e401b6bc7428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:00:22.866212 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f775a3-706b-4da5-a7bc-e401b6bc7428 admin admin] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:22.866212 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f775a3-706b-4da5-a7bc-e401b6bc7428 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:22.866364 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f775a3-706b-4da5-a7bc-e401b6bc7428 admin admin] PATH_INFO: `/v3/users` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:22.867060 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f775a3-706b-4da5-a7bc-e401b6bc7428 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:00:22.869300 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f775a3-706b-4da5-a7bc-e401b6bc7428 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:00:22.876553 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-7012ff8f-fcf9-457c-b4fc-77f321573a47 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:00:22.878140 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-7012ff8f-fcf9-457c-b4fc-77f321573a47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:00:22.890867 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 801/1596] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:00:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:00:22.891918 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7012ff8f-fcf9-457c-b4fc-77f321573a47 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:00:22.902328 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7012ff8f-fcf9-457c-b4fc-77f321573a47 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:00:22.907167 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9603b93f-646f-4860-9044-371cacc33f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:00:22.907811 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9603b93f-646f-4860-9044-371cacc33f3c admin admin] REQUEST_METHOD: `PUT` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:22.908086 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9603b93f-646f-4860-9044-371cacc33f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:22.908353 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9603b93f-646f-4860-9044-371cacc33f3c admin admin] PATH_INFO: `/v3/projects/6d199df8ae164ecc99076c0054bf03f9/users/b563386ee308443dac30642c6332443c/roles/de8f2438056f4af9879423f8a59e0e0b` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:22.924344 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9603b93f-646f-4860-9044-371cacc33f3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d199df8ae164ecc99076c0054bf03f9, user_id=b563386ee308443dac30642c6332443c, role_id=de8f2438056f4af9879423f8a59e0e0b)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:00:22.927027 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9603b93f-646f-4860-9044-371cacc33f3c admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:00:22.964330 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 796/1597] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 18 22:00:22 2022] POST /identity/v3/users => generated 290 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 22:00:22.964330 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f775a3-706b-4da5-a7bc-e401b6bc7428 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:00:22.973437 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f775a3-706b-4da5-a7bc-e401b6bc7428 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:00:22.978613 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14454fde-aac2-45b1-8285-98fe24fb5460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:00:22.979348 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14454fde-aac2-45b1-8285-98fe24fb5460 admin admin] REQUEST_METHOD: `PUT` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:22.979821 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14454fde-aac2-45b1-8285-98fe24fb5460 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:22.980118 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14454fde-aac2-45b1-8285-98fe24fb5460 admin admin] PATH_INFO: `/v3/projects/00fd9271d45d48919e5a0f203cb2dffa/users/9c13345ad7e8464fa2f06e013d0ad058/roles/de8f2438056f4af9879423f8a59e0e0b` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:22.996837 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14454fde-aac2-45b1-8285-98fe24fb5460 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00fd9271d45d48919e5a0f203cb2dffa, user_id=9c13345ad7e8464fa2f06e013d0ad058, role_id=de8f2438056f4af9879423f8a59e0e0b)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:00:23.000915 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14454fde-aac2-45b1-8285-98fe24fb5460 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:00:23.038556 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 802/1598] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 18 22:00:22 2022] PUT /identity/v3/projects/6d199df8ae164ecc99076c0054bf03f9/users/b563386ee308443dac30642c6332443c/roles/de8f2438056f4af9879423f8a59e0e0b => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:00:23.042678 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9603b93f-646f-4860-9044-371cacc33f3c admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:00:23.073944 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:00:23.094647 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 797/1599] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 18 22:00:22 2022] PUT /identity/v3/projects/00fd9271d45d48919e5a0f203cb2dffa/users/9c13345ad7e8464fa2f06e013d0ad058/roles/de8f2438056f4af9879423f8a59e0e0b => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:00:23.097866 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14454fde-aac2-45b1-8285-98fe24fb5460 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:00:23.103824 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9603b93f-646f-4860-9044-371cacc33f3c admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:00:23.162875 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18aa5bea-5d58-449f-915e-1914a0b2ef1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:00:23.163541 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aa5bea-5d58-449f-915e-1914a0b2ef1f admin admin] REQUEST_METHOD: `PUT` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:23.163817 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aa5bea-5d58-449f-915e-1914a0b2ef1f admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:23.164091 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aa5bea-5d58-449f-915e-1914a0b2ef1f admin admin] PATH_INFO: `/v3/projects/fee7c1078fe347ffa46580784fd18007/users/df77e8be35c042499dd0f08342f83d9a/roles/de8f2438056f4af9879423f8a59e0e0b` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:23.165133 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14454fde-aac2-45b1-8285-98fe24fb5460 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:00:23.170515 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc034e7-e86b-41a1-930c-3654acd4cd10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:00:23.171936 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc034e7-e86b-41a1-930c-3654acd4cd10 admin admin] REQUEST_METHOD: `PUT` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:23.172392 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc034e7-e86b-41a1-930c-3654acd4cd10 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:23.172905 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc034e7-e86b-41a1-930c-3654acd4cd10 admin admin] PATH_INFO: `/v3/projects/3d07c3567fb745e8b8a6c30e9d3e18a7/users/5f63594e64e74fa09ca52e4b0bae1f09/roles/de8f2438056f4af9879423f8a59e0e0b` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:23.181192 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18aa5bea-5d58-449f-915e-1914a0b2ef1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=fee7c1078fe347ffa46580784fd18007, user_id=df77e8be35c042499dd0f08342f83d9a, role_id=de8f2438056f4af9879423f8a59e0e0b)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:00:23.183899 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18aa5bea-5d58-449f-915e-1914a0b2ef1f admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:00:23.192068 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc034e7-e86b-41a1-930c-3654acd4cd10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d07c3567fb745e8b8a6c30e9d3e18a7, user_id=5f63594e64e74fa09ca52e4b0bae1f09, role_id=de8f2438056f4af9879423f8a59e0e0b)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:00:23.196012 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc034e7-e86b-41a1-930c-3654acd4cd10 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:00:23.294740 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 803/1600] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 18 22:00:23 2022] PUT /identity/v3/projects/fee7c1078fe347ffa46580784fd18007/users/df77e8be35c042499dd0f08342f83d9a/roles/de8f2438056f4af9879423f8a59e0e0b => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:00:23.297412 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18aa5bea-5d58-449f-915e-1914a0b2ef1f admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:00:23.323762 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 798/1601] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 18 22:00:23 2022] PUT /identity/v3/projects/3d07c3567fb745e8b8a6c30e9d3e18a7/users/5f63594e64e74fa09ca52e4b0bae1f09/roles/de8f2438056f4af9879423f8a59e0e0b => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:00:23.324632 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc034e7-e86b-41a1-930c-3654acd4cd10 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:00:23.364238 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18aa5bea-5d58-449f-915e-1914a0b2ef1f admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:00:23.391691 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc034e7-e86b-41a1-930c-3654acd4cd10 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:00:23.395342 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3b44c0-fcd5-4941-8f45-1feca4a97513 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a937971ad1a4b0c8697c764f214d446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:00:23.395983 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3b44c0-fcd5-4941-8f45-1feca4a97513 service neutron] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:23.396521 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3b44c0-fcd5-4941-8f45-1feca4a97513 service neutron] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:23.400934 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3b44c0-fcd5-4941-8f45-1feca4a97513 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:23.418771 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:00:23.427453 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d11560-2b7c-488e-afd6-0426a8d4bca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:00:23.428070 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d11560-2b7c-488e-afd6-0426a8d4bca2 admin admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:23.428353 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d11560-2b7c-488e-afd6-0426a8d4bca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:23.428689 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d11560-2b7c-488e-afd6-0426a8d4bca2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:23.429333 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d11560-2b7c-488e-afd6-0426a8d4bca2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:00:23.430945 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d11560-2b7c-488e-afd6-0426a8d4bca2 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:00:23.441387 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 804/1602] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:00:23 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:00:23.442200 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d11560-2b7c-488e-afd6-0426a8d4bca2 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:00:23.458353 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:00:23.463446 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d11560-2b7c-488e-afd6-0426a8d4bca2 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:00:23.469866 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3b44c0-fcd5-4941-8f45-1feca4a97513 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:00:23.475504 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4747aaa-308e-4609-8c8c-b53a590f0be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:00:23.475670 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3b44c0-fcd5-4941-8f45-1feca4a97513 service neutron] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:00:23.475798 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4747aaa-308e-4609-8c8c-b53a590f0be0 admin admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:23.475798 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4747aaa-308e-4609-8c8c-b53a590f0be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:23.475798 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4747aaa-308e-4609-8c8c-b53a590f0be0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:23.475798 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4747aaa-308e-4609-8c8c-b53a590f0be0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:00:23.475798 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4747aaa-308e-4609-8c8c-b53a590f0be0 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:00:23.484726 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 799/1603] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:00:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:00:23.486190 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64c159f-ccad-4133-9069-99f55214e366 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:23.486927 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 805/1604] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:00:23 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:00:23.487768 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64c159f-ccad-4133-9069-99f55214e366 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:23.488219 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64c159f-ccad-4133-9069-99f55214e366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:23.488323 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67af29c9-9f41-40b5-b4ba-f3ccc96922df None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:23.488587 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67af29c9-9f41-40b5-b4ba-f3ccc96922df None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:23.489096 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67af29c9-9f41-40b5-b4ba-f3ccc96922df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:23.514296 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-67af29c9-9f41-40b5-b4ba-f3ccc96922df None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:00:23.516126 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-67af29c9-9f41-40b5-b4ba-f3ccc96922df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:00:23.521602 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-c64c159f-ccad-4133-9069-99f55214e366 None None] MFA Rules not processed for user `b563386ee308443dac30642c6332443c`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:00:23.522799 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-c64c159f-ccad-4133-9069-99f55214e366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:00:23.525179 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 806/1605] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:00:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:00:23.526334 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab28f8b-9db3-4f9f-aa19-bdfcc7a0843e None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:23.526626 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab28f8b-9db3-4f9f-aa19-bdfcc7a0843e None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:23.526896 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab28f8b-9db3-4f9f-aa19-bdfcc7a0843e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:23.564709 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-1ab28f8b-9db3-4f9f-aa19-bdfcc7a0843e None None] MFA Rules not processed for user `df77e8be35c042499dd0f08342f83d9a`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:00:23.564709 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-1ab28f8b-9db3-4f9f-aa19-bdfcc7a0843e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:00:23.633164 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 800/1606] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:00:23 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:00:23.637547 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c48e15-fab5-435e-9e1a-a2cd63f0c193 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:23.637924 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c48e15-fab5-435e-9e1a-a2cd63f0c193 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:23.638158 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c48e15-fab5-435e-9e1a-a2cd63f0c193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:23.642897 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 807/1607] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:00:23 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:00:23.645883 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab28f8b-9db3-4f9f-aa19-bdfcc7a0843e None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:00:23.663939 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab28f8b-9db3-4f9f-aa19-bdfcc7a0843e None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:00:23.673317 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637ec544-ea9d-4dcf-8e83-abc932c8c5c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:00:23.674032 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637ec544-ea9d-4dcf-8e83-abc932c8c5c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:23.675581 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637ec544-ea9d-4dcf-8e83-abc932c8c5c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:23.675851 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637ec544-ea9d-4dcf-8e83-abc932c8c5c8 admin admin] PATH_INFO: `/v3/projects/03c48db22a5d43cd96323181da78dd0f/users/017db2cc67ba4a7eaff0c3e7966209de/roles/de8f2438056f4af9879423f8a59e0e0b` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:23.678520 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-34c48e15-fab5-435e-9e1a-a2cd63f0c193 None None] MFA Rules not processed for user `5f63594e64e74fa09ca52e4b0bae1f09`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:00:23.680812 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-34c48e15-fab5-435e-9e1a-a2cd63f0c193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:00:23.698912 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637ec544-ea9d-4dcf-8e83-abc932c8c5c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03c48db22a5d43cd96323181da78dd0f, user_id=017db2cc67ba4a7eaff0c3e7966209de, role_id=de8f2438056f4af9879423f8a59e0e0b)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:00:23.703393 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637ec544-ea9d-4dcf-8e83-abc932c8c5c8 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:00:23.772585 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 801/1608] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:00:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:00:23.772585 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c48e15-fab5-435e-9e1a-a2cd63f0c193 None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:00:23.784666 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c48e15-fab5-435e-9e1a-a2cd63f0c193 None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:00:23.791059 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34b00bd-4e32-4666-b058-fd8bcd089d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:00:23.791860 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34b00bd-4e32-4666-b058-fd8bcd089d66 admin admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:23.792377 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34b00bd-4e32-4666-b058-fd8bcd089d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:23.793135 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34b00bd-4e32-4666-b058-fd8bcd089d66 admin admin] PATH_INFO: `/v3/roles` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:23.793937 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34b00bd-4e32-4666-b058-fd8bcd089d66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:00:23.796633 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34b00bd-4e32-4666-b058-fd8bcd089d66 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:00:23.807837 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 802/1609] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:00:23 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:00:23.808826 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34b00bd-4e32-4666-b058-fd8bcd089d66 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:00:23.810675 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-b34b00bd-4e32-4666-b058-fd8bcd089d66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:00:23.823972 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34b00bd-4e32-4666-b058-fd8bcd089d66 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:00:23.828200 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b8a65f-b851-4974-b04f-3a50938d5acf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a937971ad1a4b0c8697c764f214d446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:00:23.828912 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b8a65f-b851-4974-b04f-3a50938d5acf service neutron] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:23.829188 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b8a65f-b851-4974-b04f-3a50938d5acf service neutron] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:23.829459 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b8a65f-b851-4974-b04f-3a50938d5acf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:23.838800 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b8a65f-b851-4974-b04f-3a50938d5acf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:00:23.840240 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b8a65f-b851-4974-b04f-3a50938d5acf service neutron] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:00:23.852415 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 803/1610] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:00:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:00:23.854621 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b8a65f-b851-4974-b04f-3a50938d5acf service neutron] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:00:23.876830 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b8a65f-b851-4974-b04f-3a50938d5acf service neutron] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:00:23.877850 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 808/1611] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 18 22:00:23 2022] PUT /identity/v3/projects/03c48db22a5d43cd96323181da78dd0f/users/017db2cc67ba4a7eaff0c3e7966209de/roles/de8f2438056f4af9879423f8a59e0e0b => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:00:23.880854 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e350a377-89b4-4d63-8b2d-62ca1841ef44 None None] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:23.882764 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e350a377-89b4-4d63-8b2d-62ca1841ef44 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:23.884068 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e350a377-89b4-4d63-8b2d-62ca1841ef44 None None] PATH_INFO: `/` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:23.886705 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 809/1612] 10.222.0.27 () {54 vars in 962 bytes} [Thu Aug 18 22:00:23 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 22:00:23.890943 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d81565-f090-40c7-b70e-c326ceb2b3b4 None None] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:23.893785 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d81565-f090-40c7-b70e-c326ceb2b3b4 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:23.894574 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d81565-f090-40c7-b70e-c326ceb2b3b4 None None] PATH_INFO: `/` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:23.896864 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:00:23.899806 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 810/1613] 10.222.0.27 () {54 vars in 962 bytes} [Thu Aug 18 22:00:23 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 22:00:23.905053 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d81565-f090-40c7-b70e-c326ceb2b3b4 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:00:24.016349 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a7a26c-a636-43d7-8ada-ce74baa0d3e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:00:24.017363 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a7a26c-a636-43d7-8ada-ce74baa0d3e5 admin admin] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:24.017714 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a7a26c-a636-43d7-8ada-ce74baa0d3e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:24.018051 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a7a26c-a636-43d7-8ada-ce74baa0d3e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:24.018776 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a7a26c-a636-43d7-8ada-ce74baa0d3e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:00:24.018887 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d81565-f090-40c7-b70e-c326ceb2b3b4 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:00:24.024337 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a7a26c-a636-43d7-8ada-ce74baa0d3e5 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:00:24.025812 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1867b061-59a9-4a24-b45c-4d5344d701d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:00:24.034950 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1867b061-59a9-4a24-b45c-4d5344d701d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:24.034950 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1867b061-59a9-4a24-b45c-4d5344d701d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:24.034950 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1867b061-59a9-4a24-b45c-4d5344d701d1 admin admin] PATH_INFO: `/v3/projects/af4b1c89ec6346408721a643b137ba08/users/093ed86a33304fde999010cde45be396/roles/de8f2438056f4af9879423f8a59e0e0b` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:24.048331 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1867b061-59a9-4a24-b45c-4d5344d701d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af4b1c89ec6346408721a643b137ba08, user_id=093ed86a33304fde999010cde45be396, role_id=de8f2438056f4af9879423f8a59e0e0b)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:00:24.051139 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1867b061-59a9-4a24-b45c-4d5344d701d1 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:00:24.113136 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 804/1614] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 18 22:00:23 2022] POST /identity/v3/projects => generated 373 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 22:00:24.114970 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87328c4-d246-4dac-a386-284524832770 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:24.115504 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87328c4-d246-4dac-a386-284524832770 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:24.116046 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87328c4-d246-4dac-a386-284524832770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:24.132721 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 811/1615] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 18 22:00:23 2022] PUT /identity/v3/projects/af4b1c89ec6346408721a643b137ba08/users/093ed86a33304fde999010cde45be396/roles/de8f2438056f4af9879423f8a59e0e0b => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:00:24.134463 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4befd3-c79d-4fc7-acd3-d3a58100f5d5 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:24.134754 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4befd3-c79d-4fc7-acd3-d3a58100f5d5 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:24.135034 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4befd3-c79d-4fc7-acd3-d3a58100f5d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:24.162192 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-f87328c4-d246-4dac-a386-284524832770 None None] MFA Rules not processed for user `017db2cc67ba4a7eaff0c3e7966209de`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:00:24.164390 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-f87328c4-d246-4dac-a386-284524832770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:00:24.212474 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-8e4befd3-c79d-4fc7-acd3-d3a58100f5d5 None None] MFA Rules not processed for user `a39cd50340184779ac589bbcb7cac9aa`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:00:24.214085 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-8e4befd3-c79d-4fc7-acd3-d3a58100f5d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:00:24.256150 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:00:24.298212 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 805/1616] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:00:24 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:00:24.299664 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e791b6-b00b-4c6d-aca5-311d34d44b95 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:24.300058 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e791b6-b00b-4c6d-aca5-311d34d44b95 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:24.300495 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e791b6-b00b-4c6d-aca5-311d34d44b95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:24.331582 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-49e791b6-b00b-4c6d-aca5-311d34d44b95 None None] MFA Rules not processed for user `a39cd50340184779ac589bbcb7cac9aa`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:00:24.333935 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-49e791b6-b00b-4c6d-aca5-311d34d44b95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:00:24.344627 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 812/1617] 10.222.0.27 () {58 vars in 1059 bytes} [Thu Aug 18 22:00:24 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:00:24.346761 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4befd3-c79d-4fc7-acd3-d3a58100f5d5 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:00:24.353245 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 806/1618] 10.222.0.27 () {58 vars in 1059 bytes} [Thu Aug 18 22:00:24 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:00:24.355373 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded6b418-ffd1-4475-93cd-e8b9d50feaec None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:24.357053 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded6b418-ffd1-4475-93cd-e8b9d50feaec None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:24.359706 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded6b418-ffd1-4475-93cd-e8b9d50feaec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:24.400637 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-ded6b418-ffd1-4475-93cd-e8b9d50feaec None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:00:24.401871 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-ded6b418-ffd1-4475-93cd-e8b9d50feaec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:00:24.447930 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4befd3-c79d-4fc7-acd3-d3a58100f5d5 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:00:24.453427 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8da96e-84f3-41e8-a529-3227be4ce0de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:00:24.454370 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8da96e-84f3-41e8-a529-3227be4ce0de admin admin] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:24.454867 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8da96e-84f3-41e8-a529-3227be4ce0de admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:24.455141 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8da96e-84f3-41e8-a529-3227be4ce0de admin admin] PATH_INFO: `/v3/users` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:24.455832 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8da96e-84f3-41e8-a529-3227be4ce0de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:00:24.458299 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8da96e-84f3-41e8-a529-3227be4ce0de admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:00:24.505069 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 807/1619] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:00:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:00:24.512045 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded6b418-ffd1-4475-93cd-e8b9d50feaec None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:00:24.519040 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded6b418-ffd1-4475-93cd-e8b9d50feaec None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:00:24.524313 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4eb3e8-e33f-445a-b0e6-a67d6f15d8b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:00:24.524996 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4eb3e8-e33f-445a-b0e6-a67d6f15d8b2 admin admin] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:24.525279 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4eb3e8-e33f-445a-b0e6-a67d6f15d8b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:24.525586 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4eb3e8-e33f-445a-b0e6-a67d6f15d8b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:24.526242 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4eb3e8-e33f-445a-b0e6-a67d6f15d8b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:00:24.528165 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4eb3e8-e33f-445a-b0e6-a67d6f15d8b2 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:00:24.644404 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:00:24.651137 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 813/1620] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 18 22:00:24 2022] POST /identity/v3/users => generated 293 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 22:00:24.654110 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8da96e-84f3-41e8-a529-3227be4ce0de admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:00:24.660350 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 808/1621] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 18 22:00:24 2022] POST /identity/v3/projects => generated 379 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 22:00:24.660350 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4eb3e8-e33f-445a-b0e6-a67d6f15d8b2 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:00:24.672449 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8da96e-84f3-41e8-a529-3227be4ce0de admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:00:24.747777 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6308af-b278-4070-accc-83c475105225 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a39cd50340184779ac589bbcb7cac9aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:00:24.748426 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6308af-b278-4070-accc-83c475105225 service nova] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:24.748767 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6308af-b278-4070-accc-83c475105225 service nova] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:24.749050 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6308af-b278-4070-accc-83c475105225 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:24.776142 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4eb3e8-e33f-445a-b0e6-a67d6f15d8b2 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:00:24.785326 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43744fe3-39d2-4257-a6eb-9a77d13fe817 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a39cd50340184779ac589bbcb7cac9aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:00:24.786161 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43744fe3-39d2-4257-a6eb-9a77d13fe817 service nova] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:24.788627 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43744fe3-39d2-4257-a6eb-9a77d13fe817 service nova] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:24.789055 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43744fe3-39d2-4257-a6eb-9a77d13fe817 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:24.842522 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6308af-b278-4070-accc-83c475105225 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:00:24.845169 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6308af-b278-4070-accc-83c475105225 service nova] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:00:24.858667 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 814/1622] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:00:24 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:00:24.859773 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6308af-b278-4070-accc-83c475105225 service nova] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:00:24.978798 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43744fe3-39d2-4257-a6eb-9a77d13fe817 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:00:24.978798 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43744fe3-39d2-4257-a6eb-9a77d13fe817 service nova] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:00:24.978798 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 809/1623] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:00:24 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:00:24.978798 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43744fe3-39d2-4257-a6eb-9a77d13fe817 service nova] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:00:24.997905 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6308af-b278-4070-accc-83c475105225 service nova] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:00:25.002652 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1305e513-7e92-43aa-a92a-9cac4e356073 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a937971ad1a4b0c8697c764f214d446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:00:25.003264 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1305e513-7e92-43aa-a92a-9cac4e356073 service neutron] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:25.003572 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1305e513-7e92-43aa-a92a-9cac4e356073 service neutron] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:25.003856 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1305e513-7e92-43aa-a92a-9cac4e356073 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:25.098647 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43744fe3-39d2-4257-a6eb-9a77d13fe817 service nova] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:00:25.106263 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4b9445-35e5-45d1-b930-afda8cf38019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:00:25.106888 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4b9445-35e5-45d1-b930-afda8cf38019 admin admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:25.107165 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4b9445-35e5-45d1-b930-afda8cf38019 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:25.107434 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4b9445-35e5-45d1-b930-afda8cf38019 admin admin] PATH_INFO: `/v3/roles` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:25.108223 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4b9445-35e5-45d1-b930-afda8cf38019 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:00:25.111707 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:00:25.120776 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4b9445-35e5-45d1-b930-afda8cf38019 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:00:25.136244 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 810/1624] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:00:24 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:00:25.137075 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4b9445-35e5-45d1-b930-afda8cf38019 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:00:25.141448 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1305e513-7e92-43aa-a92a-9cac4e356073 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:00:25.143539 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1305e513-7e92-43aa-a92a-9cac4e356073 service neutron] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:00:25.168346 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 815/1625] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:00:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:00:25.169680 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1305e513-7e92-43aa-a92a-9cac4e356073 service neutron] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:00:25.184809 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1305e513-7e92-43aa-a92a-9cac4e356073 service neutron] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:00:25.197391 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4b9445-35e5-45d1-b930-afda8cf38019 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:00:25.197493 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007d6ce4-b7d1-45a4-85c9-68e59d6ab459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:00:25.197493 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007d6ce4-b7d1-45a4-85c9-68e59d6ab459 admin admin] REQUEST_METHOD: `PUT` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:25.197493 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007d6ce4-b7d1-45a4-85c9-68e59d6ab459 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:25.197493 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007d6ce4-b7d1-45a4-85c9-68e59d6ab459 admin admin] PATH_INFO: `/v3/projects/702f236c25fc408aa7ff03fe52797b8d/users/665483b9c7fb40a392ea821acd62f8c1/roles/0833202e2a3d47d1b6b3af57006641b1` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:25.211404 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007d6ce4-b7d1-45a4-85c9-68e59d6ab459 admin admin] RBAC: Authorizing `identity:create_grant(project_id=702f236c25fc408aa7ff03fe52797b8d, user_id=665483b9c7fb40a392ea821acd62f8c1, role_id=0833202e2a3d47d1b6b3af57006641b1)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:00:25.214039 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007d6ce4-b7d1-45a4-85c9-68e59d6ab459 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:00:25.215762 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c15b206-1ab2-4368-93fa-c92330c48cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:00:25.216439 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c15b206-1ab2-4368-93fa-c92330c48cf4 admin admin] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:25.216821 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c15b206-1ab2-4368-93fa-c92330c48cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:25.217111 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c15b206-1ab2-4368-93fa-c92330c48cf4 admin admin] PATH_INFO: `/v3/users` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:25.217792 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c15b206-1ab2-4368-93fa-c92330c48cf4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:00:25.222235 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c15b206-1ab2-4368-93fa-c92330c48cf4 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:00:25.368774 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 811/1626] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 18 22:00:25 2022] POST /identity/v3/users => generated 296 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 22:00:25.370144 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbdd236-cb19-47e7-8ef9-ef777c6920e2 None None] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:25.370426 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbdd236-cb19-47e7-8ef9-ef777c6920e2 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:25.370698 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbdd236-cb19-47e7-8ef9-ef777c6920e2 None None] PATH_INFO: `/` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:25.378942 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 812/1627] 10.222.0.27 () {54 vars in 912 bytes} [Thu Aug 18 22:00:25 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 22:00:25.380535 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa15d515-4476-4932-b947-8e742b870102 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:25.380874 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa15d515-4476-4932-b947-8e742b870102 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:25.381135 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa15d515-4476-4932-b947-8e742b870102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:25.386268 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 816/1628] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 18 22:00:25 2022] PUT /identity/v3/projects/702f236c25fc408aa7ff03fe52797b8d/users/665483b9c7fb40a392ea821acd62f8c1/roles/0833202e2a3d47d1b6b3af57006641b1 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:00:25.387676 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007d6ce4-b7d1-45a4-85c9-68e59d6ab459 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:00:25.450249 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-aa15d515-4476-4932-b947-8e742b870102 None None] MFA Rules not processed for user `a39cd50340184779ac589bbcb7cac9aa`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:00:25.452564 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-aa15d515-4476-4932-b947-8e742b870102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:00:25.556082 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007d6ce4-b7d1-45a4-85c9-68e59d6ab459 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:00:25.572382 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2a0ebc-cdb1-4bc1-a805-ebe6e3950825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:00:25.573206 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2a0ebc-cdb1-4bc1-a805-ebe6e3950825 admin admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:25.573543 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2a0ebc-cdb1-4bc1-a805-ebe6e3950825 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:25.573813 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2a0ebc-cdb1-4bc1-a805-ebe6e3950825 admin admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:25.575535 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2a0ebc-cdb1-4bc1-a805-ebe6e3950825 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:00:25.582549 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2a0ebc-cdb1-4bc1-a805-ebe6e3950825 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:00:25.597143 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 817/1629] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:00:25 2022] GET /identity/v3/roles => generated 1420 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:00:25.598316 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2a0ebc-cdb1-4bc1-a805-ebe6e3950825 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:00:25.614633 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2a0ebc-cdb1-4bc1-a805-ebe6e3950825 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:00:25.621071 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4095d2-63f1-4111-a0e1-9399a8444cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:00:25.621821 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4095d2-63f1-4111-a0e1-9399a8444cab admin admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:25.629070 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4095d2-63f1-4111-a0e1-9399a8444cab admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:25.629070 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4095d2-63f1-4111-a0e1-9399a8444cab admin admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:25.629070 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4095d2-63f1-4111-a0e1-9399a8444cab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:00:25.629070 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4095d2-63f1-4111-a0e1-9399a8444cab admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:00:25.637915 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 818/1630] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:00:25 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:00:25.639987 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0d3a23-4fd1-4e18-b37a-6484b14fff02 None None] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:25.640295 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0d3a23-4fd1-4e18-b37a-6484b14fff02 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:25.641063 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0d3a23-4fd1-4e18-b37a-6484b14fff02 None None] PATH_INFO: `/` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:25.642436 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 819/1631] 10.222.0.27 () {54 vars in 912 bytes} [Thu Aug 18 22:00:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 22:00:25.643150 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0d3a23-4fd1-4e18-b37a-6484b14fff02 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:00:25.656250 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 813/1632] 10.222.0.27 () {58 vars in 1009 bytes} [Thu Aug 18 22:00:25 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:00:25.658731 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa15d515-4476-4932-b947-8e742b870102 None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:00:25.659509 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0d3a23-4fd1-4e18-b37a-6484b14fff02 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:00:25.665777 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1aa2d8-6499-49bf-960e-6cae67f95a9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:00:25.666503 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1aa2d8-6499-49bf-960e-6cae67f95a9b admin admin] REQUEST_METHOD: `PUT` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:25.666792 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1aa2d8-6499-49bf-960e-6cae67f95a9b admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:25.667070 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1aa2d8-6499-49bf-960e-6cae67f95a9b admin admin] PATH_INFO: `/v3/projects/407b1c519cca457f8b6553b6ef1535cd/users/f2252db878da45a8af594d8eeaaac413/roles/0833202e2a3d47d1b6b3af57006641b1` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:25.684962 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa15d515-4476-4932-b947-8e742b870102 None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:00:25.690884 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1aa2d8-6499-49bf-960e-6cae67f95a9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=407b1c519cca457f8b6553b6ef1535cd, user_id=f2252db878da45a8af594d8eeaaac413, role_id=0833202e2a3d47d1b6b3af57006641b1)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:00:25.693791 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1aa2d8-6499-49bf-960e-6cae67f95a9b admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:00:25.696537 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301c9da7-ea4b-4cc5-8868-6c241ef85097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:00:25.698691 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301c9da7-ea4b-4cc5-8868-6c241ef85097 admin admin] REQUEST_METHOD: `PUT` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:25.698989 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301c9da7-ea4b-4cc5-8868-6c241ef85097 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:25.699272 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301c9da7-ea4b-4cc5-8868-6c241ef85097 admin admin] PATH_INFO: `/v3/projects/702f236c25fc408aa7ff03fe52797b8d/users/665483b9c7fb40a392ea821acd62f8c1/roles/0833202e2a3d47d1b6b3af57006641b1` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:25.703846 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301c9da7-ea4b-4cc5-8868-6c241ef85097 admin admin] RBAC: Authorizing `identity:create_grant(project_id=702f236c25fc408aa7ff03fe52797b8d, user_id=665483b9c7fb40a392ea821acd62f8c1, role_id=0833202e2a3d47d1b6b3af57006641b1)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:00:25.708995 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301c9da7-ea4b-4cc5-8868-6c241ef85097 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:00:25.739661 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 814/1633] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 18 22:00:25 2022] PUT /identity/v3/projects/702f236c25fc408aa7ff03fe52797b8d/users/665483b9c7fb40a392ea821acd62f8c1/roles/0833202e2a3d47d1b6b3af57006641b1 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:00:25.742830 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f2264f-8425-44ab-9232-4cf1caf83ada None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:25.743124 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f2264f-8425-44ab-9232-4cf1caf83ada None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:25.756025 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f2264f-8425-44ab-9232-4cf1caf83ada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:25.791670 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-f4f2264f-8425-44ab-9232-4cf1caf83ada None None] MFA Rules not processed for user `a39cd50340184779ac589bbcb7cac9aa`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:00:25.792969 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-f4f2264f-8425-44ab-9232-4cf1caf83ada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:00:25.798294 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 820/1634] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 18 22:00:25 2022] PUT /identity/v3/projects/407b1c519cca457f8b6553b6ef1535cd/users/f2252db878da45a8af594d8eeaaac413/roles/0833202e2a3d47d1b6b3af57006641b1 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:00:25.800092 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1aa2d8-6499-49bf-960e-6cae67f95a9b admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:00:25.875193 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:00:25.916814 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1aa2d8-6499-49bf-960e-6cae67f95a9b admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:00:25.922973 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7e4cd8-020d-47ad-839d-0743d8426c2b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22b6a7c36f8a4795a75271b8079821c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:00:25.923845 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7e4cd8-020d-47ad-839d-0743d8426c2b service cinder] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:25.924133 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7e4cd8-020d-47ad-839d-0743d8426c2b service cinder] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:25.924456 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7e4cd8-020d-47ad-839d-0743d8426c2b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:25.930144 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 815/1635] 10.222.0.27 () {58 vars in 1009 bytes} [Thu Aug 18 22:00:25 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:00:25.931463 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d059ff-afac-48b7-95cb-49169ea1bcbf None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:25.931751 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d059ff-afac-48b7-95cb-49169ea1bcbf None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:25.932030 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d059ff-afac-48b7-95cb-49169ea1bcbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:25.939179 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7e4cd8-020d-47ad-839d-0743d8426c2b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:00:25.940734 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7e4cd8-020d-47ad-839d-0743d8426c2b service cinder] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:00:25.961134 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 821/1636] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:00:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:00:25.962656 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7e4cd8-020d-47ad-839d-0743d8426c2b service cinder] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:00:26.008945 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-29d059ff-afac-48b7-95cb-49169ea1bcbf None None] MFA Rules not processed for user `665483b9c7fb40a392ea821acd62f8c1`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:00:26.011521 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-29d059ff-afac-48b7-95cb-49169ea1bcbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:00:26.090898 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7e4cd8-020d-47ad-839d-0743d8426c2b service cinder] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:00:26.100027 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a8bc6f-f6a7-4878-9590-ba0ff86aea7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:00:26.102070 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a8bc6f-f6a7-4878-9590-ba0ff86aea7a admin admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:26.107716 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a8bc6f-f6a7-4878-9590-ba0ff86aea7a admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:26.107716 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a8bc6f-f6a7-4878-9590-ba0ff86aea7a admin admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:26.107716 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a8bc6f-f6a7-4878-9590-ba0ff86aea7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:00:26.107716 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a8bc6f-f6a7-4878-9590-ba0ff86aea7a admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:00:26.130460 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 822/1637] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:00:25 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:00:26.133874 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a8bc6f-f6a7-4878-9590-ba0ff86aea7a admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:00:26.134377 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 816/1638] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:00:25 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:00:26.137747 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d059ff-afac-48b7-95cb-49169ea1bcbf None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:00:26.156374 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a8bc6f-f6a7-4878-9590-ba0ff86aea7a admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:00:26.160642 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d059ff-afac-48b7-95cb-49169ea1bcbf None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:00:26.166697 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d855e232-84f9-4cae-b483-37aea7741a63 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22b6a7c36f8a4795a75271b8079821c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:00:26.167934 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d855e232-84f9-4cae-b483-37aea7741a63 service cinder] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:26.168958 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d855e232-84f9-4cae-b483-37aea7741a63 service cinder] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:26.170571 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d855e232-84f9-4cae-b483-37aea7741a63 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:26.173046 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4f30cd-40b6-4ad5-a3b7-27686d17bf03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:00:26.174157 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4f30cd-40b6-4ad5-a3b7-27686d17bf03 admin admin] REQUEST_METHOD: `PUT` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:26.175070 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4f30cd-40b6-4ad5-a3b7-27686d17bf03 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:26.176915 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4f30cd-40b6-4ad5-a3b7-27686d17bf03 admin admin] PATH_INFO: `/v3/projects/407b1c519cca457f8b6553b6ef1535cd/users/f2252db878da45a8af594d8eeaaac413/roles/0833202e2a3d47d1b6b3af57006641b1` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:26.181727 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4f30cd-40b6-4ad5-a3b7-27686d17bf03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=407b1c519cca457f8b6553b6ef1535cd, user_id=f2252db878da45a8af594d8eeaaac413, role_id=0833202e2a3d47d1b6b3af57006641b1)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:00:26.190247 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4f30cd-40b6-4ad5-a3b7-27686d17bf03 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:00:26.197783 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d855e232-84f9-4cae-b483-37aea7741a63 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:00:26.200367 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d855e232-84f9-4cae-b483-37aea7741a63 service cinder] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:00:26.215187 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 817/1639] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 18 22:00:26 2022] PUT /identity/v3/projects/407b1c519cca457f8b6553b6ef1535cd/users/f2252db878da45a8af594d8eeaaac413/roles/0833202e2a3d47d1b6b3af57006641b1 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:00:26.242701 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d6b833-d50e-4e6a-aec8-4ed65f921313 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:26.243935 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d6b833-d50e-4e6a-aec8-4ed65f921313 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:26.244345 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d6b833-d50e-4e6a-aec8-4ed65f921313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:26.268136 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 823/1640] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:00:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:00:26.306980 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:00:26.315020 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-09d6b833-d50e-4e6a-aec8-4ed65f921313 None None] MFA Rules not processed for user `f2252db878da45a8af594d8eeaaac413`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:00:26.318469 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-09d6b833-d50e-4e6a-aec8-4ed65f921313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:00:26.615409 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d855e232-84f9-4cae-b483-37aea7741a63 service cinder] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:00:26.615409 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d855e232-84f9-4cae-b483-37aea7741a63 service cinder] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:00:26.626539 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 818/1641] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:00:26 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:00:26.627648 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb52c1b4-61cf-4660-beec-90a5ceb3b74d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22b6a7c36f8a4795a75271b8079821c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:00:26.627648 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb52c1b4-61cf-4660-beec-90a5ceb3b74d service cinder] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:26.627648 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb52c1b4-61cf-4660-beec-90a5ceb3b74d service cinder] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:26.627648 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb52c1b4-61cf-4660-beec-90a5ceb3b74d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:26.629773 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb52c1b4-61cf-4660-beec-90a5ceb3b74d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:00:26.629773 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb52c1b4-61cf-4660-beec-90a5ceb3b74d service cinder] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:00:26.629773 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 824/1642] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:00:26 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 22:00:26.879823 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d6b833-d50e-4e6a-aec8-4ed65f921313 None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:00:26.892852 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d6b833-d50e-4e6a-aec8-4ed65f921313 None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:00:26.913968 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dfa0d1-9f23-47d8-897c-dd605c96957b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22b6a7c36f8a4795a75271b8079821c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:00:26.917096 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dfa0d1-9f23-47d8-897c-dd605c96957b service cinder] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:26.917495 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dfa0d1-9f23-47d8-897c-dd605c96957b service cinder] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:26.918300 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dfa0d1-9f23-47d8-897c-dd605c96957b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:26.957443 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dfa0d1-9f23-47d8-897c-dd605c96957b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:00:26.967411 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dfa0d1-9f23-47d8-897c-dd605c96957b service cinder] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:00:27.001250 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 819/1643] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:00:26 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:00:27.321091 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:00:27.415085 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb52c1b4-61cf-4660-beec-90a5ceb3b74d service cinder] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:00:27.497580 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb52c1b4-61cf-4660-beec-90a5ceb3b74d service cinder] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:00:27.503541 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b517f48b-21c3-4491-b972-b21f24184a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:00:27.504313 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b517f48b-21c3-4491-b972-b21f24184a90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:27.504712 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b517f48b-21c3-4491-b972-b21f24184a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:27.505055 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b517f48b-21c3-4491-b972-b21f24184a90 admin admin] PATH_INFO: `/v3/users/5f63594e64e74fa09ca52e4b0bae1f09` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:27.506384 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b517f48b-21c3-4491-b972-b21f24184a90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f63594e64e74fa09ca52e4b0bae1f09)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:00:27.509655 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b517f48b-21c3-4491-b972-b21f24184a90 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:00:27.576025 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dfa0d1-9f23-47d8-897c-dd605c96957b service cinder] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:00:27.586671 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dfa0d1-9f23-47d8-897c-dd605c96957b service cinder] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:00:27.598059 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260e9785-6d5c-4d84-b4e7-b00730795865 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22b6a7c36f8a4795a75271b8079821c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:00:27.598720 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260e9785-6d5c-4d84-b4e7-b00730795865 service cinder] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:27.599046 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260e9785-6d5c-4d84-b4e7-b00730795865 service cinder] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:27.599365 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260e9785-6d5c-4d84-b4e7-b00730795865 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:27.701014 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:00:27.723819 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260e9785-6d5c-4d84-b4e7-b00730795865 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:00:27.725358 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260e9785-6d5c-4d84-b4e7-b00730795865 service cinder] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:00:27.753145 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 820/1644] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:00:27 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:00:27.754023 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260e9785-6d5c-4d84-b4e7-b00730795865 service cinder] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:00:27.773950 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260e9785-6d5c-4d84-b4e7-b00730795865 service cinder] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:00:27.785036 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21931c7-c3b4-4034-ab84-cd0923e68f47 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22b6a7c36f8a4795a75271b8079821c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:00:27.785985 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21931c7-c3b4-4034-ab84-cd0923e68f47 service cinder] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:27.786268 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21931c7-c3b4-4034-ab84-cd0923e68f47 service cinder] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:27.786548 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21931c7-c3b4-4034-ab84-cd0923e68f47 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:27.818747 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-b517f48b-21c3-4491-b972-b21f24184a90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f63594e64e74fa09ca52e4b0bae1f09'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:00:27.838524 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-b517f48b-21c3-4491-b972-b21f24184a90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f63594e64e74fa09ca52e4b0bae1f09'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:00:27.839394 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-b517f48b-21c3-4491-b972-b21f24184a90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f63594e64e74fa09ca52e4b0bae1f09'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:00:27.873195 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-b517f48b-21c3-4491-b972-b21f24184a90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f63594e64e74fa09ca52e4b0bae1f09'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:00:27.925916 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21931c7-c3b4-4034-ab84-cd0923e68f47 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:00:27.927939 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21931c7-c3b4-4034-ab84-cd0923e68f47 service cinder] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:00:27.958754 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 821/1645] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:00:27 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:00:27.977560 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-b517f48b-21c3-4491-b972-b21f24184a90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f63594e64e74fa09ca52e4b0bae1f09'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:00:27.991749 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 825/1646] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 18 22:00:27 2022] DELETE /identity/v3/users/5f63594e64e74fa09ca52e4b0bae1f09 => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:00:27.993209 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69504fdc-047e-47a0-8e83-7f9cd0a3c51f None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:27.993501 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69504fdc-047e-47a0-8e83-7f9cd0a3c51f None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:27.993781 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69504fdc-047e-47a0-8e83-7f9cd0a3c51f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:28.039948 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-69504fdc-047e-47a0-8e83-7f9cd0a3c51f None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:00:28.041554 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-69504fdc-047e-47a0-8e83-7f9cd0a3c51f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:00:28.202231 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 822/1647] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:00:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:00:28.298547 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b517f48b-21c3-4491-b972-b21f24184a90 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:00:28.302326 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-b517f48b-21c3-4491-b972-b21f24184a90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:00:28.528766 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b517f48b-21c3-4491-b972-b21f24184a90 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:00:28.541484 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ee421f-462b-4fc3-90db-57784f8c9e52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a937971ad1a4b0c8697c764f214d446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:00:28.545854 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ee421f-462b-4fc3-90db-57784f8c9e52 service neutron] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:28.546887 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ee421f-462b-4fc3-90db-57784f8c9e52 service neutron] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:28.549806 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ee421f-462b-4fc3-90db-57784f8c9e52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:28.572620 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ee421f-462b-4fc3-90db-57784f8c9e52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:00:28.574394 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ee421f-462b-4fc3-90db-57784f8c9e52 service neutron] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:00:28.606052 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 826/1648] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:00:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:00:28.756211 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:00:29.150079 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:00:30.351096 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69504fdc-047e-47a0-8e83-7f9cd0a3c51f None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:00:30.352246 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-69504fdc-047e-47a0-8e83-7f9cd0a3c51f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:00:30.378310 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69504fdc-047e-47a0-8e83-7f9cd0a3c51f None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:00:30.393541 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cab7f67-d5c8-4f9f-bbf8-8ae7d361cfb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:00:30.394514 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cab7f67-d5c8-4f9f-bbf8-8ae7d361cfb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:30.394895 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cab7f67-d5c8-4f9f-bbf8-8ae7d361cfb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:30.395389 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cab7f67-d5c8-4f9f-bbf8-8ae7d361cfb5 admin admin] PATH_INFO: `/v3/projects/3d07c3567fb745e8b8a6c30e9d3e18a7` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:30.397841 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cab7f67-d5c8-4f9f-bbf8-8ae7d361cfb5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d07c3567fb745e8b8a6c30e9d3e18a7)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:00:30.402378 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cab7f67-d5c8-4f9f-bbf8-8ae7d361cfb5 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:00:30.608267 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-8cab7f67-d5c8-4f9f-bbf8-8ae7d361cfb5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d07c3567fb745e8b8a6c30e9d3e18a7', 'request_id': 'req-8cab7f67-d5c8-4f9f-bbf8-8ae7d361cfb5'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:00:30.626782 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-8cab7f67-d5c8-4f9f-bbf8-8ae7d361cfb5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d07c3567fb745e8b8a6c30e9d3e18a7', 'request_id': 'req-8cab7f67-d5c8-4f9f-bbf8-8ae7d361cfb5'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:00:30.735352 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-8cab7f67-d5c8-4f9f-bbf8-8ae7d361cfb5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d07c3567fb745e8b8a6c30e9d3e18a7', 'request_id': 'req-8cab7f67-d5c8-4f9f-bbf8-8ae7d361cfb5'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:00:30.772454 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-8cab7f67-d5c8-4f9f-bbf8-8ae7d361cfb5 admin admin] The token cache is being invalidate because project 3d07c3567fb745e8b8a6c30e9d3e18a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88096) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 22:00:30.772832 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-8cab7f67-d5c8-4f9f-bbf8-8ae7d361cfb5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:00:30.776387 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-8cab7f67-d5c8-4f9f-bbf8-8ae7d361cfb5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:00:30.785780 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 823/1649] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 18 22:00:30 2022] DELETE /identity/v3/projects/3d07c3567fb745e8b8a6c30e9d3e18a7 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:00:30.791813 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e593910b-6696-4e61-9b21-6e1e9ab7f2eb None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:30.792423 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e593910b-6696-4e61-9b21-6e1e9ab7f2eb None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:30.792423 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e593910b-6696-4e61-9b21-6e1e9ab7f2eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:30.865673 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-e593910b-6696-4e61-9b21-6e1e9ab7f2eb None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:00:30.869848 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-e593910b-6696-4e61-9b21-6e1e9ab7f2eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:00:31.130944 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 827/1650] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:00:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:00:31.142236 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43129049-758d-4146-be16-ac0a874f4b75 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:31.142236 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43129049-758d-4146-be16-ac0a874f4b75 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:31.150324 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43129049-758d-4146-be16-ac0a874f4b75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:31.234074 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-43129049-758d-4146-be16-ac0a874f4b75 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:00:31.235493 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-43129049-758d-4146-be16-ac0a874f4b75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:00:31.268186 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 824/1651] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:00:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:00:31.269476 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e593910b-6696-4e61-9b21-6e1e9ab7f2eb None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:00:31.295783 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e593910b-6696-4e61-9b21-6e1e9ab7f2eb None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:00:31.314836 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9111d225-aa98-4f64-87a1-0a73177190de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:00:31.315685 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9111d225-aa98-4f64-87a1-0a73177190de admin admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:31.317362 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9111d225-aa98-4f64-87a1-0a73177190de admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:31.317362 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9111d225-aa98-4f64-87a1-0a73177190de admin admin] PATH_INFO: `/v3/domains` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:31.317362 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9111d225-aa98-4f64-87a1-0a73177190de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 22:00:31.317362 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9111d225-aa98-4f64-87a1-0a73177190de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:00:31.318791 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9111d225-aa98-4f64-87a1-0a73177190de admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:00:31.347609 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 828/1652] 10.222.0.27 () {58 vars in 1153 bytes} [Thu Aug 18 22:00:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 22:00:31.348559 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43129049-758d-4146-be16-ac0a874f4b75 None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:00:31.375807 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43129049-758d-4146-be16-ac0a874f4b75 None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:00:31.376811 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8581d9a-712a-4ec3-b055-3a7024549842 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:31.377257 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8581d9a-712a-4ec3-b055-3a7024549842 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:31.377667 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8581d9a-712a-4ec3-b055-3a7024549842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:31.383360 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96245a5-2235-45ba-9933-abe841ebc31d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:00:31.383990 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96245a5-2235-45ba-9933-abe841ebc31d admin admin] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:31.384269 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96245a5-2235-45ba-9933-abe841ebc31d admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:31.384542 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96245a5-2235-45ba-9933-abe841ebc31d admin admin] PATH_INFO: `/v3/projects` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:31.385215 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96245a5-2235-45ba-9933-abe841ebc31d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:00:31.387117 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96245a5-2235-45ba-9933-abe841ebc31d admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:00:31.449625 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-f8581d9a-712a-4ec3-b055-3a7024549842 None None] MFA Rules not processed for user `886cb8649faf4bbdb7e290915b6c275d`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:00:31.451834 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-f8581d9a-712a-4ec3-b055-3a7024549842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:00:31.507060 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 825/1653] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 18 22:00:31 2022] POST /identity/v3/projects => generated 405 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 22:00:31.508262 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96245a5-2235-45ba-9933-abe841ebc31d admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:00:31.511892 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-b96245a5-2235-45ba-9933-abe841ebc31d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:00:31.589017 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 829/1654] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:00:31 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:00:31.593866 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8581d9a-712a-4ec3-b055-3a7024549842 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:00:31.614701 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96245a5-2235-45ba-9933-abe841ebc31d admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:00:31.621707 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6054f97-ede8-4a62-82c5-ff4f2943a954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:00:31.622544 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6054f97-ede8-4a62-82c5-ff4f2943a954 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:31.622942 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6054f97-ede8-4a62-82c5-ff4f2943a954 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:31.623284 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6054f97-ede8-4a62-82c5-ff4f2943a954 admin admin] PATH_INFO: `/v3/users/b563386ee308443dac30642c6332443c` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:31.625318 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6054f97-ede8-4a62-82c5-ff4f2943a954 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b563386ee308443dac30642c6332443c)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:00:31.626665 dv-cinder-853678-3-smb devstack@keystone.service[88096]: WARNING py.warnings [None req-b6054f97-ede8-4a62-82c5-ff4f2943a954 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 18 22:00:31.626665 dv-cinder-853678-3-smb devstack@keystone.service[88096]: warnings.warn(msg) Aug 18 22:00:31.626665 dv-cinder-853678-3-smb devstack@keystone.service[88096]: Aug 18 22:00:31.628304 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6054f97-ede8-4a62-82c5-ff4f2943a954 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:00:31.630397 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8581d9a-712a-4ec3-b055-3a7024549842 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:00:31.634452 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:00:31.645918 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f7a877-bf77-4aae-a582-7a34cf184085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:00:31.647235 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f7a877-bf77-4aae-a582-7a34cf184085 admin admin] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:31.647744 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f7a877-bf77-4aae-a582-7a34cf184085 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:31.648148 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f7a877-bf77-4aae-a582-7a34cf184085 admin admin] PATH_INFO: `/v3/users` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:31.648951 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f7a877-bf77-4aae-a582-7a34cf184085 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:00:31.651030 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f7a877-bf77-4aae-a582-7a34cf184085 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:00:31.867186 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 830/1655] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 18 22:00:31 2022] POST /identity/v3/users => generated 303 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 22:00:31.869743 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcf0adf-6c0e-4b13-9851-2d3784624d56 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:31.870316 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcf0adf-6c0e-4b13-9851-2d3784624d56 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:31.870776 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcf0adf-6c0e-4b13-9851-2d3784624d56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:31.911625 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-3bcf0adf-6c0e-4b13-9851-2d3784624d56 None None] MFA Rules not processed for user `886cb8649faf4bbdb7e290915b6c275d`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:00:31.913222 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-3bcf0adf-6c0e-4b13-9851-2d3784624d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:00:31.938866 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-b6054f97-ede8-4a62-82c5-ff4f2943a954 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b563386ee308443dac30642c6332443c'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:00:31.961006 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-b6054f97-ede8-4a62-82c5-ff4f2943a954 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b563386ee308443dac30642c6332443c'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:00:31.961823 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-b6054f97-ede8-4a62-82c5-ff4f2943a954 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b563386ee308443dac30642c6332443c'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:00:31.972991 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-b6054f97-ede8-4a62-82c5-ff4f2943a954 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b563386ee308443dac30642c6332443c'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:00:31.978739 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:00:32.003284 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-b6054f97-ede8-4a62-82c5-ff4f2943a954 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b563386ee308443dac30642c6332443c'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:00:32.094301 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 826/1656] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 18 22:00:31 2022] DELETE /identity/v3/users/b563386ee308443dac30642c6332443c => generated 0 bytes in 586 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:00:32.098611 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6054f97-ede8-4a62-82c5-ff4f2943a954 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:00:32.101229 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-b6054f97-ede8-4a62-82c5-ff4f2943a954 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:00:32.113302 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 831/1657] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:00:31 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:00:32.118260 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb122b6e-385e-4393-9089-6efae0a9e485 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:32.119765 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb122b6e-385e-4393-9089-6efae0a9e485 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:32.120243 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb122b6e-385e-4393-9089-6efae0a9e485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:32.178617 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-eb122b6e-385e-4393-9089-6efae0a9e485 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:00:32.181120 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-eb122b6e-385e-4393-9089-6efae0a9e485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:00:32.235656 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6054f97-ede8-4a62-82c5-ff4f2943a954 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:00:32.243733 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16059a33-f103-41a9-a251-2ee56c520185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:00:32.244376 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16059a33-f103-41a9-a251-2ee56c520185 admin admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:32.244691 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16059a33-f103-41a9-a251-2ee56c520185 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:32.244965 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16059a33-f103-41a9-a251-2ee56c520185 admin admin] PATH_INFO: `/v3/roles` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:32.245618 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16059a33-f103-41a9-a251-2ee56c520185 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:00:32.247996 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16059a33-f103-41a9-a251-2ee56c520185 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:00:32.277171 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 827/1658] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:00:32 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:00:32.278581 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16059a33-f103-41a9-a251-2ee56c520185 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:00:32.283155 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-16059a33-f103-41a9-a251-2ee56c520185 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:00:32.423673 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 832/1659] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:00:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:00:32.425932 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb122b6e-385e-4393-9089-6efae0a9e485 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:00:32.466017 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb122b6e-385e-4393-9089-6efae0a9e485 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:00:32.468414 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16059a33-f103-41a9-a251-2ee56c520185 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:00:32.475735 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cc22d7-ec32-400c-991d-3f18b8762830 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a39cd50340184779ac589bbcb7cac9aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:00:32.477245 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cc22d7-ec32-400c-991d-3f18b8762830 service nova] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:32.478415 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cc22d7-ec32-400c-991d-3f18b8762830 service nova] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:32.478958 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cc22d7-ec32-400c-991d-3f18b8762830 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:32.481645 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-15cc22d7-ec32-400c-991d-3f18b8762830 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:00:32.488026 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45ded4c-5b57-41fa-9c38-d3fb574c6722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:00:32.489226 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45ded4c-5b57-41fa-9c38-d3fb574c6722 admin admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:32.489748 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45ded4c-5b57-41fa-9c38-d3fb574c6722 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:32.490265 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45ded4c-5b57-41fa-9c38-d3fb574c6722 admin admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:32.491498 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45ded4c-5b57-41fa-9c38-d3fb574c6722 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:00:32.494828 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45ded4c-5b57-41fa-9c38-d3fb574c6722 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:00:32.569475 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 833/1660] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:00:32 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:00:32.575455 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45ded4c-5b57-41fa-9c38-d3fb574c6722 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:00:32.585481 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-d45ded4c-5b57-41fa-9c38-d3fb574c6722 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:00:32.634041 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cc22d7-ec32-400c-991d-3f18b8762830 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:00:32.639178 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cc22d7-ec32-400c-991d-3f18b8762830 service nova] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:00:32.662960 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 828/1661] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:00:32 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:00:32.664268 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cc22d7-ec32-400c-991d-3f18b8762830 service nova] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:00:32.677438 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cc22d7-ec32-400c-991d-3f18b8762830 service nova] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:00:32.683425 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9da9929-d213-48f5-8065-9a08ec65d42c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:00:32.684620 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9da9929-d213-48f5-8065-9a08ec65d42c admin admin] REQUEST_METHOD: `PUT` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:32.684913 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9da9929-d213-48f5-8065-9a08ec65d42c admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:32.691518 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9da9929-d213-48f5-8065-9a08ec65d42c admin admin] PATH_INFO: `/v3/projects/97f1859f6b8b484598f58fbf038f5f11/users/caee90eae9b34b8aadee392ac10e244b/roles/de8f2438056f4af9879423f8a59e0e0b` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:32.722568 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9da9929-d213-48f5-8065-9a08ec65d42c admin admin] RBAC: Authorizing `identity:create_grant(project_id=97f1859f6b8b484598f58fbf038f5f11, user_id=caee90eae9b34b8aadee392ac10e244b, role_id=de8f2438056f4af9879423f8a59e0e0b)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:00:32.729195 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9da9929-d213-48f5-8065-9a08ec65d42c admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:00:32.730876 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45ded4c-5b57-41fa-9c38-d3fb574c6722 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:00:32.740002 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189705a7-ba66-4c69-9a64-0a5d9bd6a171 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a937971ad1a4b0c8697c764f214d446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:00:32.740884 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189705a7-ba66-4c69-9a64-0a5d9bd6a171 service neutron] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:32.741169 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189705a7-ba66-4c69-9a64-0a5d9bd6a171 service neutron] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:32.741457 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189705a7-ba66-4c69-9a64-0a5d9bd6a171 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:32.753724 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189705a7-ba66-4c69-9a64-0a5d9bd6a171 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:00:32.756170 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189705a7-ba66-4c69-9a64-0a5d9bd6a171 service neutron] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:00:32.769699 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 834/1662] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:00:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:00:32.861269 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 829/1663] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 18 22:00:32 2022] PUT /identity/v3/projects/97f1859f6b8b484598f58fbf038f5f11/users/caee90eae9b34b8aadee392ac10e244b/roles/de8f2438056f4af9879423f8a59e0e0b => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:00:32.863882 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b96d913-e142-421f-9f60-36050f6d003f None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:32.864721 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b96d913-e142-421f-9f60-36050f6d003f None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:32.865107 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b96d913-e142-421f-9f60-36050f6d003f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:32.907306 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-0b96d913-e142-421f-9f60-36050f6d003f None None] MFA Rules not processed for user `caee90eae9b34b8aadee392ac10e244b`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:00:32.909365 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-0b96d913-e142-421f-9f60-36050f6d003f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:00:33.040495 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:00:33.044057 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 835/1664] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:00:32 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:00:33.048581 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9da9929-d213-48f5-8065-9a08ec65d42c admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:00:33.265016 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9da9929-d213-48f5-8065-9a08ec65d42c admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:00:33.274312 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ce91c6-98a0-408a-bda5-fff66f1c9399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:00:33.275004 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ce91c6-98a0-408a-bda5-fff66f1c9399 admin admin] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:33.275323 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ce91c6-98a0-408a-bda5-fff66f1c9399 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:33.275767 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ce91c6-98a0-408a-bda5-fff66f1c9399 admin admin] PATH_INFO: `/v3/projects` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:33.277595 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ce91c6-98a0-408a-bda5-fff66f1c9399 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:00:33.279651 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ce91c6-98a0-408a-bda5-fff66f1c9399 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:00:33.449525 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 830/1665] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 18 22:00:33 2022] POST /identity/v3/projects => generated 405 bytes in 401 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 22:00:33.454223 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b96d913-e142-421f-9f60-36050f6d003f None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:00:33.470193 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b96d913-e142-421f-9f60-36050f6d003f None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:00:33.523657 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:00:33.623630 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be656a9f-ac30-444c-98bf-e972a502d440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:00:33.624270 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be656a9f-ac30-444c-98bf-e972a502d440 admin admin] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:33.624717 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be656a9f-ac30-444c-98bf-e972a502d440 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:33.624930 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be656a9f-ac30-444c-98bf-e972a502d440 admin admin] PATH_INFO: `/v3/users` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:33.625666 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be656a9f-ac30-444c-98bf-e972a502d440 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:00:33.630663 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be656a9f-ac30-444c-98bf-e972a502d440 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:00:33.734737 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 836/1666] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 18 22:00:33 2022] POST /identity/v3/users => generated 309 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 22:00:33.736234 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ce91c6-98a0-408a-bda5-fff66f1c9399 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:00:33.763848 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ce91c6-98a0-408a-bda5-fff66f1c9399 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:00:33.777576 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e1f9dd-0a85-4f9a-8f14-7ca2ab51f3c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:00:33.778451 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e1f9dd-0a85-4f9a-8f14-7ca2ab51f3c5 admin admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:33.778889 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e1f9dd-0a85-4f9a-8f14-7ca2ab51f3c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:33.779298 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e1f9dd-0a85-4f9a-8f14-7ca2ab51f3c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:33.780080 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e1f9dd-0a85-4f9a-8f14-7ca2ab51f3c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:00:33.786058 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e1f9dd-0a85-4f9a-8f14-7ca2ab51f3c5 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:00:33.813535 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 831/1667] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:00:33 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:00:33.816116 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be656a9f-ac30-444c-98bf-e972a502d440 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:00:33.834511 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be656a9f-ac30-444c-98bf-e972a502d440 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:00:33.850667 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd9eebc-522f-4d3e-a1ae-a03d923ba275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:00:33.852403 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd9eebc-522f-4d3e-a1ae-a03d923ba275 admin admin] REQUEST_METHOD: `PUT` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:33.852875 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd9eebc-522f-4d3e-a1ae-a03d923ba275 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:33.853303 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd9eebc-522f-4d3e-a1ae-a03d923ba275 admin admin] PATH_INFO: `/v3/projects/1c69cde10fa5486f8ba0e6a2396f87e8/users/3de5e0b01dd7488ca265e7faad072439/roles/0833202e2a3d47d1b6b3af57006641b1` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:33.890744 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd9eebc-522f-4d3e-a1ae-a03d923ba275 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c69cde10fa5486f8ba0e6a2396f87e8, user_id=3de5e0b01dd7488ca265e7faad072439, role_id=0833202e2a3d47d1b6b3af57006641b1)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:00:33.894449 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd9eebc-522f-4d3e-a1ae-a03d923ba275 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:00:34.020319 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb389555-d772-4ece-bfd6-1950c00f3e1f None None] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:34.021226 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb389555-d772-4ece-bfd6-1950c00f3e1f None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:34.021226 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb389555-d772-4ece-bfd6-1950c00f3e1f None None] PATH_INFO: `/` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:34.022646 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 832/1668] 10.222.0.27 () {54 vars in 912 bytes} [Thu Aug 18 22:00:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 22:00:34.029486 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f0f120-e45a-45cb-ab1b-648e051a7625 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:34.029773 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f0f120-e45a-45cb-ab1b-648e051a7625 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:34.030047 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f0f120-e45a-45cb-ab1b-648e051a7625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:34.045234 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 837/1669] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 18 22:00:33 2022] PUT /identity/v3/projects/1c69cde10fa5486f8ba0e6a2396f87e8/users/3de5e0b01dd7488ca265e7faad072439/roles/0833202e2a3d47d1b6b3af57006641b1 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:00:34.082410 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd9eebc-522f-4d3e-a1ae-a03d923ba275 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:00:34.138734 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-87f0f120-e45a-45cb-ab1b-648e051a7625 None None] MFA Rules not processed for user `6a937971ad1a4b0c8697c764f214d446`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:00:34.139971 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-87f0f120-e45a-45cb-ab1b-648e051a7625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:00:34.211654 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 833/1670] 10.222.0.27 () {58 vars in 1009 bytes} [Thu Aug 18 22:00:34 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:00:34.228330 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f0f120-e45a-45cb-ab1b-648e051a7625 None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:00:34.229935 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-87f0f120-e45a-45cb-ab1b-648e051a7625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:00:34.246656 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f0f120-e45a-45cb-ab1b-648e051a7625 None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:00:34.275845 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beff4e2a-e381-4953-ab45-34b46a3f125c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a937971ad1a4b0c8697c764f214d446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:00:34.277366 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beff4e2a-e381-4953-ab45-34b46a3f125c service neutron] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:34.277658 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beff4e2a-e381-4953-ab45-34b46a3f125c service neutron] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:34.277926 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beff4e2a-e381-4953-ab45-34b46a3f125c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:34.310673 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beff4e2a-e381-4953-ab45-34b46a3f125c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:00:34.314725 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beff4e2a-e381-4953-ab45-34b46a3f125c service neutron] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:00:34.344246 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 834/1671] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:00:34 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 22:00:34.366098 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd9eebc-522f-4d3e-a1ae-a03d923ba275 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:00:34.381875 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd13b505-a8da-4234-8dfc-752f9e7ccdb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:00:34.382676 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd13b505-a8da-4234-8dfc-752f9e7ccdb2 admin admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:34.382960 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd13b505-a8da-4234-8dfc-752f9e7ccdb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:34.383421 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd13b505-a8da-4234-8dfc-752f9e7ccdb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:34.384088 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd13b505-a8da-4234-8dfc-752f9e7ccdb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:00:34.385865 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd13b505-a8da-4234-8dfc-752f9e7ccdb2 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:00:34.404350 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beff4e2a-e381-4953-ab45-34b46a3f125c service neutron] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:00:34.406120 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-beff4e2a-e381-4953-ab45-34b46a3f125c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:00:34.428402 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 838/1672] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:00:34 2022] GET /identity/v3/roles => generated 1420 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:00:34.432083 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd13b505-a8da-4234-8dfc-752f9e7ccdb2 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:00:34.444481 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beff4e2a-e381-4953-ab45-34b46a3f125c service neutron] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:00:34.461333 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ddaa47-4c0e-4812-b7a5-68d3e134ee13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:00:34.462006 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ddaa47-4c0e-4812-b7a5-68d3e134ee13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:34.462293 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ddaa47-4c0e-4812-b7a5-68d3e134ee13 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:34.462573 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ddaa47-4c0e-4812-b7a5-68d3e134ee13 admin admin] PATH_INFO: `/v3/projects/6d199df8ae164ecc99076c0054bf03f9` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:34.464830 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ddaa47-4c0e-4812-b7a5-68d3e134ee13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d199df8ae164ecc99076c0054bf03f9)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:00:34.466951 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ddaa47-4c0e-4812-b7a5-68d3e134ee13 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:00:34.467072 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd13b505-a8da-4234-8dfc-752f9e7ccdb2 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:00:34.478988 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b56dead-c90c-4014-9174-661c7df065e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:00:34.482230 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b56dead-c90c-4014-9174-661c7df065e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:34.482515 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b56dead-c90c-4014-9174-661c7df065e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:34.485216 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b56dead-c90c-4014-9174-661c7df065e5 admin admin] PATH_INFO: `/v3/projects/1c69cde10fa5486f8ba0e6a2396f87e8/users/3de5e0b01dd7488ca265e7faad072439/roles/0833202e2a3d47d1b6b3af57006641b1` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:34.488472 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b56dead-c90c-4014-9174-661c7df065e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c69cde10fa5486f8ba0e6a2396f87e8, user_id=3de5e0b01dd7488ca265e7faad072439, role_id=0833202e2a3d47d1b6b3af57006641b1)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:00:34.497366 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b56dead-c90c-4014-9174-661c7df065e5 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:00:34.539071 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 839/1673] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 18 22:00:34 2022] PUT /identity/v3/projects/1c69cde10fa5486f8ba0e6a2396f87e8/users/3de5e0b01dd7488ca265e7faad072439/roles/0833202e2a3d47d1b6b3af57006641b1 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:00:34.542503 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e214f8-5d71-4cec-892c-71899fe01fa6 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:34.542806 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e214f8-5d71-4cec-892c-71899fe01fa6 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:34.543078 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e214f8-5d71-4cec-892c-71899fe01fa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:34.620330 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-12e214f8-5d71-4cec-892c-71899fe01fa6 None None] MFA Rules not processed for user `3de5e0b01dd7488ca265e7faad072439`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:00:34.624130 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-12e214f8-5d71-4cec-892c-71899fe01fa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:00:34.654106 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-67ddaa47-4c0e-4812-b7a5-68d3e134ee13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d199df8ae164ecc99076c0054bf03f9', 'request_id': 'req-67ddaa47-4c0e-4812-b7a5-68d3e134ee13'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:00:34.660839 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:00:34.671938 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-67ddaa47-4c0e-4812-b7a5-68d3e134ee13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d199df8ae164ecc99076c0054bf03f9', 'request_id': 'req-67ddaa47-4c0e-4812-b7a5-68d3e134ee13'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:00:34.755544 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 840/1674] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:00:34 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:00:34.757086 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6954f65d-e192-4c45-9b0f-3e28707a45d1 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:34.757631 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6954f65d-e192-4c45-9b0f-3e28707a45d1 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:34.757720 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6954f65d-e192-4c45-9b0f-3e28707a45d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:34.768886 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-67ddaa47-4c0e-4812-b7a5-68d3e134ee13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d199df8ae164ecc99076c0054bf03f9', 'request_id': 'req-67ddaa47-4c0e-4812-b7a5-68d3e134ee13'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:00:34.787550 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-67ddaa47-4c0e-4812-b7a5-68d3e134ee13 admin admin] The token cache is being invalidate because project 6d199df8ae164ecc99076c0054bf03f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88096) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 22:00:34.787967 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-67ddaa47-4c0e-4812-b7a5-68d3e134ee13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:00:34.788791 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-67ddaa47-4c0e-4812-b7a5-68d3e134ee13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:00:34.794298 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 835/1675] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 18 22:00:34 2022] DELETE /identity/v3/projects/6d199df8ae164ecc99076c0054bf03f9 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:00:34.795345 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ddaa47-4c0e-4812-b7a5-68d3e134ee13 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:00:34.798359 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-67ddaa47-4c0e-4812-b7a5-68d3e134ee13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:00:34.873885 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-6954f65d-e192-4c45-9b0f-3e28707a45d1 None None] MFA Rules not processed for user `4ca7e9098815480f89b2a9a8a222ae5e`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:00:34.879233 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-6954f65d-e192-4c45-9b0f-3e28707a45d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:00:34.957252 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ddaa47-4c0e-4812-b7a5-68d3e134ee13 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:00:34.975326 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d70430-27e6-4191-b270-aab942b7a247 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22b6a7c36f8a4795a75271b8079821c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:00:34.976068 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d70430-27e6-4191-b270-aab942b7a247 service cinder] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:34.976425 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d70430-27e6-4191-b270-aab942b7a247 service cinder] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:34.976851 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d70430-27e6-4191-b270-aab942b7a247 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:34.981503 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-52d70430-27e6-4191-b270-aab942b7a247 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:00:35.023263 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d70430-27e6-4191-b270-aab942b7a247 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:00:35.025419 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d70430-27e6-4191-b270-aab942b7a247 service cinder] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:00:35.052949 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 841/1676] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:00:34 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:00:35.054442 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0f3d50-6a2e-4e89-a463-c33ed137d9cb None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:35.056448 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0f3d50-6a2e-4e89-a463-c33ed137d9cb None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:35.056874 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0f3d50-6a2e-4e89-a463-c33ed137d9cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:35.065004 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 836/1677] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:00:34 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:00:35.076467 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d70430-27e6-4191-b270-aab942b7a247 service cinder] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:00:35.083308 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-52d70430-27e6-4191-b270-aab942b7a247 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:00:35.101688 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-9c0f3d50-6a2e-4e89-a463-c33ed137d9cb None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:00:35.103236 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-9c0f3d50-6a2e-4e89-a463-c33ed137d9cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:00:35.300676 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 842/1678] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:00:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:00:35.307211 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51bc0bd-ed52-4389-a5bc-1a345b0956b7 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:35.307607 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51bc0bd-ed52-4389-a5bc-1a345b0956b7 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:35.307990 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51bc0bd-ed52-4389-a5bc-1a345b0956b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:35.394655 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d70430-27e6-4191-b270-aab942b7a247 service cinder] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:00:35.409806 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-c51bc0bd-ed52-4389-a5bc-1a345b0956b7 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:00:35.412038 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62ed88f-9309-4438-ba20-44f4a92276d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a39cd50340184779ac589bbcb7cac9aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:00:35.415606 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62ed88f-9309-4438-ba20-44f4a92276d9 service nova] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:35.415606 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62ed88f-9309-4438-ba20-44f4a92276d9 service nova] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:35.416432 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-c51bc0bd-ed52-4389-a5bc-1a345b0956b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:00:35.422575 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62ed88f-9309-4438-ba20-44f4a92276d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:35.454340 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62ed88f-9309-4438-ba20-44f4a92276d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:00:35.457588 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 843/1679] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:00:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:00:35.468897 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51bc0bd-ed52-4389-a5bc-1a345b0956b7 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:00:35.471159 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62ed88f-9309-4438-ba20-44f4a92276d9 service nova] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:00:35.481496 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:00:35.528975 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51bc0bd-ed52-4389-a5bc-1a345b0956b7 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:00:35.554311 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 837/1680] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:00:35 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:00:35.573786 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1d559f-028c-4124-94e1-0a4713487b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:00:35.577961 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1d559f-028c-4124-94e1-0a4713487b52 admin admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:35.580274 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1d559f-028c-4124-94e1-0a4713487b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:35.580608 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1d559f-028c-4124-94e1-0a4713487b52 admin admin] PATH_INFO: `/v3/domains` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:35.581311 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1d559f-028c-4124-94e1-0a4713487b52 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 22:00:35.581625 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1d559f-028c-4124-94e1-0a4713487b52 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:00:35.583325 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1d559f-028c-4124-94e1-0a4713487b52 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:00:35.638886 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 844/1681] 10.222.0.27 () {58 vars in 1153 bytes} [Thu Aug 18 22:00:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 22:00:35.640280 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62ed88f-9309-4438-ba20-44f4a92276d9 service nova] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:00:35.662572 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1d559f-028c-4124-94e1-0a4713487b52 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:00:35.664022 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62ed88f-9309-4438-ba20-44f4a92276d9 service nova] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:00:35.672395 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-ca1d559f-028c-4124-94e1-0a4713487b52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:00:35.689910 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f364f71-77da-4e8b-bedd-fcfb98cec386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:00:35.690539 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f364f71-77da-4e8b-bedd-fcfb98cec386 admin admin] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:35.690824 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f364f71-77da-4e8b-bedd-fcfb98cec386 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:35.691172 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f364f71-77da-4e8b-bedd-fcfb98cec386 admin admin] PATH_INFO: `/v3/projects` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:35.691898 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f364f71-77da-4e8b-bedd-fcfb98cec386 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:00:35.693947 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f364f71-77da-4e8b-bedd-fcfb98cec386 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:00:35.728197 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1d559f-028c-4124-94e1-0a4713487b52 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:00:35.764633 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1772af41-1508-48e8-b529-a0f2912b65fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:00:35.765893 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1772af41-1508-48e8-b529-a0f2912b65fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:35.766328 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1772af41-1508-48e8-b529-a0f2912b65fe admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:35.766754 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1772af41-1508-48e8-b529-a0f2912b65fe admin admin] PATH_INFO: `/v3/users/caee90eae9b34b8aadee392ac10e244b` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:35.788380 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1772af41-1508-48e8-b529-a0f2912b65fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=caee90eae9b34b8aadee392ac10e244b)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:00:35.790631 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1772af41-1508-48e8-b529-a0f2912b65fe admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:00:35.932348 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 838/1682] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 18 22:00:35 2022] POST /identity/v3/projects => generated 357 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 22:00:35.936752 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f364f71-77da-4e8b-bedd-fcfb98cec386 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:00:36.074448 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f364f71-77da-4e8b-bedd-fcfb98cec386 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:00:36.082316 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1844c62-454e-451b-bf95-12944740b1b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:00:36.082316 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1844c62-454e-451b-bf95-12944740b1b6 admin admin] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:36.082316 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1844c62-454e-451b-bf95-12944740b1b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:36.082316 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1844c62-454e-451b-bf95-12944740b1b6 admin admin] PATH_INFO: `/v3/users` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:36.082762 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1844c62-454e-451b-bf95-12944740b1b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:00:36.084492 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1844c62-454e-451b-bf95-12944740b1b6 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:00:36.166008 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-1772af41-1508-48e8-b529-a0f2912b65fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'caee90eae9b34b8aadee392ac10e244b'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:00:36.211894 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-1772af41-1508-48e8-b529-a0f2912b65fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'caee90eae9b34b8aadee392ac10e244b'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:00:36.222101 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-1772af41-1508-48e8-b529-a0f2912b65fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'caee90eae9b34b8aadee392ac10e244b'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:00:36.235078 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 839/1683] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 18 22:00:35 2022] POST /identity/v3/users => generated 279 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 22:00:36.237278 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db58a072-d783-462c-9b83-4a319f23444f None None] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:36.242360 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db58a072-d783-462c-9b83-4a319f23444f None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:36.242360 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db58a072-d783-462c-9b83-4a319f23444f None None] PATH_INFO: `/` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:36.247723 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 840/1684] 10.222.0.27 () {54 vars in 961 bytes} [Thu Aug 18 22:00:36 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 22:00:36.249351 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12df818e-f6ca-4d9e-b86b-7d2909d420d1 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:36.250632 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12df818e-f6ca-4d9e-b86b-7d2909d420d1 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:36.251249 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12df818e-f6ca-4d9e-b86b-7d2909d420d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:36.261012 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-1772af41-1508-48e8-b529-a0f2912b65fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'caee90eae9b34b8aadee392ac10e244b'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:00:36.310057 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-12df818e-f6ca-4d9e-b86b-7d2909d420d1 None None] MFA Rules not processed for user `886cb8649faf4bbdb7e290915b6c275d`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:00:36.313257 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-12df818e-f6ca-4d9e-b86b-7d2909d420d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:00:36.385408 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-1772af41-1508-48e8-b529-a0f2912b65fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'caee90eae9b34b8aadee392ac10e244b'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:00:36.394496 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 845/1685] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 18 22:00:35 2022] DELETE /identity/v3/users/caee90eae9b34b8aadee392ac10e244b => generated 0 bytes in 732 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 22:00:36.395985 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1772af41-1508-48e8-b529-a0f2912b65fe admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:00:36.401208 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-1772af41-1508-48e8-b529-a0f2912b65fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:00:36.505514 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:00:36.508528 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 841/1686] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:00:36 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:00:36.511842 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13a74dc-545f-4218-932a-b59174878b24 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:36.518136 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13a74dc-545f-4218-932a-b59174878b24 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:36.518589 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13a74dc-545f-4218-932a-b59174878b24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:36.594051 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-e13a74dc-545f-4218-932a-b59174878b24 None None] MFA Rules not processed for user `b44c0cf2d8b34f3e81c59d19eedbdfcc`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:00:36.598288 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1772af41-1508-48e8-b529-a0f2912b65fe admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:00:36.598416 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-e13a74dc-545f-4218-932a-b59174878b24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:00:36.606466 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2977d410-66e7-44e0-9111-8782d9cd63fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:00:36.607377 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2977d410-66e7-44e0-9111-8782d9cd63fb admin admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:36.607575 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2977d410-66e7-44e0-9111-8782d9cd63fb admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:36.607861 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2977d410-66e7-44e0-9111-8782d9cd63fb admin admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:36.609812 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2977d410-66e7-44e0-9111-8782d9cd63fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:00:36.614717 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2977d410-66e7-44e0-9111-8782d9cd63fb admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:00:36.685823 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 846/1687] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:00:36 2022] GET /identity/v3/roles => generated 1420 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:00:36.689160 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507103a5-aa77-434e-ad7d-00026e4f709d None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:36.690025 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507103a5-aa77-434e-ad7d-00026e4f709d None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:36.690025 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507103a5-aa77-434e-ad7d-00026e4f709d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:36.773945 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-507103a5-aa77-434e-ad7d-00026e4f709d None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:00:36.779393 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-507103a5-aa77-434e-ad7d-00026e4f709d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:00:36.807626 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 847/1688] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:00:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:00:36.808850 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507103a5-aa77-434e-ad7d-00026e4f709d None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:00:36.825083 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 842/1689] 10.222.0.27 () {58 vars in 1058 bytes} [Thu Aug 18 22:00:36 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:00:36.829168 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13a74dc-545f-4218-932a-b59174878b24 None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:00:36.839560 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507103a5-aa77-434e-ad7d-00026e4f709d None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:00:36.849057 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13a74dc-545f-4218-932a-b59174878b24 None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:00:36.854004 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506a9ab3-efb8-4282-894f-0e8adf958e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:00:36.854555 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506a9ab3-efb8-4282-894f-0e8adf958e58 admin admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:36.854978 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506a9ab3-efb8-4282-894f-0e8adf958e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:36.855424 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506a9ab3-efb8-4282-894f-0e8adf958e58 admin admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:36.856236 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506a9ab3-efb8-4282-894f-0e8adf958e58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:00:36.858642 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506a9ab3-efb8-4282-894f-0e8adf958e58 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:00:36.868415 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc97e279-026f-4156-ad42-074da2922260 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b44c0cf2d8b34f3e81c59d19eedbdfcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:00:36.869361 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc97e279-026f-4156-ad42-074da2922260 service placement] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:36.869796 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc97e279-026f-4156-ad42-074da2922260 service placement] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:36.870218 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc97e279-026f-4156-ad42-074da2922260 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:36.875144 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-cc97e279-026f-4156-ad42-074da2922260 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:00:36.885548 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 848/1690] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:00:36 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:00:36.885548 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506a9ab3-efb8-4282-894f-0e8adf958e58 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:00:36.897290 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-506a9ab3-efb8-4282-894f-0e8adf958e58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:00:36.899010 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc97e279-026f-4156-ad42-074da2922260 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:00:36.900834 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc97e279-026f-4156-ad42-074da2922260 service placement] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:00:36.941116 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 843/1691] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:00:36 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:00:36.942933 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc97e279-026f-4156-ad42-074da2922260 service placement] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:00:36.980100 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc97e279-026f-4156-ad42-074da2922260 service placement] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:00:36.990758 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:00:36.998770 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d22c53-46e9-4e5a-85a1-c84264560733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:00:37.002330 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d22c53-46e9-4e5a-85a1-c84264560733 admin admin] REQUEST_METHOD: `PUT` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:37.002661 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d22c53-46e9-4e5a-85a1-c84264560733 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:37.003020 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d22c53-46e9-4e5a-85a1-c84264560733 admin admin] PATH_INFO: `/v3/projects/2ef4f8cae6804d66af6759c9476b3c16/users/f5907ee2e62240b2a896783fefce4509/roles/de8f2438056f4af9879423f8a59e0e0b` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:37.060210 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506a9ab3-efb8-4282-894f-0e8adf958e58 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:00:37.067026 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d22c53-46e9-4e5a-85a1-c84264560733 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ef4f8cae6804d66af6759c9476b3c16, user_id=f5907ee2e62240b2a896783fefce4509, role_id=de8f2438056f4af9879423f8a59e0e0b)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:00:37.077394 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ba3e6a-c4bc-4309-9607-06001bbeb2e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a937971ad1a4b0c8697c764f214d446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:00:37.078591 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ba3e6a-c4bc-4309-9607-06001bbeb2e2 service neutron] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:37.078937 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ba3e6a-c4bc-4309-9607-06001bbeb2e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:37.079216 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ba3e6a-c4bc-4309-9607-06001bbeb2e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:37.082496 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d22c53-46e9-4e5a-85a1-c84264560733 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:00:37.115305 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ba3e6a-c4bc-4309-9607-06001bbeb2e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:00:37.125689 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ba3e6a-c4bc-4309-9607-06001bbeb2e2 service neutron] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:00:37.157246 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 849/1692] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:00:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:00:37.209566 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 844/1693] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 18 22:00:36 2022] PUT /identity/v3/projects/2ef4f8cae6804d66af6759c9476b3c16/users/f5907ee2e62240b2a896783fefce4509/roles/de8f2438056f4af9879423f8a59e0e0b => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:00:37.220572 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316996b9-0d75-48cd-beee-a15ee7e9e6a1 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:37.221049 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316996b9-0d75-48cd-beee-a15ee7e9e6a1 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:37.221200 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316996b9-0d75-48cd-beee-a15ee7e9e6a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:37.314778 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-316996b9-0d75-48cd-beee-a15ee7e9e6a1 None None] MFA Rules not processed for user `f5907ee2e62240b2a896783fefce4509`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:00:37.314778 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-316996b9-0d75-48cd-beee-a15ee7e9e6a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:00:37.443041 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 850/1694] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:00:37 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:00:37.444909 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d22c53-46e9-4e5a-85a1-c84264560733 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:00:37.577007 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d22c53-46e9-4e5a-85a1-c84264560733 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:00:37.583504 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45171f1-bfd2-4194-9f0b-98efaad4e172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:00:37.584531 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45171f1-bfd2-4194-9f0b-98efaad4e172 admin admin] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:37.585007 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45171f1-bfd2-4194-9f0b-98efaad4e172 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:37.585526 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45171f1-bfd2-4194-9f0b-98efaad4e172 admin admin] PATH_INFO: `/v3/projects` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:37.586698 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45171f1-bfd2-4194-9f0b-98efaad4e172 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:00:37.588977 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45171f1-bfd2-4194-9f0b-98efaad4e172 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:00:37.661980 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c6fa19-8f3d-40ca-9209-1e439d582282 None None] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:37.662498 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c6fa19-8f3d-40ca-9209-1e439d582282 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:37.662966 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c6fa19-8f3d-40ca-9209-1e439d582282 None None] PATH_INFO: `/` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:37.666066 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 851/1695] 10.222.0.27 () {54 vars in 912 bytes} [Thu Aug 18 22:00:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 22:00:37.680119 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58475bb4-c270-4d57-9c9d-f53725efc16e None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:37.680119 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58475bb4-c270-4d57-9c9d-f53725efc16e None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:37.680456 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58475bb4-c270-4d57-9c9d-f53725efc16e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:37.722626 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 845/1696] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 18 22:00:37 2022] POST /identity/v3/projects => generated 355 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 22:00:37.729591 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45171f1-bfd2-4194-9f0b-98efaad4e172 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:00:37.745628 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-58475bb4-c270-4d57-9c9d-f53725efc16e None None] MFA Rules not processed for user `6a937971ad1a4b0c8697c764f214d446`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:00:37.747489 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-58475bb4-c270-4d57-9c9d-f53725efc16e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:00:37.841815 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:00:37.925523 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45171f1-bfd2-4194-9f0b-98efaad4e172 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:00:37.936656 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 852/1697] 10.222.0.27 () {58 vars in 1009 bytes} [Thu Aug 18 22:00:37 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:00:37.941967 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf1b993-8a8c-46b1-bf29-c91d477afae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:00:37.943107 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf1b993-8a8c-46b1-bf29-c91d477afae6 admin admin] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:37.943613 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf1b993-8a8c-46b1-bf29-c91d477afae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:37.944118 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf1b993-8a8c-46b1-bf29-c91d477afae6 admin admin] PATH_INFO: `/v3/users` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:37.945367 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf1b993-8a8c-46b1-bf29-c91d477afae6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:00:37.956079 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf1b993-8a8c-46b1-bf29-c91d477afae6 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:00:38.019127 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58475bb4-c270-4d57-9c9d-f53725efc16e None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:00:38.062501 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58475bb4-c270-4d57-9c9d-f53725efc16e None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:00:38.095128 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb34721-2ec4-420d-9e7b-bee4da804662 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a937971ad1a4b0c8697c764f214d446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:00:38.100112 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb34721-2ec4-420d-9e7b-bee4da804662 service neutron] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:38.100705 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb34721-2ec4-420d-9e7b-bee4da804662 service neutron] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:38.103810 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb34721-2ec4-420d-9e7b-bee4da804662 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:38.135782 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb34721-2ec4-420d-9e7b-bee4da804662 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:00:38.139476 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb34721-2ec4-420d-9e7b-bee4da804662 service neutron] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:00:38.145211 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 846/1698] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 18 22:00:37 2022] POST /identity/v3/users => generated 284 bytes in 417 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 22:00:38.158209 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf1b993-8a8c-46b1-bf29-c91d477afae6 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:00:38.177615 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 853/1699] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:00:38 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 22:00:38.199845 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf1b993-8a8c-46b1-bf29-c91d477afae6 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:00:38.227726 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18dc3de-0bf8-4a97-91a3-3f86138aa87c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:00:38.231045 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18dc3de-0bf8-4a97-91a3-3f86138aa87c admin admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:38.231890 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18dc3de-0bf8-4a97-91a3-3f86138aa87c admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:38.232021 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18dc3de-0bf8-4a97-91a3-3f86138aa87c admin admin] PATH_INFO: `/v3/roles` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:38.237870 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18dc3de-0bf8-4a97-91a3-3f86138aa87c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:00:38.243526 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18dc3de-0bf8-4a97-91a3-3f86138aa87c admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:00:38.322313 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 847/1700] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:00:38 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 22:00:38.325318 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb34721-2ec4-420d-9e7b-bee4da804662 service neutron] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:00:38.353851 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb34721-2ec4-420d-9e7b-bee4da804662 service neutron] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:00:38.370830 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f2d646-74f9-4561-89ed-c099ae6dd535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:00:38.372233 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f2d646-74f9-4561-89ed-c099ae6dd535 admin admin] REQUEST_METHOD: `PUT` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:38.373008 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f2d646-74f9-4561-89ed-c099ae6dd535 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:38.379538 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f2d646-74f9-4561-89ed-c099ae6dd535 admin admin] PATH_INFO: `/v3/projects/03ea7757e6ce45e78dc4d17b69ca7f53/users/efeb24569b704c52b5a30b9763984fb7/roles/0833202e2a3d47d1b6b3af57006641b1` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:38.467479 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f2d646-74f9-4561-89ed-c099ae6dd535 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03ea7757e6ce45e78dc4d17b69ca7f53, user_id=efeb24569b704c52b5a30b9763984fb7, role_id=0833202e2a3d47d1b6b3af57006641b1)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:00:38.478496 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f2d646-74f9-4561-89ed-c099ae6dd535 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:00:38.603438 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18dc3de-0bf8-4a97-91a3-3f86138aa87c admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:00:38.610321 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 854/1701] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 18 22:00:38 2022] PUT /identity/v3/projects/03ea7757e6ce45e78dc4d17b69ca7f53/users/efeb24569b704c52b5a30b9763984fb7/roles/0833202e2a3d47d1b6b3af57006641b1 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:00:38.641690 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18dc3de-0bf8-4a97-91a3-3f86138aa87c admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:00:38.800172 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e565181-9915-4c8d-8262-c02f0e589f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:00:38.800834 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e565181-9915-4c8d-8262-c02f0e589f2a admin admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:38.801114 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e565181-9915-4c8d-8262-c02f0e589f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:38.801387 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e565181-9915-4c8d-8262-c02f0e589f2a admin admin] PATH_INFO: `/v3/roles` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:38.802123 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e565181-9915-4c8d-8262-c02f0e589f2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:00:38.807586 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e565181-9915-4c8d-8262-c02f0e589f2a admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:00:38.842393 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f2d646-74f9-4561-89ed-c099ae6dd535 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:00:38.861069 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 848/1702] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:00:38 2022] GET /identity/v3/roles => generated 1420 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:00:38.873987 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f2d646-74f9-4561-89ed-c099ae6dd535 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:00:38.881894 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27cb3e3-cedb-4474-8912-f49b40bf6ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:00:38.882508 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27cb3e3-cedb-4474-8912-f49b40bf6ec8 admin admin] REQUEST_METHOD: `PUT` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:38.882833 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27cb3e3-cedb-4474-8912-f49b40bf6ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:38.883935 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27cb3e3-cedb-4474-8912-f49b40bf6ec8 admin admin] PATH_INFO: `/v3/projects/03ea7757e6ce45e78dc4d17b69ca7f53/users/efeb24569b704c52b5a30b9763984fb7/roles/0833202e2a3d47d1b6b3af57006641b1` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:38.887494 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27cb3e3-cedb-4474-8912-f49b40bf6ec8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03ea7757e6ce45e78dc4d17b69ca7f53, user_id=efeb24569b704c52b5a30b9763984fb7, role_id=0833202e2a3d47d1b6b3af57006641b1)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:00:38.891954 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27cb3e3-cedb-4474-8912-f49b40bf6ec8 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:00:38.916496 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 855/1703] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 18 22:00:38 2022] PUT /identity/v3/projects/03ea7757e6ce45e78dc4d17b69ca7f53/users/efeb24569b704c52b5a30b9763984fb7/roles/0833202e2a3d47d1b6b3af57006641b1 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:00:38.920036 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ff7fee-80ea-4c0a-87a8-8a19b58ab535 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:38.920326 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ff7fee-80ea-4c0a-87a8-8a19b58ab535 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:38.920618 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ff7fee-80ea-4c0a-87a8-8a19b58ab535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:39.059016 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-a4ff7fee-80ea-4c0a-87a8-8a19b58ab535 None None] MFA Rules not processed for user `efeb24569b704c52b5a30b9763984fb7`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:00:39.060294 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-a4ff7fee-80ea-4c0a-87a8-8a19b58ab535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:00:39.101538 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27cb3e3-cedb-4474-8912-f49b40bf6ec8 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:00:39.103310 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-a27cb3e3-cedb-4474-8912-f49b40bf6ec8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:00:39.137054 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:00:39.345478 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27cb3e3-cedb-4474-8912-f49b40bf6ec8 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:00:39.360781 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 849/1704] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:00:38 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 442 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:00:39.367290 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d591b3fb-61e5-41ec-9bda-ff78f1c1f540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:00:39.367946 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d591b3fb-61e5-41ec-9bda-ff78f1c1f540 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:39.368378 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d591b3fb-61e5-41ec-9bda-ff78f1c1f540 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:39.368810 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d591b3fb-61e5-41ec-9bda-ff78f1c1f540 admin admin] PATH_INFO: `/v3/projects/97f1859f6b8b484598f58fbf038f5f11` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:39.370119 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d591b3fb-61e5-41ec-9bda-ff78f1c1f540 admin admin] RBAC: Authorizing `identity:delete_project(project_id=97f1859f6b8b484598f58fbf038f5f11)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:00:39.371786 dv-cinder-853678-3-smb devstack@keystone.service[88097]: WARNING py.warnings [None req-d591b3fb-61e5-41ec-9bda-ff78f1c1f540 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 18 22:00:39.371786 dv-cinder-853678-3-smb devstack@keystone.service[88097]: warnings.warn(msg) Aug 18 22:00:39.371786 dv-cinder-853678-3-smb devstack@keystone.service[88097]: Aug 18 22:00:39.373914 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d591b3fb-61e5-41ec-9bda-ff78f1c1f540 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:00:39.473132 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ff7fee-80ea-4c0a-87a8-8a19b58ab535 None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:00:39.475346 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-a4ff7fee-80ea-4c0a-87a8-8a19b58ab535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:00:39.635506 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-d591b3fb-61e5-41ec-9bda-ff78f1c1f540 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97f1859f6b8b484598f58fbf038f5f11', 'request_id': 'req-d591b3fb-61e5-41ec-9bda-ff78f1c1f540'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:00:39.680346 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-d591b3fb-61e5-41ec-9bda-ff78f1c1f540 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97f1859f6b8b484598f58fbf038f5f11', 'request_id': 'req-d591b3fb-61e5-41ec-9bda-ff78f1c1f540'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:00:39.695706 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ff7fee-80ea-4c0a-87a8-8a19b58ab535 None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:00:39.791431 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e47866c-e12f-4a45-9dbc-ac5dda77e983 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22b6a7c36f8a4795a75271b8079821c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:00:39.792071 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e47866c-e12f-4a45-9dbc-ac5dda77e983 service cinder] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:39.792799 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e47866c-e12f-4a45-9dbc-ac5dda77e983 service cinder] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:39.793109 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e47866c-e12f-4a45-9dbc-ac5dda77e983 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:39.805314 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-d591b3fb-61e5-41ec-9bda-ff78f1c1f540 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97f1859f6b8b484598f58fbf038f5f11', 'request_id': 'req-d591b3fb-61e5-41ec-9bda-ff78f1c1f540'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:00:39.846467 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-d591b3fb-61e5-41ec-9bda-ff78f1c1f540 admin admin] The token cache is being invalidate because project 97f1859f6b8b484598f58fbf038f5f11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88097) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 22:00:39.846467 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-d591b3fb-61e5-41ec-9bda-ff78f1c1f540 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:00:39.847379 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-d591b3fb-61e5-41ec-9bda-ff78f1c1f540 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:00:39.859528 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 856/1705] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 18 22:00:39 2022] DELETE /identity/v3/projects/97f1859f6b8b484598f58fbf038f5f11 => generated 0 bytes in 758 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:00:39.865224 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d591b3fb-61e5-41ec-9bda-ff78f1c1f540 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:00:39.867474 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-d591b3fb-61e5-41ec-9bda-ff78f1c1f540 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:00:39.934691 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e47866c-e12f-4a45-9dbc-ac5dda77e983 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:00:39.936314 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e47866c-e12f-4a45-9dbc-ac5dda77e983 service cinder] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:00:39.970099 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 850/1706] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:00:39 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:00:39.988458 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d591b3fb-61e5-41ec-9bda-ff78f1c1f540 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:00:39.994213 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ae6f10-2d16-40ec-b914-6d90d0078226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:00:39.995526 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ae6f10-2d16-40ec-b914-6d90d0078226 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:39.995908 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ae6f10-2d16-40ec-b914-6d90d0078226 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:39.996285 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ae6f10-2d16-40ec-b914-6d90d0078226 admin admin] PATH_INFO: `/v3/users/3de5e0b01dd7488ca265e7faad072439` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:40.000967 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ae6f10-2d16-40ec-b914-6d90d0078226 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3de5e0b01dd7488ca265e7faad072439)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:00:40.007577 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ae6f10-2d16-40ec-b914-6d90d0078226 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:00:40.235845 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:00:40.260388 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-53ae6f10-2d16-40ec-b914-6d90d0078226 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3de5e0b01dd7488ca265e7faad072439'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:00:40.278428 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-53ae6f10-2d16-40ec-b914-6d90d0078226 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3de5e0b01dd7488ca265e7faad072439'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:00:40.280047 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-53ae6f10-2d16-40ec-b914-6d90d0078226 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3de5e0b01dd7488ca265e7faad072439'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:00:40.311510 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-53ae6f10-2d16-40ec-b914-6d90d0078226 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3de5e0b01dd7488ca265e7faad072439'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:00:40.324236 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e47866c-e12f-4a45-9dbc-ac5dda77e983 service cinder] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:00:40.334841 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e47866c-e12f-4a45-9dbc-ac5dda77e983 service cinder] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:00:40.339106 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060ba274-fb96-402c-810d-47f880f06f8b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22b6a7c36f8a4795a75271b8079821c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:00:40.340025 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060ba274-fb96-402c-810d-47f880f06f8b service cinder] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:40.340310 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060ba274-fb96-402c-810d-47f880f06f8b service cinder] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:40.340581 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060ba274-fb96-402c-810d-47f880f06f8b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:40.342602 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-060ba274-fb96-402c-810d-47f880f06f8b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:00:40.435089 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-53ae6f10-2d16-40ec-b914-6d90d0078226 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3de5e0b01dd7488ca265e7faad072439'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:00:40.455523 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 857/1707] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 18 22:00:39 2022] DELETE /identity/v3/users/3de5e0b01dd7488ca265e7faad072439 => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:00:40.473757 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060ba274-fb96-402c-810d-47f880f06f8b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:00:40.479907 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060ba274-fb96-402c-810d-47f880f06f8b service cinder] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:00:40.505008 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 851/1708] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:00:40 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 22:00:41.085099 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:00:41.276804 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ae6f10-2d16-40ec-b914-6d90d0078226 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:00:41.278305 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-53ae6f10-2d16-40ec-b914-6d90d0078226 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:00:41.416184 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ae6f10-2d16-40ec-b914-6d90d0078226 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:00:41.427074 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778063db-3464-4c15-9323-c8e226173a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:00:41.427734 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778063db-3464-4c15-9323-c8e226173a2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:41.428013 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778063db-3464-4c15-9323-c8e226173a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:41.428277 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778063db-3464-4c15-9323-c8e226173a2b admin admin] PATH_INFO: `/v3/users/017db2cc67ba4a7eaff0c3e7966209de` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:41.432125 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778063db-3464-4c15-9323-c8e226173a2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=017db2cc67ba4a7eaff0c3e7966209de)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:00:41.439467 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778063db-3464-4c15-9323-c8e226173a2b admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:00:41.719060 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-778063db-3464-4c15-9323-c8e226173a2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '017db2cc67ba4a7eaff0c3e7966209de'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:00:41.727381 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-778063db-3464-4c15-9323-c8e226173a2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '017db2cc67ba4a7eaff0c3e7966209de'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:00:41.727873 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-778063db-3464-4c15-9323-c8e226173a2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '017db2cc67ba4a7eaff0c3e7966209de'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:00:41.745781 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-778063db-3464-4c15-9323-c8e226173a2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '017db2cc67ba4a7eaff0c3e7966209de'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:00:41.825147 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75061b5-a697-436a-a7ce-4b5835180478 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:41.825674 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75061b5-a697-436a-a7ce-4b5835180478 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:41.825674 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75061b5-a697-436a-a7ce-4b5835180478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:41.861662 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-d75061b5-a697-436a-a7ce-4b5835180478 None None] MFA Rules not processed for user `9c13345ad7e8464fa2f06e013d0ad058`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:00:41.863988 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-d75061b5-a697-436a-a7ce-4b5835180478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:00:41.881181 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-778063db-3464-4c15-9323-c8e226173a2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '017db2cc67ba4a7eaff0c3e7966209de'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:00:41.904766 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 858/1709] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 18 22:00:41 2022] DELETE /identity/v3/users/017db2cc67ba4a7eaff0c3e7966209de => generated 0 bytes in 628 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:00:41.910259 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f6447a-b865-43d4-85cc-8051636a0387 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:41.914456 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f6447a-b865-43d4-85cc-8051636a0387 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:41.914900 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f6447a-b865-43d4-85cc-8051636a0387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:42.013274 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-69f6447a-b865-43d4-85cc-8051636a0387 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:00:42.016566 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-69f6447a-b865-43d4-85cc-8051636a0387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:00:42.105186 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 852/1710] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:00:41 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:00:42.115912 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75061b5-a697-436a-a7ce-4b5835180478 None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:00:42.117499 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-d75061b5-a697-436a-a7ce-4b5835180478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:00:42.158422 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 859/1711] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:00:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:00:42.177915 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f6447a-b865-43d4-85cc-8051636a0387 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:00:42.179653 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-69f6447a-b865-43d4-85cc-8051636a0387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:00:42.314705 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75061b5-a697-436a-a7ce-4b5835180478 None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:00:42.366452 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f6447a-b865-43d4-85cc-8051636a0387 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:00:42.373710 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13da5854-9d55-426a-9a82-c46921724c50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a937971ad1a4b0c8697c764f214d446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:00:42.376349 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13da5854-9d55-426a-9a82-c46921724c50 service neutron] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:42.376349 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13da5854-9d55-426a-9a82-c46921724c50 service neutron] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:42.376349 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13da5854-9d55-426a-9a82-c46921724c50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:42.395355 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13da5854-9d55-426a-9a82-c46921724c50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:00:42.399606 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13da5854-9d55-426a-9a82-c46921724c50 service neutron] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:00:42.409653 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:00:42.424742 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 860/1712] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:00:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:00:42.431336 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13da5854-9d55-426a-9a82-c46921724c50 service neutron] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:00:42.433841 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-13da5854-9d55-426a-9a82-c46921724c50 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:00:42.464800 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13da5854-9d55-426a-9a82-c46921724c50 service neutron] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:00:42.473127 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366aa0a2-defb-4f2d-aad9-a4e0aa8c18a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:00:42.474132 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366aa0a2-defb-4f2d-aad9-a4e0aa8c18a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:42.475374 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366aa0a2-defb-4f2d-aad9-a4e0aa8c18a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:42.475662 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366aa0a2-defb-4f2d-aad9-a4e0aa8c18a9 admin admin] PATH_INFO: `/v3/projects/1c69cde10fa5486f8ba0e6a2396f87e8` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:42.477598 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366aa0a2-defb-4f2d-aad9-a4e0aa8c18a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c69cde10fa5486f8ba0e6a2396f87e8)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:00:42.479801 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366aa0a2-defb-4f2d-aad9-a4e0aa8c18a9 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:00:42.532008 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85eac1b-4c03-4230-b4e6-212157a78d26 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a39cd50340184779ac589bbcb7cac9aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:00:42.532848 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85eac1b-4c03-4230-b4e6-212157a78d26 service nova] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:42.533264 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85eac1b-4c03-4230-b4e6-212157a78d26 service nova] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:42.533544 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85eac1b-4c03-4230-b4e6-212157a78d26 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:42.736177 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-366aa0a2-defb-4f2d-aad9-a4e0aa8c18a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c69cde10fa5486f8ba0e6a2396f87e8', 'request_id': 'req-366aa0a2-defb-4f2d-aad9-a4e0aa8c18a9'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:00:42.747536 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-366aa0a2-defb-4f2d-aad9-a4e0aa8c18a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c69cde10fa5486f8ba0e6a2396f87e8', 'request_id': 'req-366aa0a2-defb-4f2d-aad9-a4e0aa8c18a9'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:00:42.761302 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85eac1b-4c03-4230-b4e6-212157a78d26 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:00:42.767412 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85eac1b-4c03-4230-b4e6-212157a78d26 service nova] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:00:42.849546 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-366aa0a2-defb-4f2d-aad9-a4e0aa8c18a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c69cde10fa5486f8ba0e6a2396f87e8', 'request_id': 'req-366aa0a2-defb-4f2d-aad9-a4e0aa8c18a9'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:00:42.853940 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 853/1713] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:00:42 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 739 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:00:42.855899 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7cd67d-5fe3-4cb2-8774-93ac810e4c9f None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:42.856336 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7cd67d-5fe3-4cb2-8774-93ac810e4c9f None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:42.856667 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7cd67d-5fe3-4cb2-8774-93ac810e4c9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:42.880213 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-366aa0a2-defb-4f2d-aad9-a4e0aa8c18a9 admin admin] The token cache is being invalidate because project 1c69cde10fa5486f8ba0e6a2396f87e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88097) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 22:00:42.880531 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-366aa0a2-defb-4f2d-aad9-a4e0aa8c18a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:00:42.882923 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-366aa0a2-defb-4f2d-aad9-a4e0aa8c18a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:00:42.908127 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 861/1714] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 18 22:00:42 2022] DELETE /identity/v3/projects/1c69cde10fa5486f8ba0e6a2396f87e8 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:00:42.911443 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecac2601-b5a9-4079-b8d0-ceef361f0df5 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:42.911739 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecac2601-b5a9-4079-b8d0-ceef361f0df5 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:42.912263 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecac2601-b5a9-4079-b8d0-ceef361f0df5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:43.019524 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-ecac2601-b5a9-4079-b8d0-ceef361f0df5 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:00:43.023811 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-ecac2601-b5a9-4079-b8d0-ceef361f0df5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:00:43.063540 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-3d7cd67d-5fe3-4cb2-8774-93ac810e4c9f None None] MFA Rules not processed for user `f079aa6ed5594a4982172b51b93ac54f`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:00:43.065267 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-3d7cd67d-5fe3-4cb2-8774-93ac810e4c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:00:43.161068 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:00:43.216814 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 862/1715] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:00:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:00:43.225022 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387fee9c-cc41-44d2-917a-591c173bb34c None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:43.225702 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387fee9c-cc41-44d2-917a-591c173bb34c None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:43.226296 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387fee9c-cc41-44d2-917a-591c173bb34c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:43.290706 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 854/1716] 10.222.0.27 () {58 vars in 1009 bytes} [Thu Aug 18 22:00:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 434 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:00:43.297901 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-387fee9c-cc41-44d2-917a-591c173bb34c None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:00:43.304770 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-387fee9c-cc41-44d2-917a-591c173bb34c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:00:43.331526 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 863/1717] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:00:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:00:43.335749 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7cd67d-5fe3-4cb2-8774-93ac810e4c9f None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:00:43.357898 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7cd67d-5fe3-4cb2-8774-93ac810e4c9f None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:00:43.370435 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd94d43-ab7c-46fb-9d95-0f619f2d33e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:00:43.370860 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd94d43-ab7c-46fb-9d95-0f619f2d33e7 admin admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:43.371357 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd94d43-ab7c-46fb-9d95-0f619f2d33e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:43.372645 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd94d43-ab7c-46fb-9d95-0f619f2d33e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:43.372645 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd94d43-ab7c-46fb-9d95-0f619f2d33e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 22:00:43.372645 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd94d43-ab7c-46fb-9d95-0f619f2d33e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:00:43.373970 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd94d43-ab7c-46fb-9d95-0f619f2d33e7 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:00:43.401847 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 855/1718] 10.222.0.27 () {58 vars in 1153 bytes} [Thu Aug 18 22:00:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 22:00:43.406066 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387fee9c-cc41-44d2-917a-591c173bb34c None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:00:43.425388 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387fee9c-cc41-44d2-917a-591c173bb34c None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:00:43.438162 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8f7501-af71-4044-aff0-33127682de58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:00:43.438981 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8f7501-af71-4044-aff0-33127682de58 admin admin] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:43.439429 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8f7501-af71-4044-aff0-33127682de58 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:43.439852 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8f7501-af71-4044-aff0-33127682de58 admin admin] PATH_INFO: `/v3/projects` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:43.440506 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8f7501-af71-4044-aff0-33127682de58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:00:43.457572 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8f7501-af71-4044-aff0-33127682de58 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:00:43.619104 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 864/1719] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 18 22:00:43 2022] POST /identity/v3/projects => generated 403 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 22:00:43.623248 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd94d43-ab7c-46fb-9d95-0f619f2d33e7 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:00:43.641287 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd94d43-ab7c-46fb-9d95-0f619f2d33e7 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:00:43.729524 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8f7501-af71-4044-aff0-33127682de58 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:00:43.732849 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-7e8f7501-af71-4044-aff0-33127682de58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:00:43.842626 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc196cd-082b-4e36-ac75-2feea9be7709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:00:43.844726 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc196cd-082b-4e36-ac75-2feea9be7709 admin admin] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:43.844726 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc196cd-082b-4e36-ac75-2feea9be7709 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:43.844726 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc196cd-082b-4e36-ac75-2feea9be7709 admin admin] PATH_INFO: `/v3/users` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:43.845106 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc196cd-082b-4e36-ac75-2feea9be7709 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:00:43.847060 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc196cd-082b-4e36-ac75-2feea9be7709 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:00:43.977903 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8f7501-af71-4044-aff0-33127682de58 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:00:43.986275 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd0c74e-d454-4b2d-8d92-63c5a833f665 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae59e6dca304c949942ae769acedc74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:00:43.988314 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd0c74e-d454-4b2d-8d92-63c5a833f665 service swift] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:43.989027 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd0c74e-d454-4b2d-8d92-63c5a833f665 service swift] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:43.989448 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd0c74e-d454-4b2d-8d92-63c5a833f665 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:44.072115 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 856/1720] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 18 22:00:43 2022] POST /identity/v3/users => generated 302 bytes in 430 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 22:00:44.074713 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc196cd-082b-4e36-ac75-2feea9be7709 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:00:44.095312 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc196cd-082b-4e36-ac75-2feea9be7709 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:00:44.116720 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed21d23-b923-4e1e-8f76-59ae480b8e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:00:44.117700 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed21d23-b923-4e1e-8f76-59ae480b8e77 admin admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:44.118214 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed21d23-b923-4e1e-8f76-59ae480b8e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:44.118684 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed21d23-b923-4e1e-8f76-59ae480b8e77 admin admin] PATH_INFO: `/v3/roles` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:44.119534 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed21d23-b923-4e1e-8f76-59ae480b8e77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:00:44.121379 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed21d23-b923-4e1e-8f76-59ae480b8e77 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:00:44.138844 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd0c74e-d454-4b2d-8d92-63c5a833f665 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:00:44.140710 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd0c74e-d454-4b2d-8d92-63c5a833f665 service swift] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:00:44.150227 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 857/1721] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:00:44 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 22:00:44.154383 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed21d23-b923-4e1e-8f76-59ae480b8e77 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:00:44.172166 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed21d23-b923-4e1e-8f76-59ae480b8e77 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:00:44.181220 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 865/1722] 10.222.0.27 () {60 vars in 1384 bytes} [Thu Aug 18 22:00:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 18 22:00:44.190131 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7002bc8-7c71-43dd-94e8-9e81fb6bff36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:00:44.190882 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7002bc8-7c71-43dd-94e8-9e81fb6bff36 admin admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:44.194613 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7002bc8-7c71-43dd-94e8-9e81fb6bff36 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:44.194613 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7002bc8-7c71-43dd-94e8-9e81fb6bff36 admin admin] PATH_INFO: `/v3/roles` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:44.194613 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7002bc8-7c71-43dd-94e8-9e81fb6bff36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:00:44.194613 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7002bc8-7c71-43dd-94e8-9e81fb6bff36 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:00:44.226087 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 858/1723] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:00:44 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 22:00:44.230805 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd0c74e-d454-4b2d-8d92-63c5a833f665 service swift] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:00:44.254139 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd0c74e-d454-4b2d-8d92-63c5a833f665 service swift] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:00:44.282251 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d526061-2c0f-4b30-956b-ad3cba4160e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:00:44.283198 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d526061-2c0f-4b30-956b-ad3cba4160e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:44.283616 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d526061-2c0f-4b30-956b-ad3cba4160e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:44.284002 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d526061-2c0f-4b30-956b-ad3cba4160e6 admin admin] PATH_INFO: `/v3/projects/27f719aa9d0044ec9eefd651b849736f/users/46275ec2e63f4e979eaf4d70efff5711/roles/de8f2438056f4af9879423f8a59e0e0b` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:44.346162 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d526061-2c0f-4b30-956b-ad3cba4160e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27f719aa9d0044ec9eefd651b849736f, user_id=46275ec2e63f4e979eaf4d70efff5711, role_id=de8f2438056f4af9879423f8a59e0e0b)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:00:44.355329 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d526061-2c0f-4b30-956b-ad3cba4160e6 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:00:44.423984 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:00:44.487861 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 866/1724] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 18 22:00:44 2022] PUT /identity/v3/projects/27f719aa9d0044ec9eefd651b849736f/users/46275ec2e63f4e979eaf4d70efff5711/roles/de8f2438056f4af9879423f8a59e0e0b => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:00:44.493194 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1b6e43-4740-460a-8051-2876ae1d5ba6 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:44.493194 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1b6e43-4740-460a-8051-2876ae1d5ba6 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:44.493194 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1b6e43-4740-460a-8051-2876ae1d5ba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:44.548993 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-8a1b6e43-4740-460a-8051-2876ae1d5ba6 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:00:44.550247 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-8a1b6e43-4740-460a-8051-2876ae1d5ba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:00:44.750690 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 859/1725] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:00:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 22:00:44.761092 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d526061-2c0f-4b30-956b-ad3cba4160e6 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:00:44.765055 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-1d526061-2c0f-4b30-956b-ad3cba4160e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:00:44.997385 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd317e8f-07e3-49c4-a158-8dd777fc9b5d None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:44.997673 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd317e8f-07e3-49c4-a158-8dd777fc9b5d None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:44.998135 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd317e8f-07e3-49c4-a158-8dd777fc9b5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:45.014008 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d526061-2c0f-4b30-956b-ad3cba4160e6 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:00:45.022492 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559d0d6b-d089-4c6d-ac4b-19c73f1e47b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a937971ad1a4b0c8697c764f214d446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:00:45.035242 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559d0d6b-d089-4c6d-ac4b-19c73f1e47b9 service neutron] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:45.036284 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559d0d6b-d089-4c6d-ac4b-19c73f1e47b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:45.036838 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559d0d6b-d089-4c6d-ac4b-19c73f1e47b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:45.043639 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-cd317e8f-07e3-49c4-a158-8dd777fc9b5d None None] MFA Rules not processed for user `6a937971ad1a4b0c8697c764f214d446`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:00:45.045451 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-cd317e8f-07e3-49c4-a158-8dd777fc9b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:00:45.056526 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 860/1726] 10.222.0.84 () {58 vars in 1015 bytes} [Thu Aug 18 22:00:44 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 22:00:45.069556 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559d0d6b-d089-4c6d-ac4b-19c73f1e47b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:00:45.071126 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559d0d6b-d089-4c6d-ac4b-19c73f1e47b9 service neutron] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:00:45.082982 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd317e8f-07e3-49c4-a158-8dd777fc9b5d None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:00:45.115029 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd317e8f-07e3-49c4-a158-8dd777fc9b5d None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:00:45.120387 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a62952-c1e9-4e07-b0ca-694f50d836b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a937971ad1a4b0c8697c764f214d446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:00:45.121958 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 867/1727] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:00:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:00:45.144522 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a62952-c1e9-4e07-b0ca-694f50d836b9 service neutron] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:45.144522 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a62952-c1e9-4e07-b0ca-694f50d836b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:45.144522 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a62952-c1e9-4e07-b0ca-694f50d836b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:45.152528 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a62952-c1e9-4e07-b0ca-694f50d836b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:00:45.160530 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a62952-c1e9-4e07-b0ca-694f50d836b9 service neutron] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:00:45.173081 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559d0d6b-d089-4c6d-ac4b-19c73f1e47b9 service neutron] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:00:45.175124 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-559d0d6b-d089-4c6d-ac4b-19c73f1e47b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:00:45.208071 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 861/1728] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:00:45 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:00:45.211845 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559d0d6b-d089-4c6d-ac4b-19c73f1e47b9 service neutron] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:00:45.236478 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79344cc-dccf-4b5c-9275-64e8d7fa9e57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:00:45.236478 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79344cc-dccf-4b5c-9275-64e8d7fa9e57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:45.236478 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79344cc-dccf-4b5c-9275-64e8d7fa9e57 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:45.236478 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79344cc-dccf-4b5c-9275-64e8d7fa9e57 admin admin] PATH_INFO: `/v3/projects/03c48db22a5d43cd96323181da78dd0f` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:45.237922 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79344cc-dccf-4b5c-9275-64e8d7fa9e57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=03c48db22a5d43cd96323181da78dd0f)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:00:45.249140 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79344cc-dccf-4b5c-9275-64e8d7fa9e57 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:00:45.421710 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-e79344cc-dccf-4b5c-9275-64e8d7fa9e57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03c48db22a5d43cd96323181da78dd0f', 'request_id': 'req-e79344cc-dccf-4b5c-9275-64e8d7fa9e57'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:00:45.433533 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-e79344cc-dccf-4b5c-9275-64e8d7fa9e57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03c48db22a5d43cd96323181da78dd0f', 'request_id': 'req-e79344cc-dccf-4b5c-9275-64e8d7fa9e57'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:00:45.491710 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:00:45.586780 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-e79344cc-dccf-4b5c-9275-64e8d7fa9e57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03c48db22a5d43cd96323181da78dd0f', 'request_id': 'req-e79344cc-dccf-4b5c-9275-64e8d7fa9e57'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:00:45.611082 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-e79344cc-dccf-4b5c-9275-64e8d7fa9e57 admin admin] The token cache is being invalidate because project 03c48db22a5d43cd96323181da78dd0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88097) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 22:00:45.618224 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-e79344cc-dccf-4b5c-9275-64e8d7fa9e57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:00:45.628621 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-e79344cc-dccf-4b5c-9275-64e8d7fa9e57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:00:45.631395 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 868/1729] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 18 22:00:45 2022] DELETE /identity/v3/projects/03c48db22a5d43cd96323181da78dd0f => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:00:45.645113 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a62952-c1e9-4e07-b0ca-694f50d836b9 service neutron] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:00:45.686770 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a62952-c1e9-4e07-b0ca-694f50d836b9 service neutron] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:00:45.845392 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afc7705-e809-42a6-94aa-6e4bd52f647c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:00:45.846226 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afc7705-e809-42a6-94aa-6e4bd52f647c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:45.846508 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afc7705-e809-42a6-94aa-6e4bd52f647c admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:45.848199 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afc7705-e809-42a6-94aa-6e4bd52f647c admin admin] PATH_INFO: `/v3/users/f2252db878da45a8af594d8eeaaac413` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:45.862444 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afc7705-e809-42a6-94aa-6e4bd52f647c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2252db878da45a8af594d8eeaaac413)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:00:45.867507 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afc7705-e809-42a6-94aa-6e4bd52f647c admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:00:45.908217 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:00:46.170183 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-9afc7705-e809-42a6-94aa-6e4bd52f647c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2252db878da45a8af594d8eeaaac413'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:00:46.205067 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-9afc7705-e809-42a6-94aa-6e4bd52f647c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2252db878da45a8af594d8eeaaac413'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:00:46.207964 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-9afc7705-e809-42a6-94aa-6e4bd52f647c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2252db878da45a8af594d8eeaaac413'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:00:46.213038 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-9afc7705-e809-42a6-94aa-6e4bd52f647c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2252db878da45a8af594d8eeaaac413'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:00:46.245752 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-9afc7705-e809-42a6-94aa-6e4bd52f647c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2252db878da45a8af594d8eeaaac413'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:00:46.652234 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 862/1730] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 18 22:00:45 2022] DELETE /identity/v3/users/f2252db878da45a8af594d8eeaaac413 => generated 0 bytes in 1011 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:00:46.781969 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340d6ff2-8166-476a-b4b1-2cc2baf61c4f None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:46.782720 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340d6ff2-8166-476a-b4b1-2cc2baf61c4f None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:46.783598 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340d6ff2-8166-476a-b4b1-2cc2baf61c4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:46.834568 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-340d6ff2-8166-476a-b4b1-2cc2baf61c4f None None] MFA Rules not processed for user `4ca7e9098815480f89b2a9a8a222ae5e`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:00:46.838092 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:00:46.841491 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-340d6ff2-8166-476a-b4b1-2cc2baf61c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:00:47.076259 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 869/1731] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:00:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:00:49.149752 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:00:49.385781 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6133e2-3fca-4979-a23a-ad9742f59d0c None None] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:49.386425 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6133e2-3fca-4979-a23a-ad9742f59d0c None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:49.386425 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6133e2-3fca-4979-a23a-ad9742f59d0c None None] PATH_INFO: `/` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:49.387698 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 863/1732] 10.222.0.27 () {54 vars in 921 bytes} [Thu Aug 18 22:00:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 22:00:49.445762 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c3df09-17ae-45ca-ad4f-ec15b275546e None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:49.448578 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c3df09-17ae-45ca-ad4f-ec15b275546e None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:49.449265 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c3df09-17ae-45ca-ad4f-ec15b275546e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:49.542058 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-11c3df09-17ae-45ca-ad4f-ec15b275546e None None] MFA Rules not processed for user `a39cd50340184779ac589bbcb7cac9aa`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:00:49.545140 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-11c3df09-17ae-45ca-ad4f-ec15b275546e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:00:49.752109 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 870/1733] 10.222.0.27 () {58 vars in 1018 bytes} [Thu Aug 18 22:00:49 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:00:50.200089 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6133e2-3fca-4979-a23a-ad9742f59d0c None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:00:50.213425 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-fc6133e2-3fca-4979-a23a-ad9742f59d0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:00:50.314194 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6133e2-3fca-4979-a23a-ad9742f59d0c None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:00:50.322536 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f907f032-5e23-4d9d-ad1d-1ffe11c44acb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a39cd50340184779ac589bbcb7cac9aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:00:50.323476 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f907f032-5e23-4d9d-ad1d-1ffe11c44acb service nova] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:50.325507 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f907f032-5e23-4d9d-ad1d-1ffe11c44acb service nova] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:50.325978 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f907f032-5e23-4d9d-ad1d-1ffe11c44acb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:50.346581 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f907f032-5e23-4d9d-ad1d-1ffe11c44acb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:00:50.348701 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f907f032-5e23-4d9d-ad1d-1ffe11c44acb service nova] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:00:50.366575 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 864/1734] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:00:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:00:50.599436 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c3df09-17ae-45ca-ad4f-ec15b275546e None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:00:50.601529 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-11c3df09-17ae-45ca-ad4f-ec15b275546e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:00:50.751827 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c3df09-17ae-45ca-ad4f-ec15b275546e None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:00:50.759204 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b355f1-9cd2-4612-aab4-f7590fc14d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:00:50.760181 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b355f1-9cd2-4612-aab4-f7590fc14d22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:50.760694 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b355f1-9cd2-4612-aab4-f7590fc14d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:50.761145 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b355f1-9cd2-4612-aab4-f7590fc14d22 admin admin] PATH_INFO: `/v3/projects/407b1c519cca457f8b6553b6ef1535cd` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:50.764178 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b355f1-9cd2-4612-aab4-f7590fc14d22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=407b1c519cca457f8b6553b6ef1535cd)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:00:50.768331 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b355f1-9cd2-4612-aab4-f7590fc14d22 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:00:50.942841 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-d3b355f1-9cd2-4612-aab4-f7590fc14d22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '407b1c519cca457f8b6553b6ef1535cd', 'request_id': 'req-d3b355f1-9cd2-4612-aab4-f7590fc14d22'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:00:50.980738 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-d3b355f1-9cd2-4612-aab4-f7590fc14d22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '407b1c519cca457f8b6553b6ef1535cd', 'request_id': 'req-d3b355f1-9cd2-4612-aab4-f7590fc14d22'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:00:51.087954 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-d3b355f1-9cd2-4612-aab4-f7590fc14d22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '407b1c519cca457f8b6553b6ef1535cd', 'request_id': 'req-d3b355f1-9cd2-4612-aab4-f7590fc14d22'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:00:51.113436 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-d3b355f1-9cd2-4612-aab4-f7590fc14d22 admin admin] The token cache is being invalidate because project 407b1c519cca457f8b6553b6ef1535cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88097) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 22:00:51.118896 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-d3b355f1-9cd2-4612-aab4-f7590fc14d22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:00:51.125909 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-d3b355f1-9cd2-4612-aab4-f7590fc14d22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:00:51.141745 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 871/1735] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 18 22:00:50 2022] DELETE /identity/v3/projects/407b1c519cca457f8b6553b6ef1535cd => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:00:51.146500 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e9d245-c0fd-48c6-a12d-dba9ab45f6dd None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:51.147760 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e9d245-c0fd-48c6-a12d-dba9ab45f6dd None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:51.148175 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e9d245-c0fd-48c6-a12d-dba9ab45f6dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:51.248752 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-a4e9d245-c0fd-48c6-a12d-dba9ab45f6dd None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:00:51.256508 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-a4e9d245-c0fd-48c6-a12d-dba9ab45f6dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:00:51.545996 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 865/1736] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:00:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 393 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:00:51.548894 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3316e5eb-0b6a-4a83-82ba-2cabe173f304 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:51.549183 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3316e5eb-0b6a-4a83-82ba-2cabe173f304 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:51.549455 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3316e5eb-0b6a-4a83-82ba-2cabe173f304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:51.631048 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-3316e5eb-0b6a-4a83-82ba-2cabe173f304 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:00:51.632729 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-3316e5eb-0b6a-4a83-82ba-2cabe173f304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:00:51.672401 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 872/1737] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:00:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:00:51.673125 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e9d245-c0fd-48c6-a12d-dba9ab45f6dd None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:00:51.721897 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e9d245-c0fd-48c6-a12d-dba9ab45f6dd None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:00:51.728095 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4f4a6f-bd3a-48ec-963b-6812cd12a379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:00:51.730081 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4f4a6f-bd3a-48ec-963b-6812cd12a379 admin admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:51.732143 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4f4a6f-bd3a-48ec-963b-6812cd12a379 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:51.732760 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4f4a6f-bd3a-48ec-963b-6812cd12a379 admin admin] PATH_INFO: `/v3/domains` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:51.733756 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4f4a6f-bd3a-48ec-963b-6812cd12a379 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 22:00:51.736966 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4f4a6f-bd3a-48ec-963b-6812cd12a379 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:00:51.743641 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4f4a6f-bd3a-48ec-963b-6812cd12a379 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:00:51.778685 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 866/1738] 10.222.0.27 () {58 vars in 1153 bytes} [Thu Aug 18 22:00:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 22:00:51.779688 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3316e5eb-0b6a-4a83-82ba-2cabe173f304 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:00:51.794132 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3316e5eb-0b6a-4a83-82ba-2cabe173f304 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:00:51.814124 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0a7db2-9f1f-41d8-84e7-e349fea9d455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:00:51.814888 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0a7db2-9f1f-41d8-84e7-e349fea9d455 admin admin] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:51.815176 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0a7db2-9f1f-41d8-84e7-e349fea9d455 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:51.815506 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0a7db2-9f1f-41d8-84e7-e349fea9d455 admin admin] PATH_INFO: `/v3/projects` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:51.816152 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0a7db2-9f1f-41d8-84e7-e349fea9d455 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:00:51.821791 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0a7db2-9f1f-41d8-84e7-e349fea9d455 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:00:51.952060 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 873/1739] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 18 22:00:51 2022] POST /identity/v3/projects => generated 377 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 22:00:51.953440 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4f4a6f-bd3a-48ec-963b-6812cd12a379 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:00:51.977502 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:00:52.007367 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4f4a6f-bd3a-48ec-963b-6812cd12a379 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:00:52.093914 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:00:52.228288 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b054936-8b90-45f5-ad4f-6838e0d7af7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:00:52.228987 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28fb568-c223-406d-bdf1-bd003d765d60 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:52.229090 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b054936-8b90-45f5-ad4f-6838e0d7af7d admin admin] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:52.229199 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28fb568-c223-406d-bdf1-bd003d765d60 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:52.229330 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b054936-8b90-45f5-ad4f-6838e0d7af7d admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:52.229524 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b054936-8b90-45f5-ad4f-6838e0d7af7d admin admin] PATH_INFO: `/v3/users` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:52.229900 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28fb568-c223-406d-bdf1-bd003d765d60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:52.230218 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b054936-8b90-45f5-ad4f-6838e0d7af7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:00:52.238793 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b054936-8b90-45f5-ad4f-6838e0d7af7d admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:00:52.353615 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-b28fb568-c223-406d-bdf1-bd003d765d60 None None] MFA Rules not processed for user `093ed86a33304fde999010cde45be396`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:00:52.357220 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-b28fb568-c223-406d-bdf1-bd003d765d60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:00:52.373415 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 867/1740] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 18 22:00:51 2022] POST /identity/v3/users => generated 289 bytes in 421 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 22:00:52.378240 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b054936-8b90-45f5-ad4f-6838e0d7af7d admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:00:52.411970 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b054936-8b90-45f5-ad4f-6838e0d7af7d admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:00:52.441342 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb23721-6455-457f-848d-f526dd206bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:00:52.443157 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb23721-6455-457f-848d-f526dd206bf5 admin admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:52.447059 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb23721-6455-457f-848d-f526dd206bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:52.447059 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb23721-6455-457f-848d-f526dd206bf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:52.448861 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb23721-6455-457f-848d-f526dd206bf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:00:52.466635 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb23721-6455-457f-848d-f526dd206bf5 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:00:52.517960 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 868/1741] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:00:52 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:00:52.521145 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb23721-6455-457f-848d-f526dd206bf5 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:00:52.555818 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb23721-6455-457f-848d-f526dd206bf5 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:00:52.576727 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56688634-b7e0-48e8-9088-3b1a862aabfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:00:52.577503 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56688634-b7e0-48e8-9088-3b1a862aabfb admin admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:52.580254 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56688634-b7e0-48e8-9088-3b1a862aabfb admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:52.580774 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56688634-b7e0-48e8-9088-3b1a862aabfb admin admin] PATH_INFO: `/v3/roles` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:52.581595 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56688634-b7e0-48e8-9088-3b1a862aabfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:00:52.584016 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56688634-b7e0-48e8-9088-3b1a862aabfb admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:00:52.612405 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 869/1742] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:00:52 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:00:52.613732 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56688634-b7e0-48e8-9088-3b1a862aabfb admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:00:52.655392 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 874/1743] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:00:52 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 427 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:00:52.674014 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c21b206-a4d7-49de-b451-5f50c3b4954b None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:52.676841 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c21b206-a4d7-49de-b451-5f50c3b4954b None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:52.677708 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c21b206-a4d7-49de-b451-5f50c3b4954b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:52.700383 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56688634-b7e0-48e8-9088-3b1a862aabfb admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:00:52.721406 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f2f94e-107b-4a7a-9d10-a119bf6a34df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:00:52.722110 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f2f94e-107b-4a7a-9d10-a119bf6a34df admin admin] REQUEST_METHOD: `PUT` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:52.722421 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f2f94e-107b-4a7a-9d10-a119bf6a34df admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:52.722696 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f2f94e-107b-4a7a-9d10-a119bf6a34df admin admin] PATH_INFO: `/v3/projects/1dc0ea71341c45aeb64dae4a3a9d4339/users/05047bc5b66b4729b5b8209761fb9f79/roles/de8f2438056f4af9879423f8a59e0e0b` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:52.733728 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-2c21b206-a4d7-49de-b451-5f50c3b4954b None None] MFA Rules not processed for user `093ed86a33304fde999010cde45be396`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:00:52.737752 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-2c21b206-a4d7-49de-b451-5f50c3b4954b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:00:52.773776 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 875/1744] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:00:52 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:00:52.786753 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c21b206-a4d7-49de-b451-5f50c3b4954b None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:00:52.786753 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-2c21b206-a4d7-49de-b451-5f50c3b4954b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:00:52.806815 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f2f94e-107b-4a7a-9d10-a119bf6a34df admin admin] RBAC: Authorizing `identity:create_grant(project_id=1dc0ea71341c45aeb64dae4a3a9d4339, user_id=05047bc5b66b4729b5b8209761fb9f79, role_id=de8f2438056f4af9879423f8a59e0e0b)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:00:52.820664 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f2f94e-107b-4a7a-9d10-a119bf6a34df admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:00:52.970174 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 870/1745] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 18 22:00:52 2022] PUT /identity/v3/projects/1dc0ea71341c45aeb64dae4a3a9d4339/users/05047bc5b66b4729b5b8209761fb9f79/roles/de8f2438056f4af9879423f8a59e0e0b => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:00:52.973599 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f031141e-8d6e-4a46-8dfa-3ce247bc5f7f None None] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:52.975109 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f031141e-8d6e-4a46-8dfa-3ce247bc5f7f None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:52.975518 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f031141e-8d6e-4a46-8dfa-3ce247bc5f7f None None] PATH_INFO: `/` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:52.980062 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 871/1746] 10.222.0.27 () {54 vars in 921 bytes} [Thu Aug 18 22:00:52 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 22:00:52.985018 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1626b40a-99bc-425c-a5a4-ec96f0fecde7 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:52.985663 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1626b40a-99bc-425c-a5a4-ec96f0fecde7 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:52.986151 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1626b40a-99bc-425c-a5a4-ec96f0fecde7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:53.050993 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-1626b40a-99bc-425c-a5a4-ec96f0fecde7 None None] MFA Rules not processed for user `05047bc5b66b4729b5b8209761fb9f79`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:00:53.054537 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-1626b40a-99bc-425c-a5a4-ec96f0fecde7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:00:53.059579 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c21b206-a4d7-49de-b451-5f50c3b4954b None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:00:53.267858 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3845117-0098-4fe6-b3f3-5fea40b7d893 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a39cd50340184779ac589bbcb7cac9aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:00:53.268662 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3845117-0098-4fe6-b3f3-5fea40b7d893 service nova] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:53.269059 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3845117-0098-4fe6-b3f3-5fea40b7d893 service nova] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:53.269452 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3845117-0098-4fe6-b3f3-5fea40b7d893 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:53.295411 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 872/1747] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:00:52 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:00:53.300145 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90cc193-1fec-473c-adcd-1f42773d21e0 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:53.300714 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90cc193-1fec-473c-adcd-1f42773d21e0 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:53.301194 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90cc193-1fec-473c-adcd-1f42773d21e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:53.338710 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-b90cc193-1fec-473c-adcd-1f42773d21e0 None None] MFA Rules not processed for user `46275ec2e63f4e979eaf4d70efff5711`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:00:53.342788 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-b90cc193-1fec-473c-adcd-1f42773d21e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:00:53.467965 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 873/1748] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:00:53 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:00:53.469930 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc3bec1-be3b-4c70-976f-75279ae24749 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:53.470358 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc3bec1-be3b-4c70-976f-75279ae24749 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:53.470866 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc3bec1-be3b-4c70-976f-75279ae24749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:53.503783 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3845117-0098-4fe6-b3f3-5fea40b7d893 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:00:53.503783 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3845117-0098-4fe6-b3f3-5fea40b7d893 service nova] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:00:53.517341 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 876/1749] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:00:52 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 736 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:00:53.518710 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3845117-0098-4fe6-b3f3-5fea40b7d893 service nova] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:00:53.537127 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-bdc3bec1-be3b-4c70-976f-75279ae24749 None None] MFA Rules not processed for user `a39cd50340184779ac589bbcb7cac9aa`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:00:53.537687 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-bdc3bec1-be3b-4c70-976f-75279ae24749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:00:53.556120 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 874/1750] 10.222.0.27 () {58 vars in 1018 bytes} [Thu Aug 18 22:00:53 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:00:53.557407 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc3bec1-be3b-4c70-976f-75279ae24749 None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:00:53.561248 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-bdc3bec1-be3b-4c70-976f-75279ae24749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:00:53.715197 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc3bec1-be3b-4c70-976f-75279ae24749 None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:00:53.727310 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8827c94-e282-4009-8368-1451229760bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:00:53.733720 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8827c94-e282-4009-8368-1451229760bd admin admin] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:53.733994 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8827c94-e282-4009-8368-1451229760bd admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:53.736519 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8827c94-e282-4009-8368-1451229760bd admin admin] PATH_INFO: `/v3/projects` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:53.737267 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8827c94-e282-4009-8368-1451229760bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:00:53.745757 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8827c94-e282-4009-8368-1451229760bd admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:00:53.903228 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3845117-0098-4fe6-b3f3-5fea40b7d893 service nova] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:00:53.910162 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 875/1751] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 18 22:00:53 2022] POST /identity/v3/projects => generated 405 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 22:00:53.916022 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8827c94-e282-4009-8368-1451229760bd admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:00:54.123611 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8827c94-e282-4009-8368-1451229760bd admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:00:54.154289 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa8ce81-2661-4724-b5c6-b147e40f30ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:00:54.155121 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa8ce81-2661-4724-b5c6-b147e40f30ae admin admin] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:54.155535 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa8ce81-2661-4724-b5c6-b147e40f30ae admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:54.156048 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa8ce81-2661-4724-b5c6-b147e40f30ae admin admin] PATH_INFO: `/v3/users` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:54.158715 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa8ce81-2661-4724-b5c6-b147e40f30ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:00:54.165948 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa8ce81-2661-4724-b5c6-b147e40f30ae admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:00:54.182684 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b441e98-4cac-45e2-8c76-4f37680fe191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:00:54.184068 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b441e98-4cac-45e2-8c76-4f37680fe191 admin admin] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:54.184163 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b441e98-4cac-45e2-8c76-4f37680fe191 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:54.184905 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b441e98-4cac-45e2-8c76-4f37680fe191 admin admin] PATH_INFO: `/v3/projects` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:54.186050 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b441e98-4cac-45e2-8c76-4f37680fe191 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:00:54.189943 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b441e98-4cac-45e2-8c76-4f37680fe191 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:00:54.319427 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 876/1752] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 18 22:00:53 2022] POST /identity/v3/users => generated 309 bytes in 404 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 22:00:54.321777 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa8ce81-2661-4724-b5c6-b147e40f30ae admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:00:54.344849 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa8ce81-2661-4724-b5c6-b147e40f30ae admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:00:54.354848 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f6cf2b-fb80-406d-bb42-6dd7fd8a2055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:00:54.356980 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f6cf2b-fb80-406d-bb42-6dd7fd8a2055 admin admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:54.357653 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f6cf2b-fb80-406d-bb42-6dd7fd8a2055 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:54.358380 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f6cf2b-fb80-406d-bb42-6dd7fd8a2055 admin admin] PATH_INFO: `/v3/roles` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:54.359982 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f6cf2b-fb80-406d-bb42-6dd7fd8a2055 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:00:54.364373 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f6cf2b-fb80-406d-bb42-6dd7fd8a2055 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:00:54.388212 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 877/1753] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:00:54 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:00:54.396352 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f6cf2b-fb80-406d-bb42-6dd7fd8a2055 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:00:54.428492 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 877/1754] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 18 22:00:53 2022] POST /identity/v3/projects => generated 375 bytes in 910 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 22:00:54.431230 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f6cf2b-fb80-406d-bb42-6dd7fd8a2055 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:00:54.434869 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b441e98-4cac-45e2-8c76-4f37680fe191 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:00:54.545796 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c667e6-99ee-4c07-a790-6a8e3bdbcf7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:00:54.549869 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c667e6-99ee-4c07-a790-6a8e3bdbcf7c admin admin] REQUEST_METHOD: `PUT` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:54.550967 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c667e6-99ee-4c07-a790-6a8e3bdbcf7c admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:54.564693 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c667e6-99ee-4c07-a790-6a8e3bdbcf7c admin admin] PATH_INFO: `/v3/projects/47a0feaea9324a1585c09a87a4a90da6/users/852418879b92486c82244105689d5774/roles/0833202e2a3d47d1b6b3af57006641b1` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:54.623324 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c667e6-99ee-4c07-a790-6a8e3bdbcf7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=47a0feaea9324a1585c09a87a4a90da6, user_id=852418879b92486c82244105689d5774, role_id=0833202e2a3d47d1b6b3af57006641b1)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:00:54.626585 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c667e6-99ee-4c07-a790-6a8e3bdbcf7c admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:00:54.664405 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b441e98-4cac-45e2-8c76-4f37680fe191 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:00:54.667637 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c0d3fc-d838-412d-a903-15f9af1b8477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:00:54.668683 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c0d3fc-d838-412d-a903-15f9af1b8477 admin admin] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:54.669346 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c0d3fc-d838-412d-a903-15f9af1b8477 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:54.669927 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c0d3fc-d838-412d-a903-15f9af1b8477 admin admin] PATH_INFO: `/v3/users` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:54.672161 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c0d3fc-d838-412d-a903-15f9af1b8477 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:00:54.676155 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c0d3fc-d838-412d-a903-15f9af1b8477 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:00:54.785935 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 878/1755] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 18 22:00:54 2022] PUT /identity/v3/projects/47a0feaea9324a1585c09a87a4a90da6/users/852418879b92486c82244105689d5774/roles/0833202e2a3d47d1b6b3af57006641b1 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:00:54.798726 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c667e6-99ee-4c07-a790-6a8e3bdbcf7c admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:00:54.803841 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-92c667e6-99ee-4c07-a790-6a8e3bdbcf7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:00:54.807117 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 878/1756] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 18 22:00:54 2022] POST /identity/v3/users => generated 294 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 22:00:54.807117 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c0d3fc-d838-412d-a903-15f9af1b8477 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:00:54.826653 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c0d3fc-d838-412d-a903-15f9af1b8477 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:00:54.933878 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930bd608-c557-490b-a4a1-adc1275fe09a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:00:54.934707 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930bd608-c557-490b-a4a1-adc1275fe09a admin admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:54.935271 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930bd608-c557-490b-a4a1-adc1275fe09a admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:54.935989 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930bd608-c557-490b-a4a1-adc1275fe09a admin admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:54.937887 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930bd608-c557-490b-a4a1-adc1275fe09a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:00:54.940632 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930bd608-c557-490b-a4a1-adc1275fe09a admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:00:54.979675 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 879/1757] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:00:54 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:00:54.981066 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930bd608-c557-490b-a4a1-adc1275fe09a admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:00:55.008536 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930bd608-c557-490b-a4a1-adc1275fe09a admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:00:55.020713 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd968377-429f-411b-a006-42506333d961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:00:55.021350 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd968377-429f-411b-a006-42506333d961 admin admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:55.023565 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd968377-429f-411b-a006-42506333d961 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:55.024572 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd968377-429f-411b-a006-42506333d961 admin admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:55.026908 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd968377-429f-411b-a006-42506333d961 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:00:55.033236 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd968377-429f-411b-a006-42506333d961 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:00:55.048387 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c667e6-99ee-4c07-a790-6a8e3bdbcf7c admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:00:55.069517 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098bffa0-b444-4e3b-bb92-9f1e9a8aa869 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a39cd50340184779ac589bbcb7cac9aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:00:55.070247 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098bffa0-b444-4e3b-bb92-9f1e9a8aa869 service nova] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:55.070523 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098bffa0-b444-4e3b-bb92-9f1e9a8aa869 service nova] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:55.070797 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098bffa0-b444-4e3b-bb92-9f1e9a8aa869 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:55.083424 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 880/1758] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:00:54 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:00:55.084777 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fa6389-f7be-477c-94dd-498aa4c885b5 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:55.086982 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fa6389-f7be-477c-94dd-498aa4c885b5 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:55.087295 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fa6389-f7be-477c-94dd-498aa4c885b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:55.131133 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-80fa6389-f7be-477c-94dd-498aa4c885b5 None None] MFA Rules not processed for user `9c13345ad7e8464fa2f06e013d0ad058`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:00:55.132388 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-80fa6389-f7be-477c-94dd-498aa4c885b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:00:55.132502 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098bffa0-b444-4e3b-bb92-9f1e9a8aa869 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:00:55.134337 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098bffa0-b444-4e3b-bb92-9f1e9a8aa869 service nova] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:00:55.152360 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 879/1759] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:00:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:00:55.167057 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098bffa0-b444-4e3b-bb92-9f1e9a8aa869 service nova] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:00:55.214034 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098bffa0-b444-4e3b-bb92-9f1e9a8aa869 service nova] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:00:55.237566 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e838a00-b835-4f60-b405-7dc6215c86a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:00:55.244616 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e838a00-b835-4f60-b405-7dc6215c86a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:55.244616 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e838a00-b835-4f60-b405-7dc6215c86a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:55.244616 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e838a00-b835-4f60-b405-7dc6215c86a2 admin admin] PATH_INFO: `/v3/projects/47a0feaea9324a1585c09a87a4a90da6/users/852418879b92486c82244105689d5774/roles/0833202e2a3d47d1b6b3af57006641b1` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:55.254959 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e838a00-b835-4f60-b405-7dc6215c86a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47a0feaea9324a1585c09a87a4a90da6, user_id=852418879b92486c82244105689d5774, role_id=0833202e2a3d47d1b6b3af57006641b1)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:00:55.257706 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e838a00-b835-4f60-b405-7dc6215c86a2 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:00:55.336854 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 880/1760] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 18 22:00:55 2022] PUT /identity/v3/projects/47a0feaea9324a1585c09a87a4a90da6/users/852418879b92486c82244105689d5774/roles/0833202e2a3d47d1b6b3af57006641b1 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:00:55.337866 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e838a00-b835-4f60-b405-7dc6215c86a2 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:00:55.360286 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 881/1761] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:00:55 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:00:55.634316 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e838a00-b835-4f60-b405-7dc6215c86a2 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:00:55.644478 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fba2e75-ef24-4ad2-a9c6-516bc501578b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:00:55.648698 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fba2e75-ef24-4ad2-a9c6-516bc501578b admin admin] REQUEST_METHOD: `PUT` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:55.648698 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fba2e75-ef24-4ad2-a9c6-516bc501578b admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:55.648698 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fba2e75-ef24-4ad2-a9c6-516bc501578b admin admin] PATH_INFO: `/v3/projects/0a6b1cffdb0d41c5ba62f01d22011238/users/9306963922fe440db458d83f9b7c63b3/roles/0833202e2a3d47d1b6b3af57006641b1` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:55.686331 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fba2e75-ef24-4ad2-a9c6-516bc501578b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a6b1cffdb0d41c5ba62f01d22011238, user_id=9306963922fe440db458d83f9b7c63b3, role_id=0833202e2a3d47d1b6b3af57006641b1)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:00:55.691685 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fba2e75-ef24-4ad2-a9c6-516bc501578b admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:00:55.746711 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:00:55.818847 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 881/1762] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 18 22:00:55 2022] PUT /identity/v3/projects/0a6b1cffdb0d41c5ba62f01d22011238/users/9306963922fe440db458d83f9b7c63b3/roles/0833202e2a3d47d1b6b3af57006641b1 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:00:55.823136 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fa6389-f7be-477c-94dd-498aa4c885b5 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:00:55.850313 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fa6389-f7be-477c-94dd-498aa4c885b5 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:00:55.912111 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:00:56.004932 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4c6408-9972-4cdc-8051-e144eb535085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:00:56.006390 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4c6408-9972-4cdc-8051-e144eb535085 admin admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:56.007118 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4c6408-9972-4cdc-8051-e144eb535085 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:56.007618 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4c6408-9972-4cdc-8051-e144eb535085 admin admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:56.009556 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4c6408-9972-4cdc-8051-e144eb535085 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:00:56.011688 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4c6408-9972-4cdc-8051-e144eb535085 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:00:56.041138 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fba2e75-ef24-4ad2-a9c6-516bc501578b admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:00:56.043361 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 882/1763] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:00:55 2022] GET /identity/v3/roles => generated 1420 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:00:56.064400 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fba2e75-ef24-4ad2-a9c6-516bc501578b admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:00:56.093332 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f32a267-c89c-45f2-a7e7-f60738bdb0ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:00:56.094525 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f32a267-c89c-45f2-a7e7-f60738bdb0ec admin admin] REQUEST_METHOD: `PUT` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:56.094858 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f32a267-c89c-45f2-a7e7-f60738bdb0ec admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:56.095177 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f32a267-c89c-45f2-a7e7-f60738bdb0ec admin admin] PATH_INFO: `/v3/projects/0a6b1cffdb0d41c5ba62f01d22011238/users/9306963922fe440db458d83f9b7c63b3/roles/0833202e2a3d47d1b6b3af57006641b1` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:56.100451 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f32a267-c89c-45f2-a7e7-f60738bdb0ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a6b1cffdb0d41c5ba62f01d22011238, user_id=9306963922fe440db458d83f9b7c63b3, role_id=0833202e2a3d47d1b6b3af57006641b1)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:00:56.138957 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f32a267-c89c-45f2-a7e7-f60738bdb0ec admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:00:56.176754 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 882/1764] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 18 22:00:56 2022] PUT /identity/v3/projects/0a6b1cffdb0d41c5ba62f01d22011238/users/9306963922fe440db458d83f9b7c63b3/roles/0833202e2a3d47d1b6b3af57006641b1 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 22:00:56.187029 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be245db0-45b5-45ed-a77e-5319ef5cb7ce None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:56.187960 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be245db0-45b5-45ed-a77e-5319ef5cb7ce None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:56.188484 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be245db0-45b5-45ed-a77e-5319ef5cb7ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:56.269097 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-be245db0-45b5-45ed-a77e-5319ef5cb7ce None None] MFA Rules not processed for user `9306963922fe440db458d83f9b7c63b3`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:00:56.272919 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-be245db0-45b5-45ed-a77e-5319ef5cb7ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:00:56.495151 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 883/1765] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:00:56 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:00:56.509341 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f32a267-c89c-45f2-a7e7-f60738bdb0ec admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:00:56.511790 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-8f32a267-c89c-45f2-a7e7-f60738bdb0ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:00:56.667717 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f32a267-c89c-45f2-a7e7-f60738bdb0ec admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:00:56.672242 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2c6b3c-5254-467b-b17b-e4d85c0a73ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22b6a7c36f8a4795a75271b8079821c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:00:56.673208 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2c6b3c-5254-467b-b17b-e4d85c0a73ea service cinder] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:00:56.673638 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2c6b3c-5254-467b-b17b-e4d85c0a73ea service cinder] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:00:56.674137 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2c6b3c-5254-467b-b17b-e4d85c0a73ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:00:56.894656 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2c6b3c-5254-467b-b17b-e4d85c0a73ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:00:56.899030 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2c6b3c-5254-467b-b17b-e4d85c0a73ea service cinder] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:00:56.932885 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 883/1766] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:00:56 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:00:58.083191 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:00:58.782437 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:00:59.913824 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:01:00.383139 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d245b1-49ad-4b70-a816-ca9d11a57d35 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:00.384159 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d245b1-49ad-4b70-a816-ca9d11a57d35 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:00.384443 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d245b1-49ad-4b70-a816-ca9d11a57d35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:00.462431 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-22d245b1-49ad-4b70-a816-ca9d11a57d35 None None] MFA Rules not processed for user `852418879b92486c82244105689d5774`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:01:00.463799 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-22d245b1-49ad-4b70-a816-ca9d11a57d35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:00.720870 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 884/1767] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:01:00 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:01:01.476979 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2c6b3c-5254-467b-b17b-e4d85c0a73ea service cinder] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:01.478495 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-fd2c6b3c-5254-467b-b17b-e4d85c0a73ea service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:01.493307 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2c6b3c-5254-467b-b17b-e4d85c0a73ea service cinder] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:01.497669 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebee31cc-7460-43a1-90cb-222a25da772d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22b6a7c36f8a4795a75271b8079821c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:01.498571 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebee31cc-7460-43a1-90cb-222a25da772d service cinder] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:01.499485 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebee31cc-7460-43a1-90cb-222a25da772d service cinder] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:01.500906 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebee31cc-7460-43a1-90cb-222a25da772d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:01.512497 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebee31cc-7460-43a1-90cb-222a25da772d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:01.514194 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebee31cc-7460-43a1-90cb-222a25da772d service cinder] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:01.526623 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 884/1768] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:01:01 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:01:01.678312 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:01:01.874396 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1166da0-eae8-42eb-bcc4-28cdb102adcd None None] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:01.874941 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1166da0-eae8-42eb-bcc4-28cdb102adcd None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:01.875438 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1166da0-eae8-42eb-bcc4-28cdb102adcd None None] PATH_INFO: `/` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:01.879414 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 885/1769] 10.222.0.27 () {54 vars in 921 bytes} [Thu Aug 18 22:01:01 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 22:01:01.971146 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247d7d0f-bccc-46cc-8645-91e256c97705 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:01.972301 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247d7d0f-bccc-46cc-8645-91e256c97705 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:01.973323 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247d7d0f-bccc-46cc-8645-91e256c97705 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:02.017971 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-247d7d0f-bccc-46cc-8645-91e256c97705 None None] MFA Rules not processed for user `b44c0cf2d8b34f3e81c59d19eedbdfcc`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:01:02.020068 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-247d7d0f-bccc-46cc-8645-91e256c97705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:02.138497 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 885/1770] 10.222.0.27 () {58 vars in 1018 bytes} [Thu Aug 18 22:01:01 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:01:02.158748 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1166da0-eae8-42eb-bcc4-28cdb102adcd None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:02.165966 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-b1166da0-eae8-42eb-bcc4-28cdb102adcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:02.204917 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1166da0-eae8-42eb-bcc4-28cdb102adcd None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:02.211106 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98147c38-76fd-4ddf-b709-01df6f7d4533 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b44c0cf2d8b34f3e81c59d19eedbdfcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:02.212029 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98147c38-76fd-4ddf-b709-01df6f7d4533 service placement] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:02.212463 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98147c38-76fd-4ddf-b709-01df6f7d4533 service placement] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:02.213193 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98147c38-76fd-4ddf-b709-01df6f7d4533 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:02.249702 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98147c38-76fd-4ddf-b709-01df6f7d4533 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:02.252409 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98147c38-76fd-4ddf-b709-01df6f7d4533 service placement] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:02.296260 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 886/1771] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:01:02 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:01:02.378216 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:01:03.166215 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a7e7cb-983d-4bb6-bc66-a8275d0cf589 None None] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:03.169119 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a7e7cb-983d-4bb6-bc66-a8275d0cf589 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:03.169119 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a7e7cb-983d-4bb6-bc66-a8275d0cf589 None None] PATH_INFO: `/` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:03.169119 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 886/1772] 10.222.0.27 () {54 vars in 921 bytes} [Thu Aug 18 22:01:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 22:01:03.205415 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97b1236-ef4d-45eb-869c-72b0888124d6 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:03.206237 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97b1236-ef4d-45eb-869c-72b0888124d6 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:03.206516 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97b1236-ef4d-45eb-869c-72b0888124d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:03.228424 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-c97b1236-ef4d-45eb-869c-72b0888124d6 None None] MFA Rules not processed for user `b44c0cf2d8b34f3e81c59d19eedbdfcc`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:01:03.229942 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-c97b1236-ef4d-45eb-869c-72b0888124d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:03.241959 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:01:03.241959 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 887/1773] 10.222.0.27 () {58 vars in 1018 bytes} [Thu Aug 18 22:01:03 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:01:03.258502 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a7e7cb-983d-4bb6-bc66-a8275d0cf589 None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:03.260388 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-a0a7e7cb-983d-4bb6-bc66-a8275d0cf589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:03.279225 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a7e7cb-983d-4bb6-bc66-a8275d0cf589 None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:03.295598 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b395fd-3fca-40f3-a5ba-bb3de2108b51 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b44c0cf2d8b34f3e81c59d19eedbdfcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:03.296668 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b395fd-3fca-40f3-a5ba-bb3de2108b51 service placement] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:03.298100 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b395fd-3fca-40f3-a5ba-bb3de2108b51 service placement] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:03.298775 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b395fd-3fca-40f3-a5ba-bb3de2108b51 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:03.316853 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b395fd-3fca-40f3-a5ba-bb3de2108b51 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:03.319301 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b395fd-3fca-40f3-a5ba-bb3de2108b51 service placement] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:03.335659 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 887/1774] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:01:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:01:03.352140 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97b1236-ef4d-45eb-869c-72b0888124d6 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:03.483139 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97b1236-ef4d-45eb-869c-72b0888124d6 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:03.489775 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957b3e87-500a-4b5e-9ffd-d1c1e2b39f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:03.490570 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957b3e87-500a-4b5e-9ffd-d1c1e2b39f34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:03.493233 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957b3e87-500a-4b5e-9ffd-d1c1e2b39f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:03.493233 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957b3e87-500a-4b5e-9ffd-d1c1e2b39f34 admin admin] PATH_INFO: `/v3/users/46275ec2e63f4e979eaf4d70efff5711` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:03.493233 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957b3e87-500a-4b5e-9ffd-d1c1e2b39f34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46275ec2e63f4e979eaf4d70efff5711)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:03.494995 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957b3e87-500a-4b5e-9ffd-d1c1e2b39f34 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:03.788927 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-957b3e87-500a-4b5e-9ffd-d1c1e2b39f34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46275ec2e63f4e979eaf4d70efff5711'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:03.804564 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-957b3e87-500a-4b5e-9ffd-d1c1e2b39f34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46275ec2e63f4e979eaf4d70efff5711'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:03.807166 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-957b3e87-500a-4b5e-9ffd-d1c1e2b39f34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46275ec2e63f4e979eaf4d70efff5711'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:03.856795 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-957b3e87-500a-4b5e-9ffd-d1c1e2b39f34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46275ec2e63f4e979eaf4d70efff5711'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:03.993629 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-957b3e87-500a-4b5e-9ffd-d1c1e2b39f34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46275ec2e63f4e979eaf4d70efff5711'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:04.003412 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 888/1775] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 18 22:01:03 2022] DELETE /identity/v3/users/46275ec2e63f4e979eaf4d70efff5711 => generated 0 bytes in 652 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 22:01:05.456616 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b395fd-3fca-40f3-a5ba-bb3de2108b51 service placement] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:05.478849 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b395fd-3fca-40f3-a5ba-bb3de2108b51 service placement] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:05.542924 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:01:05.602877 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91f1acd-4cd6-4677-81d0-9a52a171fc90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:05.605838 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91f1acd-4cd6-4677-81d0-9a52a171fc90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:05.605838 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91f1acd-4cd6-4677-81d0-9a52a171fc90 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:05.608707 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91f1acd-4cd6-4677-81d0-9a52a171fc90 admin admin] PATH_INFO: `/v3/projects/27f719aa9d0044ec9eefd651b849736f` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:05.611064 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91f1acd-4cd6-4677-81d0-9a52a171fc90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=27f719aa9d0044ec9eefd651b849736f)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:05.613872 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91f1acd-4cd6-4677-81d0-9a52a171fc90 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:05.817311 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-f91f1acd-4cd6-4677-81d0-9a52a171fc90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27f719aa9d0044ec9eefd651b849736f', 'request_id': 'req-f91f1acd-4cd6-4677-81d0-9a52a171fc90'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:05.823154 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-f91f1acd-4cd6-4677-81d0-9a52a171fc90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27f719aa9d0044ec9eefd651b849736f', 'request_id': 'req-f91f1acd-4cd6-4677-81d0-9a52a171fc90'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:05.905449 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-f91f1acd-4cd6-4677-81d0-9a52a171fc90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27f719aa9d0044ec9eefd651b849736f', 'request_id': 'req-f91f1acd-4cd6-4677-81d0-9a52a171fc90'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:05.920272 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-f91f1acd-4cd6-4677-81d0-9a52a171fc90 admin admin] The token cache is being invalidate because project 27f719aa9d0044ec9eefd651b849736f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88096) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 22:01:05.936010 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-f91f1acd-4cd6-4677-81d0-9a52a171fc90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:05.936010 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-f91f1acd-4cd6-4677-81d0-9a52a171fc90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:05.936010 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 888/1776] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 18 22:01:05 2022] DELETE /identity/v3/projects/27f719aa9d0044ec9eefd651b849736f => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:01:05.937786 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957b3e87-500a-4b5e-9ffd-d1c1e2b39f34 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:05.938916 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-957b3e87-500a-4b5e-9ffd-d1c1e2b39f34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:05.959446 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957b3e87-500a-4b5e-9ffd-d1c1e2b39f34 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:06.003378 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:01:06.021978 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0730e80a-57b5-48f5-89d4-4cbdbc191505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:06.022878 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0730e80a-57b5-48f5-89d4-4cbdbc191505 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:06.023156 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0730e80a-57b5-48f5-89d4-4cbdbc191505 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:06.023427 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0730e80a-57b5-48f5-89d4-4cbdbc191505 admin admin] PATH_INFO: `/v3/users/852418879b92486c82244105689d5774` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:06.024546 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0730e80a-57b5-48f5-89d4-4cbdbc191505 admin admin] RBAC: Authorizing `identity:delete_user(user_id=852418879b92486c82244105689d5774)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:06.026544 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0730e80a-57b5-48f5-89d4-4cbdbc191505 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:06.232948 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-0730e80a-57b5-48f5-89d4-4cbdbc191505 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '852418879b92486c82244105689d5774'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:06.242967 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-0730e80a-57b5-48f5-89d4-4cbdbc191505 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '852418879b92486c82244105689d5774'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:06.244098 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-0730e80a-57b5-48f5-89d4-4cbdbc191505 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '852418879b92486c82244105689d5774'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:06.266261 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-0730e80a-57b5-48f5-89d4-4cbdbc191505 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '852418879b92486c82244105689d5774'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:06.375378 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-0730e80a-57b5-48f5-89d4-4cbdbc191505 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '852418879b92486c82244105689d5774'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:06.387018 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 889/1777] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 18 22:01:05 2022] DELETE /identity/v3/users/852418879b92486c82244105689d5774 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:01:06.787186 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91f1acd-4cd6-4677-81d0-9a52a171fc90 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:06.789741 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-f91f1acd-4cd6-4677-81d0-9a52a171fc90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:06.804933 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91f1acd-4cd6-4677-81d0-9a52a171fc90 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:06.867052 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c006ec6-c35b-4a6e-a0ca-3dd406e24de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:06.867699 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c006ec6-c35b-4a6e-a0ca-3dd406e24de3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:06.867982 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c006ec6-c35b-4a6e-a0ca-3dd406e24de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:06.868258 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c006ec6-c35b-4a6e-a0ca-3dd406e24de3 admin admin] PATH_INFO: `/v3/projects/47a0feaea9324a1585c09a87a4a90da6` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:06.869469 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c006ec6-c35b-4a6e-a0ca-3dd406e24de3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=47a0feaea9324a1585c09a87a4a90da6)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:06.871376 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c006ec6-c35b-4a6e-a0ca-3dd406e24de3 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:07.005323 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-2c006ec6-c35b-4a6e-a0ca-3dd406e24de3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47a0feaea9324a1585c09a87a4a90da6', 'request_id': 'req-2c006ec6-c35b-4a6e-a0ca-3dd406e24de3'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:07.011339 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-2c006ec6-c35b-4a6e-a0ca-3dd406e24de3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47a0feaea9324a1585c09a87a4a90da6', 'request_id': 'req-2c006ec6-c35b-4a6e-a0ca-3dd406e24de3'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:07.060726 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-2c006ec6-c35b-4a6e-a0ca-3dd406e24de3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47a0feaea9324a1585c09a87a4a90da6', 'request_id': 'req-2c006ec6-c35b-4a6e-a0ca-3dd406e24de3'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:07.062307 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:01:07.074684 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-2c006ec6-c35b-4a6e-a0ca-3dd406e24de3 admin admin] The token cache is being invalidate because project 47a0feaea9324a1585c09a87a4a90da6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88096) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 22:01:07.074980 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-2c006ec6-c35b-4a6e-a0ca-3dd406e24de3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:07.075646 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-2c006ec6-c35b-4a6e-a0ca-3dd406e24de3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:07.077471 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 889/1778] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 18 22:01:06 2022] DELETE /identity/v3/projects/47a0feaea9324a1585c09a87a4a90da6 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:01:07.083967 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413c6dd8-785a-48e7-84cf-bd554f2dfc1f None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:07.084522 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413c6dd8-785a-48e7-84cf-bd554f2dfc1f None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:07.084522 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413c6dd8-785a-48e7-84cf-bd554f2dfc1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:07.108139 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-413c6dd8-785a-48e7-84cf-bd554f2dfc1f None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:01:07.109720 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-413c6dd8-785a-48e7-84cf-bd554f2dfc1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:07.186715 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 890/1779] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:01:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:01:07.195278 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a23eb9d-221e-45a2-944f-ba63277c2ce4 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:07.195559 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a23eb9d-221e-45a2-944f-ba63277c2ce4 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:07.195827 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a23eb9d-221e-45a2-944f-ba63277c2ce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:07.216677 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-7a23eb9d-221e-45a2-944f-ba63277c2ce4 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:01:07.218116 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-7a23eb9d-221e-45a2-944f-ba63277c2ce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:07.228264 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 890/1780] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:01:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:01:07.232733 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413c6dd8-785a-48e7-84cf-bd554f2dfc1f None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:07.243113 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413c6dd8-785a-48e7-84cf-bd554f2dfc1f None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:07.248235 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a30e9e-7994-45a6-b35c-e5e513ea1d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:07.248958 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a30e9e-7994-45a6-b35c-e5e513ea1d0b admin admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:07.249305 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a30e9e-7994-45a6-b35c-e5e513ea1d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:07.249644 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a30e9e-7994-45a6-b35c-e5e513ea1d0b admin admin] PATH_INFO: `/v3/domains` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:07.250402 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a30e9e-7994-45a6-b35c-e5e513ea1d0b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 22:01:07.250718 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a30e9e-7994-45a6-b35c-e5e513ea1d0b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:07.253183 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a30e9e-7994-45a6-b35c-e5e513ea1d0b admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:07.268653 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 891/1781] 10.222.0.27 () {58 vars in 1153 bytes} [Thu Aug 18 22:01:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 22:01:07.270208 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a23eb9d-221e-45a2-944f-ba63277c2ce4 None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:07.280028 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a23eb9d-221e-45a2-944f-ba63277c2ce4 None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:07.288648 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17dba87-b9f1-4ea7-a96b-68b0b57ab9f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:07.288648 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17dba87-b9f1-4ea7-a96b-68b0b57ab9f3 admin admin] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:07.288648 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17dba87-b9f1-4ea7-a96b-68b0b57ab9f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:07.288648 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17dba87-b9f1-4ea7-a96b-68b0b57ab9f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:07.289112 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17dba87-b9f1-4ea7-a96b-68b0b57ab9f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:07.289112 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17dba87-b9f1-4ea7-a96b-68b0b57ab9f3 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:07.394697 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a30e9e-7994-45a6-b35c-e5e513ea1d0b admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:07.394977 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 891/1782] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 18 22:01:07 2022] POST /identity/v3/projects => generated 371 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 22:01:07.406841 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a30e9e-7994-45a6-b35c-e5e513ea1d0b admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:07.466133 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d720f1-e6f3-46d1-8ae6-edf4b24abb15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:07.466784 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d720f1-e6f3-46d1-8ae6-edf4b24abb15 admin admin] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:07.467069 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d720f1-e6f3-46d1-8ae6-edf4b24abb15 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:07.467344 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d720f1-e6f3-46d1-8ae6-edf4b24abb15 admin admin] PATH_INFO: `/v3/users` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:07.467972 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d720f1-e6f3-46d1-8ae6-edf4b24abb15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:07.470074 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d720f1-e6f3-46d1-8ae6-edf4b24abb15 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:07.590206 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 892/1783] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 18 22:01:07 2022] POST /identity/v3/users => generated 286 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 22:01:07.594352 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17dba87-b9f1-4ea7-a96b-68b0b57ab9f3 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:07.604839 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17dba87-b9f1-4ea7-a96b-68b0b57ab9f3 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:07.617063 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d938cc-3e10-4126-9758-fd2415854f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:07.617943 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d938cc-3e10-4126-9758-fd2415854f84 admin admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:07.618388 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d938cc-3e10-4126-9758-fd2415854f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:07.618824 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d938cc-3e10-4126-9758-fd2415854f84 admin admin] PATH_INFO: `/v3/roles` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:07.620140 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d938cc-3e10-4126-9758-fd2415854f84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:07.621517 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d938cc-3e10-4126-9758-fd2415854f84 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:07.637943 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 892/1784] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:01:07 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:01:07.638296 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d720f1-e6f3-46d1-8ae6-edf4b24abb15 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:07.651114 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d720f1-e6f3-46d1-8ae6-edf4b24abb15 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:07.657577 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93293823-88e3-492e-9d40-8ac38c4ab857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:07.658463 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93293823-88e3-492e-9d40-8ac38c4ab857 admin admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:07.658936 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93293823-88e3-492e-9d40-8ac38c4ab857 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:07.659359 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93293823-88e3-492e-9d40-8ac38c4ab857 admin admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:07.660161 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93293823-88e3-492e-9d40-8ac38c4ab857 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:07.662141 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93293823-88e3-492e-9d40-8ac38c4ab857 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:07.675200 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 893/1785] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:01:07 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:01:07.678955 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d938cc-3e10-4126-9758-fd2415854f84 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:07.690405 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d938cc-3e10-4126-9758-fd2415854f84 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:07.699712 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9200c0-d8d1-4276-8d34-4e968c9b3f40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:07.700482 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9200c0-d8d1-4276-8d34-4e968c9b3f40 admin admin] REQUEST_METHOD: `PUT` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:07.700851 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9200c0-d8d1-4276-8d34-4e968c9b3f40 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:07.701191 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9200c0-d8d1-4276-8d34-4e968c9b3f40 admin admin] PATH_INFO: `/v3/projects/d38b9feb8cb34e2e88b9e6ef548d4536/users/e440abea230b4e559c43cc98d639bce8/roles/de8f2438056f4af9879423f8a59e0e0b` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:07.718937 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9200c0-d8d1-4276-8d34-4e968c9b3f40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d38b9feb8cb34e2e88b9e6ef548d4536, user_id=e440abea230b4e559c43cc98d639bce8, role_id=de8f2438056f4af9879423f8a59e0e0b)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:07.722778 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9200c0-d8d1-4276-8d34-4e968c9b3f40 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:07.831730 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 893/1786] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 18 22:01:07 2022] PUT /identity/v3/projects/d38b9feb8cb34e2e88b9e6ef548d4536/users/e440abea230b4e559c43cc98d639bce8/roles/de8f2438056f4af9879423f8a59e0e0b => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:01:07.844451 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdfdea0-109b-4ff8-b961-b6d830311f59 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:07.845008 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdfdea0-109b-4ff8-b961-b6d830311f59 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:07.845384 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdfdea0-109b-4ff8-b961-b6d830311f59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:07.898955 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-6bdfdea0-109b-4ff8-b961-b6d830311f59 None None] MFA Rules not processed for user `e440abea230b4e559c43cc98d639bce8`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:01:07.900183 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-6bdfdea0-109b-4ff8-b961-b6d830311f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:08.003472 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 894/1787] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:01:07 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:01:08.014379 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9200c0-d8d1-4276-8d34-4e968c9b3f40 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:08.089637 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9200c0-d8d1-4276-8d34-4e968c9b3f40 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:08.095442 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90418322-29b6-4766-b2ff-5479523258f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:08.109140 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90418322-29b6-4766-b2ff-5479523258f0 admin admin] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:08.109140 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90418322-29b6-4766-b2ff-5479523258f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:08.109140 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90418322-29b6-4766-b2ff-5479523258f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:08.109140 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90418322-29b6-4766-b2ff-5479523258f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:08.109140 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90418322-29b6-4766-b2ff-5479523258f0 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:08.225160 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 894/1788] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 18 22:01:08 2022] POST /identity/v3/projects => generated 371 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 22:01:08.233537 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdfdea0-109b-4ff8-b961-b6d830311f59 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:08.252698 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdfdea0-109b-4ff8-b961-b6d830311f59 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:08.343925 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02943b68-393e-482d-8450-83fd4d83e2e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:08.345002 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02943b68-393e-482d-8450-83fd4d83e2e0 admin admin] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:08.345764 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02943b68-393e-482d-8450-83fd4d83e2e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:08.346203 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02943b68-393e-482d-8450-83fd4d83e2e0 admin admin] PATH_INFO: `/v3/users` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:08.347002 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02943b68-393e-482d-8450-83fd4d83e2e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:08.349753 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02943b68-393e-482d-8450-83fd4d83e2e0 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:08.359420 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8973ac-8c67-4fb4-b50d-08804a8a4528 None None] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:08.362563 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8973ac-8c67-4fb4-b50d-08804a8a4528 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:08.368569 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8973ac-8c67-4fb4-b50d-08804a8a4528 None None] PATH_INFO: `/` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:08.368836 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 895/1789] 10.222.0.27 () {54 vars in 921 bytes} [Thu Aug 18 22:01:08 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 22:01:08.379013 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600e376f-c543-4e7b-a4f8-0eb5dc84f1f8 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:08.380077 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600e376f-c543-4e7b-a4f8-0eb5dc84f1f8 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:08.380392 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600e376f-c543-4e7b-a4f8-0eb5dc84f1f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:08.407330 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-600e376f-c543-4e7b-a4f8-0eb5dc84f1f8 None None] MFA Rules not processed for user `a39cd50340184779ac589bbcb7cac9aa`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:01:08.408814 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-600e376f-c543-4e7b-a4f8-0eb5dc84f1f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:08.443859 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:01:08.481608 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 896/1790] 10.222.0.27 () {58 vars in 1018 bytes} [Thu Aug 18 22:01:08 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 22:01:08.482730 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600e376f-c543-4e7b-a4f8-0eb5dc84f1f8 None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:08.484392 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-600e376f-c543-4e7b-a4f8-0eb5dc84f1f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:08.500352 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 895/1791] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 18 22:01:08 2022] POST /identity/v3/users => generated 292 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 22:01:08.500352 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02943b68-393e-482d-8450-83fd4d83e2e0 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:08.504720 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02943b68-393e-482d-8450-83fd4d83e2e0 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:08.512473 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2d1fad-68a9-4644-b710-a0955400194c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:08.513611 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2d1fad-68a9-4644-b710-a0955400194c admin admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:08.514033 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2d1fad-68a9-4644-b710-a0955400194c admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:08.514470 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2d1fad-68a9-4644-b710-a0955400194c admin admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:08.515447 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2d1fad-68a9-4644-b710-a0955400194c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:08.517725 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2d1fad-68a9-4644-b710-a0955400194c admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:08.523902 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600e376f-c543-4e7b-a4f8-0eb5dc84f1f8 None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:08.529143 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08035190-4a25-45a9-a3d1-fbac17e1b4ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:08.536999 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08035190-4a25-45a9-a3d1-fbac17e1b4ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:08.536999 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08035190-4a25-45a9-a3d1-fbac17e1b4ac admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:08.536999 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08035190-4a25-45a9-a3d1-fbac17e1b4ac admin admin] PATH_INFO: `/v3/users/f5907ee2e62240b2a896783fefce4509` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:08.536999 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08035190-4a25-45a9-a3d1-fbac17e1b4ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5907ee2e62240b2a896783fefce4509)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:08.537531 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 896/1792] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:01:08 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 22:01:08.538048 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08035190-4a25-45a9-a3d1-fbac17e1b4ac admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:08.542373 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2d1fad-68a9-4644-b710-a0955400194c admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:08.546437 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-bd2d1fad-68a9-4644-b710-a0955400194c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:08.564396 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2d1fad-68a9-4644-b710-a0955400194c admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:08.571933 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5e295d-e94a-49a4-8588-44175ab6d5bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a39cd50340184779ac589bbcb7cac9aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:08.572780 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5e295d-e94a-49a4-8588-44175ab6d5bb service nova] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:08.573180 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5e295d-e94a-49a4-8588-44175ab6d5bb service nova] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:08.573735 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5e295d-e94a-49a4-8588-44175ab6d5bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:08.597203 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5e295d-e94a-49a4-8588-44175ab6d5bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:08.603387 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5e295d-e94a-49a4-8588-44175ab6d5bb service nova] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:08.618381 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 897/1793] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:01:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:01:08.619842 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5e295d-e94a-49a4-8588-44175ab6d5bb service nova] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:08.632427 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5e295d-e94a-49a4-8588-44175ab6d5bb service nova] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:08.638271 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b528c6e-1aa6-4446-afbe-713521d533a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:08.639762 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b528c6e-1aa6-4446-afbe-713521d533a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:08.640228 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b528c6e-1aa6-4446-afbe-713521d533a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:08.640755 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b528c6e-1aa6-4446-afbe-713521d533a3 admin admin] PATH_INFO: `/v3/projects/7901f1ac46f0431db0c57a9b89bfd132/users/8736a93606a64f4589f1ad8b8c2b0e40/roles/0833202e2a3d47d1b6b3af57006641b1` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:08.667791 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b528c6e-1aa6-4446-afbe-713521d533a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7901f1ac46f0431db0c57a9b89bfd132, user_id=8736a93606a64f4589f1ad8b8c2b0e40, role_id=0833202e2a3d47d1b6b3af57006641b1)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:08.673659 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b528c6e-1aa6-4446-afbe-713521d533a3 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:08.816761 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 898/1794] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 18 22:01:08 2022] PUT /identity/v3/projects/7901f1ac46f0431db0c57a9b89bfd132/users/8736a93606a64f4589f1ad8b8c2b0e40/roles/0833202e2a3d47d1b6b3af57006641b1 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:01:08.821626 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b528c6e-1aa6-4446-afbe-713521d533a3 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:08.829759 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-08035190-4a25-45a9-a3d1-fbac17e1b4ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5907ee2e62240b2a896783fefce4509'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:08.853837 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-08035190-4a25-45a9-a3d1-fbac17e1b4ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5907ee2e62240b2a896783fefce4509'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:08.853837 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-08035190-4a25-45a9-a3d1-fbac17e1b4ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5907ee2e62240b2a896783fefce4509'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:08.853837 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-08035190-4a25-45a9-a3d1-fbac17e1b4ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5907ee2e62240b2a896783fefce4509'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:08.885329 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-08035190-4a25-45a9-a3d1-fbac17e1b4ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5907ee2e62240b2a896783fefce4509'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:08.951159 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b528c6e-1aa6-4446-afbe-713521d533a3 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:08.964238 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c165481-12e6-4b04-9c60-32cbc018b121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:08.965080 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c165481-12e6-4b04-9c60-32cbc018b121 admin admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:08.965504 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c165481-12e6-4b04-9c60-32cbc018b121 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:08.965681 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c165481-12e6-4b04-9c60-32cbc018b121 admin admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:08.966533 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c165481-12e6-4b04-9c60-32cbc018b121 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:08.968849 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c165481-12e6-4b04-9c60-32cbc018b121 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:08.975935 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 897/1795] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 18 22:01:08 2022] DELETE /identity/v3/users/f5907ee2e62240b2a896783fefce4509 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:01:08.979131 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99bf688-b701-40ac-96be-33e6035dc445 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:08.979576 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99bf688-b701-40ac-96be-33e6035dc445 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:08.979855 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99bf688-b701-40ac-96be-33e6035dc445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:09.005048 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 899/1796] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:01:08 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:01:09.011591 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c165481-12e6-4b04-9c60-32cbc018b121 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:09.015224 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-0c165481-12e6-4b04-9c60-32cbc018b121 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:09.037937 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-a99bf688-b701-40ac-96be-33e6035dc445 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:01:09.039832 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-a99bf688-b701-40ac-96be-33e6035dc445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:09.042458 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c165481-12e6-4b04-9c60-32cbc018b121 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:09.119049 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa4c2fa-adab-4818-81a6-6a615cab3410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:09.119267 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa4c2fa-adab-4818-81a6-6a615cab3410 admin admin] REQUEST_METHOD: `PUT` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:09.119494 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa4c2fa-adab-4818-81a6-6a615cab3410 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:09.120631 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa4c2fa-adab-4818-81a6-6a615cab3410 admin admin] PATH_INFO: `/v3/projects/7901f1ac46f0431db0c57a9b89bfd132/users/8736a93606a64f4589f1ad8b8c2b0e40/roles/0833202e2a3d47d1b6b3af57006641b1` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:09.120787 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 898/1797] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:01:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:01:09.121838 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa4c2fa-adab-4818-81a6-6a615cab3410 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7901f1ac46f0431db0c57a9b89bfd132, user_id=8736a93606a64f4589f1ad8b8c2b0e40, role_id=0833202e2a3d47d1b6b3af57006641b1)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:09.125196 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa4c2fa-adab-4818-81a6-6a615cab3410 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:09.132071 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99bf688-b701-40ac-96be-33e6035dc445 None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:09.133982 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-a99bf688-b701-40ac-96be-33e6035dc445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:09.141213 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 900/1798] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 18 22:01:09 2022] PUT /identity/v3/projects/7901f1ac46f0431db0c57a9b89bfd132/users/8736a93606a64f4589f1ad8b8c2b0e40/roles/0833202e2a3d47d1b6b3af57006641b1 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:01:09.152380 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfa47df-85c7-48d5-b0e3-a8dee1481478 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:09.152699 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfa47df-85c7-48d5-b0e3-a8dee1481478 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:09.152959 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfa47df-85c7-48d5-b0e3-a8dee1481478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:09.188144 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-8bfa47df-85c7-48d5-b0e3-a8dee1481478 None None] MFA Rules not processed for user `8736a93606a64f4589f1ad8b8c2b0e40`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:01:09.190578 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-8bfa47df-85c7-48d5-b0e3-a8dee1481478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:09.206208 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99bf688-b701-40ac-96be-33e6035dc445 None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:09.270647 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241af80c-4f70-48a2-bb0a-07344e5c33d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a937971ad1a4b0c8697c764f214d446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:09.271400 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241af80c-4f70-48a2-bb0a-07344e5c33d6 service neutron] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:09.271751 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241af80c-4f70-48a2-bb0a-07344e5c33d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:09.272097 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241af80c-4f70-48a2-bb0a-07344e5c33d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:09.278612 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 901/1799] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:01:09 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:01:09.290893 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfa47df-85c7-48d5-b0e3-a8dee1481478 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:09.293652 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-8bfa47df-85c7-48d5-b0e3-a8dee1481478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:09.344889 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241af80c-4f70-48a2-bb0a-07344e5c33d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:09.347263 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241af80c-4f70-48a2-bb0a-07344e5c33d6 service neutron] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:09.360039 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 899/1800] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:01:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 22:01:09.365033 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfa47df-85c7-48d5-b0e3-a8dee1481478 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:09.371156 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ef8e46-a908-4d2f-bd65-9f75c6883384 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22b6a7c36f8a4795a75271b8079821c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:09.371693 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ef8e46-a908-4d2f-bd65-9f75c6883384 service cinder] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:09.371974 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ef8e46-a908-4d2f-bd65-9f75c6883384 service cinder] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:09.372253 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ef8e46-a908-4d2f-bd65-9f75c6883384 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:09.383140 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ef8e46-a908-4d2f-bd65-9f75c6883384 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:09.384680 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ef8e46-a908-4d2f-bd65-9f75c6883384 service cinder] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:09.396168 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 902/1801] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:01:09 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 22:01:09.523679 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:01:09.806461 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241af80c-4f70-48a2-bb0a-07344e5c33d6 service neutron] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:09.807886 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-241af80c-4f70-48a2-bb0a-07344e5c33d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:09.824207 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241af80c-4f70-48a2-bb0a-07344e5c33d6 service neutron] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:09.835391 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9823ff98-c473-4fb3-9d15-ab6eb4afdd14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:09.836168 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9823ff98-c473-4fb3-9d15-ab6eb4afdd14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:09.836452 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9823ff98-c473-4fb3-9d15-ab6eb4afdd14 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:09.836777 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9823ff98-c473-4fb3-9d15-ab6eb4afdd14 admin admin] PATH_INFO: `/v3/projects/2ef4f8cae6804d66af6759c9476b3c16` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:09.841507 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9823ff98-c473-4fb3-9d15-ab6eb4afdd14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ef4f8cae6804d66af6759c9476b3c16)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:09.843694 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9823ff98-c473-4fb3-9d15-ab6eb4afdd14 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:10.023991 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-9823ff98-c473-4fb3-9d15-ab6eb4afdd14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ef4f8cae6804d66af6759c9476b3c16', 'request_id': 'req-9823ff98-c473-4fb3-9d15-ab6eb4afdd14'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:10.033675 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-9823ff98-c473-4fb3-9d15-ab6eb4afdd14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ef4f8cae6804d66af6759c9476b3c16', 'request_id': 'req-9823ff98-c473-4fb3-9d15-ab6eb4afdd14'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:10.126936 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-9823ff98-c473-4fb3-9d15-ab6eb4afdd14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ef4f8cae6804d66af6759c9476b3c16', 'request_id': 'req-9823ff98-c473-4fb3-9d15-ab6eb4afdd14'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:10.143649 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-9823ff98-c473-4fb3-9d15-ab6eb4afdd14 admin admin] The token cache is being invalidate because project 2ef4f8cae6804d66af6759c9476b3c16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88096) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 22:01:10.143840 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-9823ff98-c473-4fb3-9d15-ab6eb4afdd14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:10.144529 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-9823ff98-c473-4fb3-9d15-ab6eb4afdd14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:10.146248 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 900/1802] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 18 22:01:09 2022] DELETE /identity/v3/projects/2ef4f8cae6804d66af6759c9476b3c16 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:01:10.151692 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ef8e46-a908-4d2f-bd65-9f75c6883384 service cinder] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:10.165102 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ef8e46-a908-4d2f-bd65-9f75c6883384 service cinder] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:10.240655 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0444cb6-3ded-4061-bc8b-0213c2edad4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:10.241381 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0444cb6-3ded-4061-bc8b-0213c2edad4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:10.241829 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0444cb6-3ded-4061-bc8b-0213c2edad4d admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:10.244621 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0444cb6-3ded-4061-bc8b-0213c2edad4d admin admin] PATH_INFO: `/v3/users/efeb24569b704c52b5a30b9763984fb7` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:10.244621 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0444cb6-3ded-4061-bc8b-0213c2edad4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=efeb24569b704c52b5a30b9763984fb7)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:10.246379 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0444cb6-3ded-4061-bc8b-0213c2edad4d admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:10.463682 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-a0444cb6-3ded-4061-bc8b-0213c2edad4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'efeb24569b704c52b5a30b9763984fb7'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:10.472901 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-a0444cb6-3ded-4061-bc8b-0213c2edad4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'efeb24569b704c52b5a30b9763984fb7'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:10.474274 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-a0444cb6-3ded-4061-bc8b-0213c2edad4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'efeb24569b704c52b5a30b9763984fb7'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:10.492200 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-a0444cb6-3ded-4061-bc8b-0213c2edad4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'efeb24569b704c52b5a30b9763984fb7'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:10.603885 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-a0444cb6-3ded-4061-bc8b-0213c2edad4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'efeb24569b704c52b5a30b9763984fb7'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:10.609741 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9823ff98-c473-4fb3-9d15-ab6eb4afdd14 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:10.611549 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-9823ff98-c473-4fb3-9d15-ab6eb4afdd14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:10.616944 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 903/1803] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 18 22:01:10 2022] DELETE /identity/v3/users/efeb24569b704c52b5a30b9763984fb7 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:01:10.630705 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9823ff98-c473-4fb3-9d15-ab6eb4afdd14 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:10.720344 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255f7e16-2089-46a8-b975-c36efa538ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:10.721010 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255f7e16-2089-46a8-b975-c36efa538ec9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:10.721305 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255f7e16-2089-46a8-b975-c36efa538ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:10.721625 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255f7e16-2089-46a8-b975-c36efa538ec9 admin admin] PATH_INFO: `/v3/users/e440abea230b4e559c43cc98d639bce8` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:10.725416 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255f7e16-2089-46a8-b975-c36efa538ec9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e440abea230b4e559c43cc98d639bce8)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:10.729652 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255f7e16-2089-46a8-b975-c36efa538ec9 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:10.996947 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-255f7e16-2089-46a8-b975-c36efa538ec9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e440abea230b4e559c43cc98d639bce8'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:11.005534 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-255f7e16-2089-46a8-b975-c36efa538ec9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e440abea230b4e559c43cc98d639bce8'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:11.006230 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-255f7e16-2089-46a8-b975-c36efa538ec9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e440abea230b4e559c43cc98d639bce8'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:11.006846 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-255f7e16-2089-46a8-b975-c36efa538ec9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e440abea230b4e559c43cc98d639bce8'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:11.021429 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-255f7e16-2089-46a8-b975-c36efa538ec9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e440abea230b4e559c43cc98d639bce8'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:11.089994 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 901/1804] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 18 22:01:10 2022] DELETE /identity/v3/users/e440abea230b4e559c43cc98d639bce8 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 22:01:11.094401 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c28fc1a-4706-4013-86f0-ca50b93aa34e None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:11.094866 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c28fc1a-4706-4013-86f0-ca50b93aa34e None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:11.095229 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c28fc1a-4706-4013-86f0-ca50b93aa34e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:11.115356 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-3c28fc1a-4706-4013-86f0-ca50b93aa34e None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:01:11.116621 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-3c28fc1a-4706-4013-86f0-ca50b93aa34e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:11.178340 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 904/1805] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:01:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 22:01:11.189683 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255f7e16-2089-46a8-b975-c36efa538ec9 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:11.191355 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-255f7e16-2089-46a8-b975-c36efa538ec9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:11.250419 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255f7e16-2089-46a8-b975-c36efa538ec9 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:11.254709 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c28fc1a-4706-4013-86f0-ca50b93aa34e None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:11.256115 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-3c28fc1a-4706-4013-86f0-ca50b93aa34e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:11.256238 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b6c8b0-4885-45c4-af79-421baf073508 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a937971ad1a4b0c8697c764f214d446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:11.256920 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b6c8b0-4885-45c4-af79-421baf073508 service neutron] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:11.257388 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b6c8b0-4885-45c4-af79-421baf073508 service neutron] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:11.257784 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b6c8b0-4885-45c4-af79-421baf073508 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:11.269974 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b6c8b0-4885-45c4-af79-421baf073508 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:11.271461 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b6c8b0-4885-45c4-af79-421baf073508 service neutron] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:11.282007 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 902/1806] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:01:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 22:01:11.293416 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c28fc1a-4706-4013-86f0-ca50b93aa34e None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:11.298688 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15709610-9dd4-4906-be2c-d7d739d4ee0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:11.299545 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15709610-9dd4-4906-be2c-d7d739d4ee0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:11.299829 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15709610-9dd4-4906-be2c-d7d739d4ee0f admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:11.300109 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15709610-9dd4-4906-be2c-d7d739d4ee0f admin admin] PATH_INFO: `/v3/projects/03ea7757e6ce45e78dc4d17b69ca7f53` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:11.301286 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15709610-9dd4-4906-be2c-d7d739d4ee0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=03ea7757e6ce45e78dc4d17b69ca7f53)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:11.303239 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15709610-9dd4-4906-be2c-d7d739d4ee0f admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:11.441771 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-15709610-9dd4-4906-be2c-d7d739d4ee0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03ea7757e6ce45e78dc4d17b69ca7f53', 'request_id': 'req-15709610-9dd4-4906-be2c-d7d739d4ee0f'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:11.449056 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-15709610-9dd4-4906-be2c-d7d739d4ee0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03ea7757e6ce45e78dc4d17b69ca7f53', 'request_id': 'req-15709610-9dd4-4906-be2c-d7d739d4ee0f'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:11.543654 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:01:11.563874 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-15709610-9dd4-4906-be2c-d7d739d4ee0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03ea7757e6ce45e78dc4d17b69ca7f53', 'request_id': 'req-15709610-9dd4-4906-be2c-d7d739d4ee0f'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:11.580943 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-15709610-9dd4-4906-be2c-d7d739d4ee0f admin admin] The token cache is being invalidate because project 03ea7757e6ce45e78dc4d17b69ca7f53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88097) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 22:01:11.581474 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-15709610-9dd4-4906-be2c-d7d739d4ee0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:11.582484 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-15709610-9dd4-4906-be2c-d7d739d4ee0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:11.584638 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 905/1807] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 18 22:01:11 2022] DELETE /identity/v3/projects/03ea7757e6ce45e78dc4d17b69ca7f53 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 22:01:11.590097 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20429b4e-623c-41cb-9e9b-4facc4d2c2fd None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:11.590388 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20429b4e-623c-41cb-9e9b-4facc4d2c2fd None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:11.590940 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20429b4e-623c-41cb-9e9b-4facc4d2c2fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:11.617505 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-20429b4e-623c-41cb-9e9b-4facc4d2c2fd None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:01:11.619415 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-20429b4e-623c-41cb-9e9b-4facc4d2c2fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:11.707017 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 903/1808] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:01:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:01:11.714977 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cfeabb-d3ca-427e-9758-69bd1c3c591b None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:11.715655 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cfeabb-d3ca-427e-9758-69bd1c3c591b None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:11.715831 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cfeabb-d3ca-427e-9758-69bd1c3c591b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:11.737621 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-53cfeabb-d3ca-427e-9758-69bd1c3c591b None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:01:11.742281 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-53cfeabb-d3ca-427e-9758-69bd1c3c591b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:11.747600 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 906/1809] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:01:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:01:11.752327 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20429b4e-623c-41cb-9e9b-4facc4d2c2fd None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:11.763158 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20429b4e-623c-41cb-9e9b-4facc4d2c2fd None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:11.769111 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f77d35-51e2-4a69-a061-fbac7ff0c26e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:11.773507 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f77d35-51e2-4a69-a061-fbac7ff0c26e admin admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:11.773507 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f77d35-51e2-4a69-a061-fbac7ff0c26e admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:11.773507 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f77d35-51e2-4a69-a061-fbac7ff0c26e admin admin] PATH_INFO: `/v3/domains` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:11.773507 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f77d35-51e2-4a69-a061-fbac7ff0c26e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 22:01:11.773507 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f77d35-51e2-4a69-a061-fbac7ff0c26e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:11.773507 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f77d35-51e2-4a69-a061-fbac7ff0c26e admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:11.787114 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 904/1810] 10.222.0.27 () {58 vars in 1153 bytes} [Thu Aug 18 22:01:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 22:01:11.791694 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cfeabb-d3ca-427e-9758-69bd1c3c591b None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:11.813411 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cfeabb-d3ca-427e-9758-69bd1c3c591b None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:11.813411 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2b58bb-9dee-475a-a889-5011ebc0dcb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:11.813411 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2b58bb-9dee-475a-a889-5011ebc0dcb1 admin admin] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:11.813411 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2b58bb-9dee-475a-a889-5011ebc0dcb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:11.814114 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2b58bb-9dee-475a-a889-5011ebc0dcb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:11.814114 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2b58bb-9dee-475a-a889-5011ebc0dcb1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:11.814114 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2b58bb-9dee-475a-a889-5011ebc0dcb1 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:11.827571 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:01:11.940472 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 907/1811] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 18 22:01:11 2022] POST /identity/v3/projects => generated 369 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 22:01:11.944715 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f77d35-51e2-4a69-a061-fbac7ff0c26e admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:11.958050 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f77d35-51e2-4a69-a061-fbac7ff0c26e admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:12.032873 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2b58bb-9dee-475a-a889-5011ebc0dcb1 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:12.035311 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-9f2b58bb-9dee-475a-a889-5011ebc0dcb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:12.039778 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366ef557-1777-4a09-ac1c-bad233307802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:12.040427 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366ef557-1777-4a09-ac1c-bad233307802 admin admin] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:12.041871 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366ef557-1777-4a09-ac1c-bad233307802 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:12.042157 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366ef557-1777-4a09-ac1c-bad233307802 admin admin] PATH_INFO: `/v3/users` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:12.042796 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366ef557-1777-4a09-ac1c-bad233307802 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:12.046522 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366ef557-1777-4a09-ac1c-bad233307802 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:12.066446 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2b58bb-9dee-475a-a889-5011ebc0dcb1 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:12.073253 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464a7452-a883-4080-af8a-f4d05b49ce58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:12.073909 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464a7452-a883-4080-af8a-f4d05b49ce58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:12.074244 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464a7452-a883-4080-af8a-f4d05b49ce58 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:12.074877 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464a7452-a883-4080-af8a-f4d05b49ce58 admin admin] PATH_INFO: `/v3/projects/d38b9feb8cb34e2e88b9e6ef548d4536` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:12.077323 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464a7452-a883-4080-af8a-f4d05b49ce58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d38b9feb8cb34e2e88b9e6ef548d4536)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:12.080090 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464a7452-a883-4080-af8a-f4d05b49ce58 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:12.161888 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 905/1812] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 18 22:01:11 2022] POST /identity/v3/users => generated 285 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 22:01:12.168237 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366ef557-1777-4a09-ac1c-bad233307802 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:12.184143 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366ef557-1777-4a09-ac1c-bad233307802 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:12.198526 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7500b85c-8aef-4752-be53-b029576f4584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:12.203475 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7500b85c-8aef-4752-be53-b029576f4584 admin admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:12.203475 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7500b85c-8aef-4752-be53-b029576f4584 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:12.203475 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7500b85c-8aef-4752-be53-b029576f4584 admin admin] PATH_INFO: `/v3/roles` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:12.203475 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7500b85c-8aef-4752-be53-b029576f4584 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:12.203475 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7500b85c-8aef-4752-be53-b029576f4584 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:12.215431 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 906/1813] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:01:12 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:01:12.219441 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7500b85c-8aef-4752-be53-b029576f4584 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:12.232323 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7500b85c-8aef-4752-be53-b029576f4584 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:12.237460 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572d076f-3393-4c4e-a779-8d30a3fce9c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:12.239464 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572d076f-3393-4c4e-a779-8d30a3fce9c1 admin admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:12.239464 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572d076f-3393-4c4e-a779-8d30a3fce9c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:12.239464 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572d076f-3393-4c4e-a779-8d30a3fce9c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:12.246015 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572d076f-3393-4c4e-a779-8d30a3fce9c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:12.246015 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572d076f-3393-4c4e-a779-8d30a3fce9c1 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:12.255875 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 907/1814] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:01:12 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 22:01:12.256965 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572d076f-3393-4c4e-a779-8d30a3fce9c1 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:12.274423 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572d076f-3393-4c4e-a779-8d30a3fce9c1 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:12.288194 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f7f852-0378-4155-9327-b79fb7eae843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:12.288194 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f7f852-0378-4155-9327-b79fb7eae843 admin admin] REQUEST_METHOD: `PUT` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:12.288194 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f7f852-0378-4155-9327-b79fb7eae843 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:12.291424 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f7f852-0378-4155-9327-b79fb7eae843 admin admin] PATH_INFO: `/v3/projects/7436c474c3af45328fcf00b8132986e8/users/31bdf1609f78463fb10fdfe5b3dc3c85/roles/de8f2438056f4af9879423f8a59e0e0b` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:12.316836 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-464a7452-a883-4080-af8a-f4d05b49ce58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd38b9feb8cb34e2e88b9e6ef548d4536', 'request_id': 'req-464a7452-a883-4080-af8a-f4d05b49ce58'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:12.325990 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f7f852-0378-4155-9327-b79fb7eae843 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7436c474c3af45328fcf00b8132986e8, user_id=31bdf1609f78463fb10fdfe5b3dc3c85, role_id=de8f2438056f4af9879423f8a59e0e0b)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:12.331794 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-464a7452-a883-4080-af8a-f4d05b49ce58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd38b9feb8cb34e2e88b9e6ef548d4536', 'request_id': 'req-464a7452-a883-4080-af8a-f4d05b49ce58'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:12.331921 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f7f852-0378-4155-9327-b79fb7eae843 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:12.426420 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-464a7452-a883-4080-af8a-f4d05b49ce58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd38b9feb8cb34e2e88b9e6ef548d4536', 'request_id': 'req-464a7452-a883-4080-af8a-f4d05b49ce58'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:12.440448 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-464a7452-a883-4080-af8a-f4d05b49ce58 admin admin] The token cache is being invalidate because project d38b9feb8cb34e2e88b9e6ef548d4536 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88097) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 22:01:12.440778 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-464a7452-a883-4080-af8a-f4d05b49ce58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:12.441451 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-464a7452-a883-4080-af8a-f4d05b49ce58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:12.449909 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 908/1815] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 18 22:01:12 2022] PUT /identity/v3/projects/7436c474c3af45328fcf00b8132986e8/users/31bdf1609f78463fb10fdfe5b3dc3c85/roles/de8f2438056f4af9879423f8a59e0e0b => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:01:12.450074 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 908/1816] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 18 22:01:12 2022] DELETE /identity/v3/projects/d38b9feb8cb34e2e88b9e6ef548d4536 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 22:01:12.451802 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f7f852-0378-4155-9327-b79fb7eae843 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:12.454505 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-41f7f852-0378-4155-9327-b79fb7eae843 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:12.455441 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e92c13-12a4-4e39-98cd-de68805f44e2 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:12.455958 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e92c13-12a4-4e39-98cd-de68805f44e2 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:12.456644 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e92c13-12a4-4e39-98cd-de68805f44e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:12.489038 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-88e92c13-12a4-4e39-98cd-de68805f44e2 None None] MFA Rules not processed for user `31bdf1609f78463fb10fdfe5b3dc3c85`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:01:12.490502 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-88e92c13-12a4-4e39-98cd-de68805f44e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:12.582655 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f7f852-0378-4155-9327-b79fb7eae843 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:12.584894 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 909/1817] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:01:12 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:01:12.586172 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e92c13-12a4-4e39-98cd-de68805f44e2 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:12.588642 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-88e92c13-12a4-4e39-98cd-de68805f44e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:12.591129 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff149afc-a2a5-40f4-8975-c67ebb5aec11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:12.592266 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff149afc-a2a5-40f4-8975-c67ebb5aec11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:12.592856 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff149afc-a2a5-40f4-8975-c67ebb5aec11 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:12.593417 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff149afc-a2a5-40f4-8975-c67ebb5aec11 admin admin] PATH_INFO: `/v3/users/8736a93606a64f4589f1ad8b8c2b0e40` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:12.595419 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff149afc-a2a5-40f4-8975-c67ebb5aec11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8736a93606a64f4589f1ad8b8c2b0e40)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:12.598703 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff149afc-a2a5-40f4-8975-c67ebb5aec11 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:12.619042 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e92c13-12a4-4e39-98cd-de68805f44e2 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:12.624440 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a44646-519e-4d60-a2c7-79e9a4ae9fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:12.625241 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a44646-519e-4d60-a2c7-79e9a4ae9fe8 admin admin] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:12.625624 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a44646-519e-4d60-a2c7-79e9a4ae9fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:12.626694 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a44646-519e-4d60-a2c7-79e9a4ae9fe8 admin admin] PATH_INFO: `/v3/projects` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:12.627826 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a44646-519e-4d60-a2c7-79e9a4ae9fe8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:12.643561 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a44646-519e-4d60-a2c7-79e9a4ae9fe8 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:12.763948 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 910/1818] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 18 22:01:12 2022] POST /identity/v3/projects => generated 367 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 22:01:12.765712 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a44646-519e-4d60-a2c7-79e9a4ae9fe8 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:12.894111 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a44646-519e-4d60-a2c7-79e9a4ae9fe8 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:12.906033 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4cdb8b-fc99-430d-98a7-b590946632df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:12.906654 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4cdb8b-fc99-430d-98a7-b590946632df admin admin] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:12.906933 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4cdb8b-fc99-430d-98a7-b590946632df admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:12.907261 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4cdb8b-fc99-430d-98a7-b590946632df admin admin] PATH_INFO: `/v3/users` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:12.908470 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4cdb8b-fc99-430d-98a7-b590946632df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:12.915075 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4cdb8b-fc99-430d-98a7-b590946632df admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:12.934058 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-ff149afc-a2a5-40f4-8975-c67ebb5aec11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8736a93606a64f4589f1ad8b8c2b0e40'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:12.942200 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-ff149afc-a2a5-40f4-8975-c67ebb5aec11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8736a93606a64f4589f1ad8b8c2b0e40'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:12.943095 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-ff149afc-a2a5-40f4-8975-c67ebb5aec11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8736a93606a64f4589f1ad8b8c2b0e40'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:12.943871 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-ff149afc-a2a5-40f4-8975-c67ebb5aec11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8736a93606a64f4589f1ad8b8c2b0e40'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:12.957458 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-ff149afc-a2a5-40f4-8975-c67ebb5aec11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8736a93606a64f4589f1ad8b8c2b0e40'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:13.084896 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 909/1819] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 18 22:01:12 2022] DELETE /identity/v3/users/8736a93606a64f4589f1ad8b8c2b0e40 => generated 0 bytes in 635 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:01:13.088420 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 911/1820] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 18 22:01:12 2022] POST /identity/v3/users => generated 290 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 22:01:13.089503 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff149afc-a2a5-40f4-8975-c67ebb5aec11 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:13.091257 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-ff149afc-a2a5-40f4-8975-c67ebb5aec11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:13.174588 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff149afc-a2a5-40f4-8975-c67ebb5aec11 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:13.179321 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57312c9-979b-447c-9c3b-05fd65e98e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:13.179938 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57312c9-979b-447c-9c3b-05fd65e98e8e admin admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:13.180222 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57312c9-979b-447c-9c3b-05fd65e98e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:13.180519 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57312c9-979b-447c-9c3b-05fd65e98e8e admin admin] PATH_INFO: `/v3/roles` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:13.181217 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57312c9-979b-447c-9c3b-05fd65e98e8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:13.182905 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57312c9-979b-447c-9c3b-05fd65e98e8e admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:13.193362 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 910/1821] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:01:13 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 22:01:13.197917 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4cdb8b-fc99-430d-98a7-b590946632df admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:13.208944 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4cdb8b-fc99-430d-98a7-b590946632df admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:13.214375 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dd25d7-c75c-4df4-ab70-b3ba721407a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:13.215068 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dd25d7-c75c-4df4-ab70-b3ba721407a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:13.215376 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dd25d7-c75c-4df4-ab70-b3ba721407a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:13.215697 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dd25d7-c75c-4df4-ab70-b3ba721407a0 admin admin] PATH_INFO: `/v3/projects/0a8f1cce7b864affbffa6420f10244d2/users/f1f4b4b0b7874a72896de0463e3472d4/roles/0833202e2a3d47d1b6b3af57006641b1` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:13.233265 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dd25d7-c75c-4df4-ab70-b3ba721407a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a8f1cce7b864affbffa6420f10244d2, user_id=f1f4b4b0b7874a72896de0463e3472d4, role_id=0833202e2a3d47d1b6b3af57006641b1)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:13.237463 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dd25d7-c75c-4df4-ab70-b3ba721407a0 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:13.357442 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 912/1822] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 18 22:01:13 2022] PUT /identity/v3/projects/0a8f1cce7b864affbffa6420f10244d2/users/f1f4b4b0b7874a72896de0463e3472d4/roles/0833202e2a3d47d1b6b3af57006641b1 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:01:13.361334 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57312c9-979b-447c-9c3b-05fd65e98e8e admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:13.375979 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57312c9-979b-447c-9c3b-05fd65e98e8e admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:13.439381 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649ea52a-2e4e-4f37-8934-947cef768158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:13.439898 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649ea52a-2e4e-4f37-8934-947cef768158 admin admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:13.440177 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649ea52a-2e4e-4f37-8934-947cef768158 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:13.440450 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649ea52a-2e4e-4f37-8934-947cef768158 admin admin] PATH_INFO: `/v3/roles` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:13.441198 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649ea52a-2e4e-4f37-8934-947cef768158 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:13.442786 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649ea52a-2e4e-4f37-8934-947cef768158 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:13.454663 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 911/1823] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:01:13 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:01:13.458748 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dd25d7-c75c-4df4-ab70-b3ba721407a0 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:13.469018 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dd25d7-c75c-4df4-ab70-b3ba721407a0 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:13.476584 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abaef55-6349-48da-b63b-55fd72a125ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:13.477284 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abaef55-6349-48da-b63b-55fd72a125ab admin admin] REQUEST_METHOD: `PUT` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:13.480032 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abaef55-6349-48da-b63b-55fd72a125ab admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:13.480032 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abaef55-6349-48da-b63b-55fd72a125ab admin admin] PATH_INFO: `/v3/projects/0a8f1cce7b864affbffa6420f10244d2/users/f1f4b4b0b7874a72896de0463e3472d4/roles/0833202e2a3d47d1b6b3af57006641b1` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:13.480032 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abaef55-6349-48da-b63b-55fd72a125ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a8f1cce7b864affbffa6420f10244d2, user_id=f1f4b4b0b7874a72896de0463e3472d4, role_id=0833202e2a3d47d1b6b3af57006641b1)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:13.482462 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abaef55-6349-48da-b63b-55fd72a125ab admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:13.496881 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 913/1824] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 18 22:01:13 2022] PUT /identity/v3/projects/0a8f1cce7b864affbffa6420f10244d2/users/f1f4b4b0b7874a72896de0463e3472d4/roles/0833202e2a3d47d1b6b3af57006641b1 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:01:13.507693 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37a44c3-2028-4007-bb04-2463e228d2cc None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:13.508195 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37a44c3-2028-4007-bb04-2463e228d2cc None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:13.508482 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37a44c3-2028-4007-bb04-2463e228d2cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:13.538156 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-b37a44c3-2028-4007-bb04-2463e228d2cc None None] MFA Rules not processed for user `f1f4b4b0b7874a72896de0463e3472d4`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:01:13.539301 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-b37a44c3-2028-4007-bb04-2463e228d2cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:13.598264 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abaef55-6349-48da-b63b-55fd72a125ab admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:13.599957 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-3abaef55-6349-48da-b63b-55fd72a125ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:13.619703 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 912/1825] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:01:13 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:01:13.636397 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37a44c3-2028-4007-bb04-2463e228d2cc None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:13.637873 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-b37a44c3-2028-4007-bb04-2463e228d2cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:13.676521 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abaef55-6349-48da-b63b-55fd72a125ab admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:13.681271 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a321ab-e6be-4647-96c0-f6d782096731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:13.681908 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a321ab-e6be-4647-96c0-f6d782096731 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:13.682189 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a321ab-e6be-4647-96c0-f6d782096731 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:13.682464 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a321ab-e6be-4647-96c0-f6d782096731 admin admin] PATH_INFO: `/v3/projects/7901f1ac46f0431db0c57a9b89bfd132` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:13.683653 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a321ab-e6be-4647-96c0-f6d782096731 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7901f1ac46f0431db0c57a9b89bfd132)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:13.685617 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a321ab-e6be-4647-96c0-f6d782096731 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:13.698906 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37a44c3-2028-4007-bb04-2463e228d2cc None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:13.701391 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeb4779-bfee-4ea2-a9c6-a9b0bbecbf93 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22b6a7c36f8a4795a75271b8079821c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:13.702004 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeb4779-bfee-4ea2-a9c6-a9b0bbecbf93 service cinder] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:13.702424 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeb4779-bfee-4ea2-a9c6-a9b0bbecbf93 service cinder] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:13.702764 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeb4779-bfee-4ea2-a9c6-a9b0bbecbf93 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:13.713515 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eeb4779-bfee-4ea2-a9c6-a9b0bbecbf93 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:13.715104 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eeb4779-bfee-4ea2-a9c6-a9b0bbecbf93 service cinder] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:13.727654 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 913/1826] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:01:13 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 22:01:13.793879 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-b0a321ab-e6be-4647-96c0-f6d782096731 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7901f1ac46f0431db0c57a9b89bfd132', 'request_id': 'req-b0a321ab-e6be-4647-96c0-f6d782096731'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:13.800254 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-b0a321ab-e6be-4647-96c0-f6d782096731 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7901f1ac46f0431db0c57a9b89bfd132', 'request_id': 'req-b0a321ab-e6be-4647-96c0-f6d782096731'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:13.911634 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeb4779-bfee-4ea2-a9c6-a9b0bbecbf93 service cinder] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:13.917074 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-b0a321ab-e6be-4647-96c0-f6d782096731 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7901f1ac46f0431db0c57a9b89bfd132', 'request_id': 'req-b0a321ab-e6be-4647-96c0-f6d782096731'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:13.925651 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeb4779-bfee-4ea2-a9c6-a9b0bbecbf93 service cinder] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:13.933940 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-b0a321ab-e6be-4647-96c0-f6d782096731 admin admin] The token cache is being invalidate because project 7901f1ac46f0431db0c57a9b89bfd132 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88097) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 22:01:13.934212 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-b0a321ab-e6be-4647-96c0-f6d782096731 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:13.934892 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-b0a321ab-e6be-4647-96c0-f6d782096731 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:13.948631 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 914/1827] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 18 22:01:13 2022] DELETE /identity/v3/projects/7901f1ac46f0431db0c57a9b89bfd132 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 22:01:13.954782 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a98487-7f88-412f-b945-6fd0c76e4b4f None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:13.955072 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a98487-7f88-412f-b945-6fd0c76e4b4f None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:13.955347 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a98487-7f88-412f-b945-6fd0c76e4b4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:13.985326 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-58a98487-7f88-412f-b945-6fd0c76e4b4f None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:01:13.987587 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-58a98487-7f88-412f-b945-6fd0c76e4b4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:14.021299 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea74e18-0611-4ff2-acca-3f6fab1c40b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22b6a7c36f8a4795a75271b8079821c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:14.022071 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea74e18-0611-4ff2-acca-3f6fab1c40b9 service cinder] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:14.022231 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea74e18-0611-4ff2-acca-3f6fab1c40b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:14.022801 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea74e18-0611-4ff2-acca-3f6fab1c40b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:14.030847 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-bea74e18-0611-4ff2-acca-3f6fab1c40b9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:14.053227 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:01:14.077302 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 915/1828] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:01:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 22:01:14.085700 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0303f9e1-af0b-466f-8c23-bb410486923c None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:14.086333 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0303f9e1-af0b-466f-8c23-bb410486923c None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:14.086333 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0303f9e1-af0b-466f-8c23-bb410486923c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:14.112684 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-0303f9e1-af0b-466f-8c23-bb410486923c None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:01:14.113967 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-0303f9e1-af0b-466f-8c23-bb410486923c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:14.124187 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 916/1829] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:01:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 22:01:14.129552 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0303f9e1-af0b-466f-8c23-bb410486923c None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:14.140286 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0303f9e1-af0b-466f-8c23-bb410486923c None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:14.146185 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6cc79b-06d8-42ba-adf8-90892243586f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:14.147063 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6cc79b-06d8-42ba-adf8-90892243586f admin admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:14.147782 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6cc79b-06d8-42ba-adf8-90892243586f admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:14.148229 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6cc79b-06d8-42ba-adf8-90892243586f admin admin] PATH_INFO: `/v3/domains` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:14.149186 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6cc79b-06d8-42ba-adf8-90892243586f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 22:01:14.149653 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6cc79b-06d8-42ba-adf8-90892243586f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:14.151451 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6cc79b-06d8-42ba-adf8-90892243586f admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:14.161599 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea74e18-0611-4ff2-acca-3f6fab1c40b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:14.163411 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea74e18-0611-4ff2-acca-3f6fab1c40b9 service cinder] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:14.166878 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 917/1830] 10.222.0.27 () {58 vars in 1153 bytes} [Thu Aug 18 22:01:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 22:01:14.171255 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6cc79b-06d8-42ba-adf8-90892243586f admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:14.177016 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 914/1831] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:01:13 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 22:01:14.185685 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6cc79b-06d8-42ba-adf8-90892243586f admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:14.191235 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2da652e-da75-4e2f-b0e7-424acf618623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:14.192015 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2da652e-da75-4e2f-b0e7-424acf618623 admin admin] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:14.192300 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2da652e-da75-4e2f-b0e7-424acf618623 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:14.192572 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2da652e-da75-4e2f-b0e7-424acf618623 admin admin] PATH_INFO: `/v3/projects` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:14.193510 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2da652e-da75-4e2f-b0e7-424acf618623 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:14.195398 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2da652e-da75-4e2f-b0e7-424acf618623 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:14.323791 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 918/1832] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 18 22:01:14 2022] POST /identity/v3/projects => generated 365 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 22:01:14.328057 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea74e18-0611-4ff2-acca-3f6fab1c40b9 service cinder] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:14.344453 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea74e18-0611-4ff2-acca-3f6fab1c40b9 service cinder] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:14.436727 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3ffe3a-fb10-4820-b705-cc81dcc440c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:14.437916 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3ffe3a-fb10-4820-b705-cc81dcc440c6 admin admin] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:14.438211 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3ffe3a-fb10-4820-b705-cc81dcc440c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:14.438509 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3ffe3a-fb10-4820-b705-cc81dcc440c6 admin admin] PATH_INFO: `/v3/users` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:14.440423 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3ffe3a-fb10-4820-b705-cc81dcc440c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:14.442753 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3ffe3a-fb10-4820-b705-cc81dcc440c6 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:14.544543 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 915/1833] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 18 22:01:14 2022] POST /identity/v3/users => generated 283 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 22:01:14.546507 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2da652e-da75-4e2f-b0e7-424acf618623 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:14.557402 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2da652e-da75-4e2f-b0e7-424acf618623 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:14.562258 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a358ebb9-6fd0-4dc4-a641-0bebf66cf528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:14.562870 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a358ebb9-6fd0-4dc4-a641-0bebf66cf528 admin admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:14.563312 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a358ebb9-6fd0-4dc4-a641-0bebf66cf528 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:14.563624 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a358ebb9-6fd0-4dc4-a641-0bebf66cf528 admin admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:14.564446 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a358ebb9-6fd0-4dc4-a641-0bebf66cf528 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:14.566214 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a358ebb9-6fd0-4dc4-a641-0bebf66cf528 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:14.576420 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 919/1834] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:01:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:01:14.581262 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3ffe3a-fb10-4820-b705-cc81dcc440c6 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:14.591551 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3ffe3a-fb10-4820-b705-cc81dcc440c6 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:14.600104 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea73369d-5d29-4bd4-ab93-6731316a02b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:14.600104 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea73369d-5d29-4bd4-ab93-6731316a02b2 admin admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:14.600104 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea73369d-5d29-4bd4-ab93-6731316a02b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:14.600104 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea73369d-5d29-4bd4-ab93-6731316a02b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:14.600380 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea73369d-5d29-4bd4-ab93-6731316a02b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:14.601113 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea73369d-5d29-4bd4-ab93-6731316a02b2 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:14.616645 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 916/1835] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:01:14 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:01:14.618420 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a358ebb9-6fd0-4dc4-a641-0bebf66cf528 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:14.642246 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a358ebb9-6fd0-4dc4-a641-0bebf66cf528 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:14.647962 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2f74bb-f1d0-4c40-bf95-5033e799ce7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:14.648654 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2f74bb-f1d0-4c40-bf95-5033e799ce7e admin admin] REQUEST_METHOD: `PUT` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:14.648936 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2f74bb-f1d0-4c40-bf95-5033e799ce7e admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:14.649505 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2f74bb-f1d0-4c40-bf95-5033e799ce7e admin admin] PATH_INFO: `/v3/projects/7570a4382e594051b04858725c8b1266/users/3d626c80895a4c159eb341df2d506092/roles/de8f2438056f4af9879423f8a59e0e0b` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:14.664868 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2f74bb-f1d0-4c40-bf95-5033e799ce7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7570a4382e594051b04858725c8b1266, user_id=3d626c80895a4c159eb341df2d506092, role_id=de8f2438056f4af9879423f8a59e0e0b)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:14.667877 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2f74bb-f1d0-4c40-bf95-5033e799ce7e admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:14.798320 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 920/1836] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 18 22:01:14 2022] PUT /identity/v3/projects/7570a4382e594051b04858725c8b1266/users/3d626c80895a4c159eb341df2d506092/roles/de8f2438056f4af9879423f8a59e0e0b => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:01:14.809701 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f372eee3-63cb-4c07-a372-433a0e61db3d None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:14.809928 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f372eee3-63cb-4c07-a372-433a0e61db3d None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:14.810207 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f372eee3-63cb-4c07-a372-433a0e61db3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:14.841136 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-f372eee3-63cb-4c07-a372-433a0e61db3d None None] MFA Rules not processed for user `3d626c80895a4c159eb341df2d506092`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:01:14.842749 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-f372eee3-63cb-4c07-a372-433a0e61db3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:14.911863 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 917/1837] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:01:14 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:01:14.916059 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2f74bb-f1d0-4c40-bf95-5033e799ce7e admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:14.986630 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2f74bb-f1d0-4c40-bf95-5033e799ce7e admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:14.991593 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03832f8a-27fc-4158-be1c-d612c16c9c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:14.992285 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03832f8a-27fc-4158-be1c-d612c16c9c5b admin admin] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:14.992563 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03832f8a-27fc-4158-be1c-d612c16c9c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:14.992866 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03832f8a-27fc-4158-be1c-d612c16c9c5b admin admin] PATH_INFO: `/v3/projects` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:14.993500 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03832f8a-27fc-4158-be1c-d612c16c9c5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:14.995500 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03832f8a-27fc-4158-be1c-d612c16c9c5b admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:15.109319 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 921/1838] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 18 22:01:14 2022] POST /identity/v3/projects => generated 365 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 22:01:15.117973 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f372eee3-63cb-4c07-a372-433a0e61db3d None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:15.124289 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f372eee3-63cb-4c07-a372-433a0e61db3d None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:15.196761 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a988543c-4a08-4f69-9903-ee449dfaf2fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:15.197425 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a988543c-4a08-4f69-9903-ee449dfaf2fd admin admin] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:15.197703 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a988543c-4a08-4f69-9903-ee449dfaf2fd admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:15.198106 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a988543c-4a08-4f69-9903-ee449dfaf2fd admin admin] PATH_INFO: `/v3/users` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:15.198798 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a988543c-4a08-4f69-9903-ee449dfaf2fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:15.200783 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a988543c-4a08-4f69-9903-ee449dfaf2fd admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:15.336050 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 918/1839] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 18 22:01:15 2022] POST /identity/v3/users => generated 289 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 22:01:15.340200 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03832f8a-27fc-4158-be1c-d612c16c9c5b admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:15.352505 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03832f8a-27fc-4158-be1c-d612c16c9c5b admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:15.360275 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b06cb0-323c-4490-a5d7-640f9477006c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:15.360275 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b06cb0-323c-4490-a5d7-640f9477006c admin admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:15.361254 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b06cb0-323c-4490-a5d7-640f9477006c admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:15.361659 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b06cb0-323c-4490-a5d7-640f9477006c admin admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:15.362408 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b06cb0-323c-4490-a5d7-640f9477006c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:15.364143 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b06cb0-323c-4490-a5d7-640f9477006c admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:15.378496 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 922/1840] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:01:15 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:01:15.383338 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a988543c-4a08-4f69-9903-ee449dfaf2fd admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:15.400524 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a988543c-4a08-4f69-9903-ee449dfaf2fd admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:15.409359 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306dd9f6-eea8-4200-8908-ddb95a63d7d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:15.412069 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306dd9f6-eea8-4200-8908-ddb95a63d7d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:15.412069 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306dd9f6-eea8-4200-8908-ddb95a63d7d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:15.412069 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306dd9f6-eea8-4200-8908-ddb95a63d7d1 admin admin] PATH_INFO: `/v3/projects/735b338fa0574d259631bcb0761939c5/users/76ee13d8b81141bea8a4fe405b0b595d/roles/0833202e2a3d47d1b6b3af57006641b1` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:15.434305 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306dd9f6-eea8-4200-8908-ddb95a63d7d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=735b338fa0574d259631bcb0761939c5, user_id=76ee13d8b81141bea8a4fe405b0b595d, role_id=0833202e2a3d47d1b6b3af57006641b1)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:15.437156 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306dd9f6-eea8-4200-8908-ddb95a63d7d1 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:15.540402 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 919/1841] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 18 22:01:15 2022] PUT /identity/v3/projects/735b338fa0574d259631bcb0761939c5/users/76ee13d8b81141bea8a4fe405b0b595d/roles/0833202e2a3d47d1b6b3af57006641b1 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:01:15.544536 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b06cb0-323c-4490-a5d7-640f9477006c admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:15.555070 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b06cb0-323c-4490-a5d7-640f9477006c admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:15.630169 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5866f526-9a14-41e2-8ff2-5d7f860b226d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:15.630892 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5866f526-9a14-41e2-8ff2-5d7f860b226d admin admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:15.631064 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5866f526-9a14-41e2-8ff2-5d7f860b226d admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:15.631339 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5866f526-9a14-41e2-8ff2-5d7f860b226d admin admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:15.631986 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5866f526-9a14-41e2-8ff2-5d7f860b226d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:15.633858 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5866f526-9a14-41e2-8ff2-5d7f860b226d admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:15.650378 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 923/1842] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:01:15 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:01:15.655574 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306dd9f6-eea8-4200-8908-ddb95a63d7d1 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:15.672170 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306dd9f6-eea8-4200-8908-ddb95a63d7d1 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:15.678720 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7de125-d615-46cb-87ef-47679445a9c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:15.679571 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7de125-d615-46cb-87ef-47679445a9c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:15.680161 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7de125-d615-46cb-87ef-47679445a9c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:15.680544 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7de125-d615-46cb-87ef-47679445a9c7 admin admin] PATH_INFO: `/v3/projects/735b338fa0574d259631bcb0761939c5/users/76ee13d8b81141bea8a4fe405b0b595d/roles/0833202e2a3d47d1b6b3af57006641b1` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:15.683289 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7de125-d615-46cb-87ef-47679445a9c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=735b338fa0574d259631bcb0761939c5, user_id=76ee13d8b81141bea8a4fe405b0b595d, role_id=0833202e2a3d47d1b6b3af57006641b1)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:15.686698 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7de125-d615-46cb-87ef-47679445a9c7 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:15.703391 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 920/1843] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 18 22:01:15 2022] PUT /identity/v3/projects/735b338fa0574d259631bcb0761939c5/users/76ee13d8b81141bea8a4fe405b0b595d/roles/0833202e2a3d47d1b6b3af57006641b1 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:01:15.713618 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74911f0-10e6-4be1-8ad4-f322409831a8 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:15.714106 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74911f0-10e6-4be1-8ad4-f322409831a8 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:15.714389 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74911f0-10e6-4be1-8ad4-f322409831a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:15.740312 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:01:15.785247 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-d74911f0-10e6-4be1-8ad4-f322409831a8 None None] MFA Rules not processed for user `76ee13d8b81141bea8a4fe405b0b595d`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:01:15.786664 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-d74911f0-10e6-4be1-8ad4-f322409831a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:15.880363 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 924/1844] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:01:15 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:01:15.895508 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7de125-d615-46cb-87ef-47679445a9c7 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:15.897334 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-8d7de125-d615-46cb-87ef-47679445a9c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:15.978652 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7de125-d615-46cb-87ef-47679445a9c7 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:15.983059 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6da0f05-a997-4071-a190-65f76eeb7d06 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22b6a7c36f8a4795a75271b8079821c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:15.983849 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6da0f05-a997-4071-a190-65f76eeb7d06 service cinder] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:15.984191 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6da0f05-a997-4071-a190-65f76eeb7d06 service cinder] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:15.984483 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6da0f05-a997-4071-a190-65f76eeb7d06 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:15.998650 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6da0f05-a997-4071-a190-65f76eeb7d06 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:16.000641 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6da0f05-a997-4071-a190-65f76eeb7d06 service cinder] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:16.020491 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 921/1845] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:01:15 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:01:16.398186 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74911f0-10e6-4be1-8ad4-f322409831a8 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:16.408872 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74911f0-10e6-4be1-8ad4-f322409831a8 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:16.413080 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9414ae81-b423-4d6b-a049-2eed6853a2f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22b6a7c36f8a4795a75271b8079821c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:16.413726 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9414ae81-b423-4d6b-a049-2eed6853a2f2 service cinder] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:16.414006 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9414ae81-b423-4d6b-a049-2eed6853a2f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:16.414280 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9414ae81-b423-4d6b-a049-2eed6853a2f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:16.479633 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9414ae81-b423-4d6b-a049-2eed6853a2f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:16.481153 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9414ae81-b423-4d6b-a049-2eed6853a2f2 service cinder] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:16.491878 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 925/1846] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:01:16 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 22:01:16.738548 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:01:18.941461 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6da0f05-a997-4071-a190-65f76eeb7d06 service cinder] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:18.942963 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-c6da0f05-a997-4071-a190-65f76eeb7d06 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:19.010711 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6da0f05-a997-4071-a190-65f76eeb7d06 service cinder] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:19.015504 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab8ce60-529d-4b2a-9c3d-46c506b33535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:19.016330 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab8ce60-529d-4b2a-9c3d-46c506b33535 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:19.016669 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab8ce60-529d-4b2a-9c3d-46c506b33535 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:19.017089 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab8ce60-529d-4b2a-9c3d-46c506b33535 admin admin] PATH_INFO: `/v3/users/df77e8be35c042499dd0f08342f83d9a` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:19.018475 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab8ce60-529d-4b2a-9c3d-46c506b33535 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df77e8be35c042499dd0f08342f83d9a)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:19.020396 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab8ce60-529d-4b2a-9c3d-46c506b33535 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:19.060321 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:01:19.321699 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-5ab8ce60-529d-4b2a-9c3d-46c506b33535 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df77e8be35c042499dd0f08342f83d9a'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:19.332087 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-5ab8ce60-529d-4b2a-9c3d-46c506b33535 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df77e8be35c042499dd0f08342f83d9a'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:19.332939 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-5ab8ce60-529d-4b2a-9c3d-46c506b33535 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df77e8be35c042499dd0f08342f83d9a'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:19.336249 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-5ab8ce60-529d-4b2a-9c3d-46c506b33535 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df77e8be35c042499dd0f08342f83d9a'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:19.347828 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-5ab8ce60-529d-4b2a-9c3d-46c506b33535 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df77e8be35c042499dd0f08342f83d9a'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:19.449122 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 922/1847] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 18 22:01:18 2022] DELETE /identity/v3/users/df77e8be35c042499dd0f08342f83d9a => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:01:19.450589 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4630c8a5-4a08-447c-8f31-a6d15c015008 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:19.451069 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4630c8a5-4a08-447c-8f31-a6d15c015008 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:19.451311 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4630c8a5-4a08-447c-8f31-a6d15c015008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:19.471441 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-4630c8a5-4a08-447c-8f31-a6d15c015008 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:01:19.472724 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-4630c8a5-4a08-447c-8f31-a6d15c015008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:19.533742 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 926/1848] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:01:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:01:19.545058 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab8ce60-529d-4b2a-9c3d-46c506b33535 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:19.546946 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-5ab8ce60-529d-4b2a-9c3d-46c506b33535 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:19.632256 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab8ce60-529d-4b2a-9c3d-46c506b33535 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:19.644815 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210a7bad-3651-4aab-9dc1-33d931911252 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a937971ad1a4b0c8697c764f214d446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:19.646752 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210a7bad-3651-4aab-9dc1-33d931911252 service neutron] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:19.648286 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210a7bad-3651-4aab-9dc1-33d931911252 service neutron] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:19.649177 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210a7bad-3651-4aab-9dc1-33d931911252 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:19.663580 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210a7bad-3651-4aab-9dc1-33d931911252 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:19.665308 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210a7bad-3651-4aab-9dc1-33d931911252 service neutron] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:19.683523 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 923/1849] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:01:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 22:01:19.964238 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:01:20.369213 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4630c8a5-4a08-447c-8f31-a6d15c015008 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:20.371515 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-4630c8a5-4a08-447c-8f31-a6d15c015008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:20.392820 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4630c8a5-4a08-447c-8f31-a6d15c015008 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:20.402596 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aafab0-bb43-4673-8600-cef973312ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:20.403521 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aafab0-bb43-4673-8600-cef973312ae2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:20.404311 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aafab0-bb43-4673-8600-cef973312ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:20.404912 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aafab0-bb43-4673-8600-cef973312ae2 admin admin] PATH_INFO: `/v3/projects/fee7c1078fe347ffa46580784fd18007` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:20.406327 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5aafab0-bb43-4673-8600-cef973312ae2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fee7c1078fe347ffa46580784fd18007)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:20.409501 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5aafab0-bb43-4673-8600-cef973312ae2 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:20.598630 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-e5aafab0-bb43-4673-8600-cef973312ae2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fee7c1078fe347ffa46580784fd18007', 'request_id': 'req-e5aafab0-bb43-4673-8600-cef973312ae2'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:20.604169 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-e5aafab0-bb43-4673-8600-cef973312ae2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fee7c1078fe347ffa46580784fd18007', 'request_id': 'req-e5aafab0-bb43-4673-8600-cef973312ae2'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:20.693719 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-e5aafab0-bb43-4673-8600-cef973312ae2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fee7c1078fe347ffa46580784fd18007', 'request_id': 'req-e5aafab0-bb43-4673-8600-cef973312ae2'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:20.724955 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-e5aafab0-bb43-4673-8600-cef973312ae2 admin admin] The token cache is being invalidate because project fee7c1078fe347ffa46580784fd18007 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88097) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 22:01:20.731150 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-e5aafab0-bb43-4673-8600-cef973312ae2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:20.731150 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-e5aafab0-bb43-4673-8600-cef973312ae2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:20.735189 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 927/1850] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 18 22:01:20 2022] DELETE /identity/v3/projects/fee7c1078fe347ffa46580784fd18007 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:01:20.735885 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210a7bad-3651-4aab-9dc1-33d931911252 service neutron] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:20.750065 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210a7bad-3651-4aab-9dc1-33d931911252 service neutron] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:20.827213 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c909e24a-e919-48fe-8b6f-cbe668e79f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:20.828042 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c909e24a-e919-48fe-8b6f-cbe668e79f93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:20.828461 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c909e24a-e919-48fe-8b6f-cbe668e79f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:20.829071 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c909e24a-e919-48fe-8b6f-cbe668e79f93 admin admin] PATH_INFO: `/v3/users/665483b9c7fb40a392ea821acd62f8c1` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:20.831232 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c909e24a-e919-48fe-8b6f-cbe668e79f93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=665483b9c7fb40a392ea821acd62f8c1)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:20.836921 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c909e24a-e919-48fe-8b6f-cbe668e79f93 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:21.057821 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-c909e24a-e919-48fe-8b6f-cbe668e79f93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '665483b9c7fb40a392ea821acd62f8c1'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:21.072006 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-c909e24a-e919-48fe-8b6f-cbe668e79f93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '665483b9c7fb40a392ea821acd62f8c1'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:21.074828 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-c909e24a-e919-48fe-8b6f-cbe668e79f93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '665483b9c7fb40a392ea821acd62f8c1'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:21.077206 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-c909e24a-e919-48fe-8b6f-cbe668e79f93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '665483b9c7fb40a392ea821acd62f8c1'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:21.126498 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-c909e24a-e919-48fe-8b6f-cbe668e79f93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '665483b9c7fb40a392ea821acd62f8c1'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:21.209174 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aafab0-bb43-4673-8600-cef973312ae2 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:21.214022 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-e5aafab0-bb43-4673-8600-cef973312ae2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:21.243124 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aafab0-bb43-4673-8600-cef973312ae2 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:21.255446 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d845ab-2c64-4341-b2a6-1e2ec86c01b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:21.256116 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d845ab-2c64-4341-b2a6-1e2ec86c01b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:21.256379 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d845ab-2c64-4341-b2a6-1e2ec86c01b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:21.256683 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d845ab-2c64-4341-b2a6-1e2ec86c01b0 admin admin] PATH_INFO: `/v3/users/05047bc5b66b4729b5b8209761fb9f79` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:21.259588 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d845ab-2c64-4341-b2a6-1e2ec86c01b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05047bc5b66b4729b5b8209761fb9f79)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:21.265820 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d845ab-2c64-4341-b2a6-1e2ec86c01b0 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:21.272525 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 924/1851] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 18 22:01:20 2022] DELETE /identity/v3/users/665483b9c7fb40a392ea821acd62f8c1 => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:01:21.564484 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-27d845ab-2c64-4341-b2a6-1e2ec86c01b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05047bc5b66b4729b5b8209761fb9f79'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:21.575787 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-27d845ab-2c64-4341-b2a6-1e2ec86c01b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05047bc5b66b4729b5b8209761fb9f79'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:21.577107 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-27d845ab-2c64-4341-b2a6-1e2ec86c01b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05047bc5b66b4729b5b8209761fb9f79'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:21.605031 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-27d845ab-2c64-4341-b2a6-1e2ec86c01b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05047bc5b66b4729b5b8209761fb9f79'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:21.701788 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c909e24a-e919-48fe-8b6f-cbe668e79f93 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:21.705071 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-c909e24a-e919-48fe-8b6f-cbe668e79f93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:21.707351 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-27d845ab-2c64-4341-b2a6-1e2ec86c01b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05047bc5b66b4729b5b8209761fb9f79'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:21.714851 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 928/1852] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 18 22:01:21 2022] DELETE /identity/v3/users/05047bc5b66b4729b5b8209761fb9f79 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:01:21.719557 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792adae3-4d5c-495f-ac57-b0e369948b1c None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:21.720861 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792adae3-4d5c-495f-ac57-b0e369948b1c None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:21.721479 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792adae3-4d5c-495f-ac57-b0e369948b1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:21.764717 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-792adae3-4d5c-495f-ac57-b0e369948b1c None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:01:21.769006 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-792adae3-4d5c-495f-ac57-b0e369948b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:21.794938 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c909e24a-e919-48fe-8b6f-cbe668e79f93 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:21.860066 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258752fc-a4e8-4112-a6dc-cfc6cf9bcdd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:21.861699 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258752fc-a4e8-4112-a6dc-cfc6cf9bcdd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:21.862198 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258752fc-a4e8-4112-a6dc-cfc6cf9bcdd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:21.862656 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258752fc-a4e8-4112-a6dc-cfc6cf9bcdd4 admin admin] PATH_INFO: `/v3/users/31bdf1609f78463fb10fdfe5b3dc3c85` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:21.864059 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258752fc-a4e8-4112-a6dc-cfc6cf9bcdd4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=31bdf1609f78463fb10fdfe5b3dc3c85)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:21.866268 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258752fc-a4e8-4112-a6dc-cfc6cf9bcdd4 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:21.908163 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 929/1853] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:01:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 22:01:21.918225 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792adae3-4d5c-495f-ac57-b0e369948b1c None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:21.920039 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-792adae3-4d5c-495f-ac57-b0e369948b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:21.996560 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792adae3-4d5c-495f-ac57-b0e369948b1c None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:22.000819 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa128ea4-8175-4a12-9c43-16bc9071d230 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a937971ad1a4b0c8697c764f214d446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:22.002088 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa128ea4-8175-4a12-9c43-16bc9071d230 service neutron] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:22.002475 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa128ea4-8175-4a12-9c43-16bc9071d230 service neutron] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:22.002856 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa128ea4-8175-4a12-9c43-16bc9071d230 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:22.013317 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa128ea4-8175-4a12-9c43-16bc9071d230 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:22.014993 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa128ea4-8175-4a12-9c43-16bc9071d230 service neutron] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:22.028967 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 930/1854] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:01:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 22:01:22.103361 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:01:22.120497 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-258752fc-a4e8-4112-a6dc-cfc6cf9bcdd4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31bdf1609f78463fb10fdfe5b3dc3c85'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:22.146366 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-258752fc-a4e8-4112-a6dc-cfc6cf9bcdd4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31bdf1609f78463fb10fdfe5b3dc3c85'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:22.147193 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-258752fc-a4e8-4112-a6dc-cfc6cf9bcdd4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31bdf1609f78463fb10fdfe5b3dc3c85'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:22.148080 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-258752fc-a4e8-4112-a6dc-cfc6cf9bcdd4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31bdf1609f78463fb10fdfe5b3dc3c85'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:22.165988 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-258752fc-a4e8-4112-a6dc-cfc6cf9bcdd4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31bdf1609f78463fb10fdfe5b3dc3c85'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:22.248293 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 925/1855] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 18 22:01:21 2022] DELETE /identity/v3/users/31bdf1609f78463fb10fdfe5b3dc3c85 => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:01:22.253850 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2b8b10-2b15-4142-9cd1-408711dea0c8 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:22.254210 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2b8b10-2b15-4142-9cd1-408711dea0c8 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:22.254563 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2b8b10-2b15-4142-9cd1-408711dea0c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:22.294771 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-8a2b8b10-2b15-4142-9cd1-408711dea0c8 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:01:22.296471 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-8a2b8b10-2b15-4142-9cd1-408711dea0c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:22.364314 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 931/1856] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:01:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 22:01:22.374540 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258752fc-a4e8-4112-a6dc-cfc6cf9bcdd4 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:22.375964 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-258752fc-a4e8-4112-a6dc-cfc6cf9bcdd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:22.378232 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2b8b10-2b15-4142-9cd1-408711dea0c8 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:22.380527 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-8a2b8b10-2b15-4142-9cd1-408711dea0c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:22.394558 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2b8b10-2b15-4142-9cd1-408711dea0c8 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:22.400130 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c014c2-138a-4a22-89fb-f9f2d130b740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:22.400925 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c014c2-138a-4a22-89fb-f9f2d130b740 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:22.401310 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c014c2-138a-4a22-89fb-f9f2d130b740 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:22.401690 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c014c2-138a-4a22-89fb-f9f2d130b740 admin admin] PATH_INFO: `/v3/projects/702f236c25fc408aa7ff03fe52797b8d` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:22.403069 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c014c2-138a-4a22-89fb-f9f2d130b740 admin admin] RBAC: Authorizing `identity:delete_project(project_id=702f236c25fc408aa7ff03fe52797b8d)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:22.405179 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c014c2-138a-4a22-89fb-f9f2d130b740 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:22.458742 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258752fc-a4e8-4112-a6dc-cfc6cf9bcdd4 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:22.462527 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4770f2e5-1bb0-4cda-ac0e-f974d4dc7e59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a937971ad1a4b0c8697c764f214d446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:22.463243 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4770f2e5-1bb0-4cda-ac0e-f974d4dc7e59 service neutron] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:22.463643 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4770f2e5-1bb0-4cda-ac0e-f974d4dc7e59 service neutron] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:22.463827 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4770f2e5-1bb0-4cda-ac0e-f974d4dc7e59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:22.476564 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4770f2e5-1bb0-4cda-ac0e-f974d4dc7e59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:22.478237 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4770f2e5-1bb0-4cda-ac0e-f974d4dc7e59 service neutron] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:22.490979 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 926/1857] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:01:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 22:01:22.524142 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-50c014c2-138a-4a22-89fb-f9f2d130b740 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '702f236c25fc408aa7ff03fe52797b8d', 'request_id': 'req-50c014c2-138a-4a22-89fb-f9f2d130b740'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:22.531680 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-50c014c2-138a-4a22-89fb-f9f2d130b740 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '702f236c25fc408aa7ff03fe52797b8d', 'request_id': 'req-50c014c2-138a-4a22-89fb-f9f2d130b740'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:22.615158 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-50c014c2-138a-4a22-89fb-f9f2d130b740 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '702f236c25fc408aa7ff03fe52797b8d', 'request_id': 'req-50c014c2-138a-4a22-89fb-f9f2d130b740'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:22.630896 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-50c014c2-138a-4a22-89fb-f9f2d130b740 admin admin] The token cache is being invalidate because project 702f236c25fc408aa7ff03fe52797b8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88097) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 22:01:22.632314 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-50c014c2-138a-4a22-89fb-f9f2d130b740 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:22.633262 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-50c014c2-138a-4a22-89fb-f9f2d130b740 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:22.636444 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 932/1858] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 18 22:01:22 2022] DELETE /identity/v3/projects/702f236c25fc408aa7ff03fe52797b8d => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:01:22.642079 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fca8e5-83cc-44fe-a2d5-91688203332d None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:22.643118 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fca8e5-83cc-44fe-a2d5-91688203332d None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:22.643455 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fca8e5-83cc-44fe-a2d5-91688203332d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:22.681795 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-52fca8e5-83cc-44fe-a2d5-91688203332d None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:01:22.685785 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-52fca8e5-83cc-44fe-a2d5-91688203332d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:22.707283 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:01:22.789002 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 927/1859] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:01:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:01:22.791842 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b976cc-4620-40bc-aeb5-2b212c843884 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:22.794445 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b976cc-4620-40bc-aeb5-2b212c843884 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:22.794445 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b976cc-4620-40bc-aeb5-2b212c843884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:22.817160 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-45b976cc-4620-40bc-aeb5-2b212c843884 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:01:22.818731 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-45b976cc-4620-40bc-aeb5-2b212c843884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:22.830789 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 933/1860] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:01:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:01:22.835362 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fca8e5-83cc-44fe-a2d5-91688203332d None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:22.848407 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fca8e5-83cc-44fe-a2d5-91688203332d None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:22.854596 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39cac39-a892-4bae-8809-2fdb54756914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:22.855418 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39cac39-a892-4bae-8809-2fdb54756914 admin admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:22.855761 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39cac39-a892-4bae-8809-2fdb54756914 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:22.856044 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39cac39-a892-4bae-8809-2fdb54756914 admin admin] PATH_INFO: `/v3/domains` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:22.857035 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39cac39-a892-4bae-8809-2fdb54756914 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 22:01:22.857505 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39cac39-a892-4bae-8809-2fdb54756914 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:22.859182 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39cac39-a892-4bae-8809-2fdb54756914 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:22.871944 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 928/1861] 10.222.0.27 () {58 vars in 1153 bytes} [Thu Aug 18 22:01:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 22:01:22.876641 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b976cc-4620-40bc-aeb5-2b212c843884 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:22.888288 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b976cc-4620-40bc-aeb5-2b212c843884 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:22.895114 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ef7876-ffe8-48ac-9131-ecfe37774ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:22.895734 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ef7876-ffe8-48ac-9131-ecfe37774ed0 admin admin] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:22.896014 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ef7876-ffe8-48ac-9131-ecfe37774ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:22.896335 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ef7876-ffe8-48ac-9131-ecfe37774ed0 admin admin] PATH_INFO: `/v3/projects` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:22.897011 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ef7876-ffe8-48ac-9131-ecfe37774ed0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:22.899384 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ef7876-ffe8-48ac-9131-ecfe37774ed0 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:22.916084 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39cac39-a892-4bae-8809-2fdb54756914 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:22.918608 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-a39cac39-a892-4bae-8809-2fdb54756914 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:22.949333 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39cac39-a892-4bae-8809-2fdb54756914 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:22.955798 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c9e57d-28f2-46a6-9d85-d96f620c40e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:22.956514 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c9e57d-28f2-46a6-9d85-d96f620c40e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:22.956831 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c9e57d-28f2-46a6-9d85-d96f620c40e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:22.957092 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c9e57d-28f2-46a6-9d85-d96f620c40e3 admin admin] PATH_INFO: `/v3/projects/1dc0ea71341c45aeb64dae4a3a9d4339` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:22.958250 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c9e57d-28f2-46a6-9d85-d96f620c40e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1dc0ea71341c45aeb64dae4a3a9d4339)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:22.960230 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c9e57d-28f2-46a6-9d85-d96f620c40e3 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:23.059035 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 934/1862] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 18 22:01:22 2022] POST /identity/v3/projects => generated 387 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 22:01:23.060216 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ef7876-ffe8-48ac-9131-ecfe37774ed0 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:23.068362 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-f7ef7876-ffe8-48ac-9131-ecfe37774ed0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:23.098153 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-53c9e57d-28f2-46a6-9d85-d96f620c40e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1dc0ea71341c45aeb64dae4a3a9d4339', 'request_id': 'req-53c9e57d-28f2-46a6-9d85-d96f620c40e3'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:23.104864 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-53c9e57d-28f2-46a6-9d85-d96f620c40e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1dc0ea71341c45aeb64dae4a3a9d4339', 'request_id': 'req-53c9e57d-28f2-46a6-9d85-d96f620c40e3'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:23.143528 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ef7876-ffe8-48ac-9131-ecfe37774ed0 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:23.152817 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-53c9e57d-28f2-46a6-9d85-d96f620c40e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1dc0ea71341c45aeb64dae4a3a9d4339', 'request_id': 'req-53c9e57d-28f2-46a6-9d85-d96f620c40e3'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:23.180202 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-53c9e57d-28f2-46a6-9d85-d96f620c40e3 admin admin] The token cache is being invalidate because project 1dc0ea71341c45aeb64dae4a3a9d4339 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88096) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 22:01:23.181150 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-53c9e57d-28f2-46a6-9d85-d96f620c40e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:23.182296 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-53c9e57d-28f2-46a6-9d85-d96f620c40e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:23.191368 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 929/1863] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 18 22:01:22 2022] DELETE /identity/v3/projects/1dc0ea71341c45aeb64dae4a3a9d4339 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:01:23.191368 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c9e57d-28f2-46a6-9d85-d96f620c40e3 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:23.191757 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-53c9e57d-28f2-46a6-9d85-d96f620c40e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:23.220850 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aba2737-d0f3-489b-9b1a-836f95c03884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:23.221544 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aba2737-d0f3-489b-9b1a-836f95c03884 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:23.221828 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aba2737-d0f3-489b-9b1a-836f95c03884 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:23.222148 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aba2737-d0f3-489b-9b1a-836f95c03884 admin admin] PATH_INFO: `/v3/projects/7436c474c3af45328fcf00b8132986e8` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:23.223307 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aba2737-d0f3-489b-9b1a-836f95c03884 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7436c474c3af45328fcf00b8132986e8)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:23.225864 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aba2737-d0f3-489b-9b1a-836f95c03884 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:23.278495 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c9e57d-28f2-46a6-9d85-d96f620c40e3 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:23.284764 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efbd883-fcb1-4578-b3c5-2257f5ae5f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:23.285652 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efbd883-fcb1-4578-b3c5-2257f5ae5f55 admin admin] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:23.285929 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efbd883-fcb1-4578-b3c5-2257f5ae5f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:23.286449 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efbd883-fcb1-4578-b3c5-2257f5ae5f55 admin admin] PATH_INFO: `/v3/users` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:23.289041 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efbd883-fcb1-4578-b3c5-2257f5ae5f55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:23.291808 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efbd883-fcb1-4578-b3c5-2257f5ae5f55 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:23.363219 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-4aba2737-d0f3-489b-9b1a-836f95c03884 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7436c474c3af45328fcf00b8132986e8', 'request_id': 'req-4aba2737-d0f3-489b-9b1a-836f95c03884'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:23.377027 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-4aba2737-d0f3-489b-9b1a-836f95c03884 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7436c474c3af45328fcf00b8132986e8', 'request_id': 'req-4aba2737-d0f3-489b-9b1a-836f95c03884'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:23.377395 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 930/1864] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 18 22:01:23 2022] POST /identity/v3/users => generated 294 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 22:01:23.378674 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efbd883-fcb1-4578-b3c5-2257f5ae5f55 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:23.380553 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-0efbd883-fcb1-4578-b3c5-2257f5ae5f55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:23.395986 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efbd883-fcb1-4578-b3c5-2257f5ae5f55 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:23.458568 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdefa634-8426-4496-be24-c8509f0d4d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:23.459219 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdefa634-8426-4496-be24-c8509f0d4d10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:23.459496 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdefa634-8426-4496-be24-c8509f0d4d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:23.473560 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdefa634-8426-4496-be24-c8509f0d4d10 admin admin] PATH_INFO: `/v3/users/9306963922fe440db458d83f9b7c63b3` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:23.473560 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdefa634-8426-4496-be24-c8509f0d4d10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9306963922fe440db458d83f9b7c63b3)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:23.473560 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdefa634-8426-4496-be24-c8509f0d4d10 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:23.491211 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-4aba2737-d0f3-489b-9b1a-836f95c03884 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7436c474c3af45328fcf00b8132986e8', 'request_id': 'req-4aba2737-d0f3-489b-9b1a-836f95c03884'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:23.510331 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-4aba2737-d0f3-489b-9b1a-836f95c03884 admin admin] The token cache is being invalidate because project 7436c474c3af45328fcf00b8132986e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88097) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 22:01:23.510701 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-4aba2737-d0f3-489b-9b1a-836f95c03884 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:23.511352 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-4aba2737-d0f3-489b-9b1a-836f95c03884 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:23.512952 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 935/1865] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 18 22:01:23 2022] DELETE /identity/v3/projects/7436c474c3af45328fcf00b8132986e8 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:01:23.513818 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aba2737-d0f3-489b-9b1a-836f95c03884 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:23.515233 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-4aba2737-d0f3-489b-9b1a-836f95c03884 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:23.530668 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aba2737-d0f3-489b-9b1a-836f95c03884 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:23.537102 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ed4fd3-3ab4-4d51-9271-0b86283b1d74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:23.537723 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ed4fd3-3ab4-4d51-9271-0b86283b1d74 admin admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:23.538119 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ed4fd3-3ab4-4d51-9271-0b86283b1d74 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:23.538367 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ed4fd3-3ab4-4d51-9271-0b86283b1d74 admin admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:23.539005 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ed4fd3-3ab4-4d51-9271-0b86283b1d74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:23.540816 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ed4fd3-3ab4-4d51-9271-0b86283b1d74 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:23.555481 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 936/1866] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:01:23 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:01:23.555481 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ed4fd3-3ab4-4d51-9271-0b86283b1d74 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:23.555481 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-c2ed4fd3-3ab4-4d51-9271-0b86283b1d74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:23.569354 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ed4fd3-3ab4-4d51-9271-0b86283b1d74 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:23.580479 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167433b2-a59a-4809-9565-bb9900af9af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:23.584230 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167433b2-a59a-4809-9565-bb9900af9af3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:23.584230 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167433b2-a59a-4809-9565-bb9900af9af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:23.584230 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167433b2-a59a-4809-9565-bb9900af9af3 admin admin] PATH_INFO: `/v3/users/f1f4b4b0b7874a72896de0463e3472d4` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:23.584230 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167433b2-a59a-4809-9565-bb9900af9af3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1f4b4b0b7874a72896de0463e3472d4)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:23.587067 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167433b2-a59a-4809-9565-bb9900af9af3 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:23.728339 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-bdefa634-8426-4496-be24-c8509f0d4d10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9306963922fe440db458d83f9b7c63b3'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:23.737488 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-bdefa634-8426-4496-be24-c8509f0d4d10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9306963922fe440db458d83f9b7c63b3'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:23.738227 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-bdefa634-8426-4496-be24-c8509f0d4d10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9306963922fe440db458d83f9b7c63b3'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:23.738841 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-bdefa634-8426-4496-be24-c8509f0d4d10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9306963922fe440db458d83f9b7c63b3'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:23.752185 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-bdefa634-8426-4496-be24-c8509f0d4d10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9306963922fe440db458d83f9b7c63b3'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:23.834688 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-167433b2-a59a-4809-9565-bb9900af9af3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1f4b4b0b7874a72896de0463e3472d4'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:23.848575 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 931/1867] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 18 22:01:23 2022] DELETE /identity/v3/users/9306963922fe440db458d83f9b7c63b3 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:01:23.850743 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdefa634-8426-4496-be24-c8509f0d4d10 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:23.852723 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-bdefa634-8426-4496-be24-c8509f0d4d10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:23.869800 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-167433b2-a59a-4809-9565-bb9900af9af3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1f4b4b0b7874a72896de0463e3472d4'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:23.872368 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-167433b2-a59a-4809-9565-bb9900af9af3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1f4b4b0b7874a72896de0463e3472d4'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:23.918973 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-167433b2-a59a-4809-9565-bb9900af9af3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1f4b4b0b7874a72896de0463e3472d4'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:23.962527 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdefa634-8426-4496-be24-c8509f0d4d10 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:23.968162 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62eaaf0-10fc-4670-a2b4-5a42a813b8ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:23.969189 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62eaaf0-10fc-4670-a2b4-5a42a813b8ad admin admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:23.969747 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62eaaf0-10fc-4670-a2b4-5a42a813b8ad admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:23.971289 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62eaaf0-10fc-4670-a2b4-5a42a813b8ad admin admin] PATH_INFO: `/v3/roles` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:23.972444 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62eaaf0-10fc-4670-a2b4-5a42a813b8ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:23.974427 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62eaaf0-10fc-4670-a2b4-5a42a813b8ad admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:23.988515 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 932/1868] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:01:23 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:01:23.992485 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62eaaf0-10fc-4670-a2b4-5a42a813b8ad admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:24.003995 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62eaaf0-10fc-4670-a2b4-5a42a813b8ad admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:24.011596 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e97121-dc04-45fa-b3bd-a70cd92920ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:24.012266 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e97121-dc04-45fa-b3bd-a70cd92920ed admin admin] REQUEST_METHOD: `PUT` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:24.012574 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e97121-dc04-45fa-b3bd-a70cd92920ed admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:24.014609 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e97121-dc04-45fa-b3bd-a70cd92920ed admin admin] PATH_INFO: `/v3/projects/8ee366625cdd4d85b00c18f23671dd4f/users/64ca3fff459e479fbe4ac02e7aeeefeb/roles/de8f2438056f4af9879423f8a59e0e0b` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:24.028565 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e97121-dc04-45fa-b3bd-a70cd92920ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ee366625cdd4d85b00c18f23671dd4f, user_id=64ca3fff459e479fbe4ac02e7aeeefeb, role_id=de8f2438056f4af9879423f8a59e0e0b)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:24.031352 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e97121-dc04-45fa-b3bd-a70cd92920ed admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:24.044341 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-167433b2-a59a-4809-9565-bb9900af9af3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1f4b4b0b7874a72896de0463e3472d4'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:24.052292 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 937/1869] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 18 22:01:23 2022] DELETE /identity/v3/users/f1f4b4b0b7874a72896de0463e3472d4 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:01:24.151979 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 933/1870] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 18 22:01:23 2022] PUT /identity/v3/projects/8ee366625cdd4d85b00c18f23671dd4f/users/64ca3fff459e479fbe4ac02e7aeeefeb/roles/de8f2438056f4af9879423f8a59e0e0b => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 22:01:24.164911 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eeadc3-c399-4e49-aff0-4f6a609f3d89 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:24.165209 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eeadc3-c399-4e49-aff0-4f6a609f3d89 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:24.165495 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eeadc3-c399-4e49-aff0-4f6a609f3d89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:24.196750 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-f7eeadc3-c399-4e49-aff0-4f6a609f3d89 None None] MFA Rules not processed for user `64ca3fff459e479fbe4ac02e7aeeefeb`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:01:24.198052 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-f7eeadc3-c399-4e49-aff0-4f6a609f3d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:24.276744 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 938/1871] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:01:24 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:01:24.278302 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e97121-dc04-45fa-b3bd-a70cd92920ed admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:24.280026 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-92e97121-dc04-45fa-b3bd-a70cd92920ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:24.347691 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:01:24.360707 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e97121-dc04-45fa-b3bd-a70cd92920ed admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:24.367235 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab42b222-5744-454e-80cc-d143c1786049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:24.367864 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab42b222-5744-454e-80cc-d143c1786049 admin admin] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:24.368623 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab42b222-5744-454e-80cc-d143c1786049 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:24.368954 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab42b222-5744-454e-80cc-d143c1786049 admin admin] PATH_INFO: `/v3/projects` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:24.369615 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab42b222-5744-454e-80cc-d143c1786049 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:24.371741 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab42b222-5744-454e-80cc-d143c1786049 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:24.415250 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eeadc3-c399-4e49-aff0-4f6a609f3d89 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:24.417754 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-f7eeadc3-c399-4e49-aff0-4f6a609f3d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:24.438597 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eeadc3-c399-4e49-aff0-4f6a609f3d89 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:24.444106 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64267410-155d-467f-8f56-62dcc2cb5ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:24.445309 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64267410-155d-467f-8f56-62dcc2cb5ca4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:24.445622 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64267410-155d-467f-8f56-62dcc2cb5ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:24.445852 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64267410-155d-467f-8f56-62dcc2cb5ca4 admin admin] PATH_INFO: `/v3/projects/0a6b1cffdb0d41c5ba62f01d22011238` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:24.450291 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64267410-155d-467f-8f56-62dcc2cb5ca4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a6b1cffdb0d41c5ba62f01d22011238)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:24.450291 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64267410-155d-467f-8f56-62dcc2cb5ca4 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:24.482896 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 934/1872] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 18 22:01:24 2022] POST /identity/v3/projects => generated 389 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 22:01:24.488624 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab42b222-5744-454e-80cc-d143c1786049 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:24.558517 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:01:24.567880 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab42b222-5744-454e-80cc-d143c1786049 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:24.572972 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cdc083-72e7-42c4-858c-54f963bb4523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:24.573777 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cdc083-72e7-42c4-858c-54f963bb4523 admin admin] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:24.574064 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cdc083-72e7-42c4-858c-54f963bb4523 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:24.574343 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cdc083-72e7-42c4-858c-54f963bb4523 admin admin] PATH_INFO: `/v3/users` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:24.574976 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cdc083-72e7-42c4-858c-54f963bb4523 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:24.576934 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cdc083-72e7-42c4-858c-54f963bb4523 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:24.600972 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-64267410-155d-467f-8f56-62dcc2cb5ca4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a6b1cffdb0d41c5ba62f01d22011238', 'request_id': 'req-64267410-155d-467f-8f56-62dcc2cb5ca4'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:24.606365 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-64267410-155d-467f-8f56-62dcc2cb5ca4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a6b1cffdb0d41c5ba62f01d22011238', 'request_id': 'req-64267410-155d-467f-8f56-62dcc2cb5ca4'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:24.684257 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-64267410-155d-467f-8f56-62dcc2cb5ca4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a6b1cffdb0d41c5ba62f01d22011238', 'request_id': 'req-64267410-155d-467f-8f56-62dcc2cb5ca4'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:24.694603 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 935/1873] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 18 22:01:24 2022] POST /identity/v3/users => generated 301 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 22:01:24.695445 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cdc083-72e7-42c4-858c-54f963bb4523 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:24.697603 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-54cdc083-72e7-42c4-858c-54f963bb4523 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:24.709220 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-64267410-155d-467f-8f56-62dcc2cb5ca4 admin admin] The token cache is being invalidate because project 0a6b1cffdb0d41c5ba62f01d22011238 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88097) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 22:01:24.709515 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-64267410-155d-467f-8f56-62dcc2cb5ca4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:24.710197 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-64267410-155d-467f-8f56-62dcc2cb5ca4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:24.711955 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 939/1874] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 18 22:01:24 2022] DELETE /identity/v3/projects/0a6b1cffdb0d41c5ba62f01d22011238 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 22:01:24.712921 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64267410-155d-467f-8f56-62dcc2cb5ca4 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:24.714206 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-64267410-155d-467f-8f56-62dcc2cb5ca4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:24.715734 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cdc083-72e7-42c4-858c-54f963bb4523 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:24.783074 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e03c6c-4be1-481d-90b3-0b2631f3b2e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:24.784375 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e03c6c-4be1-481d-90b3-0b2631f3b2e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:24.784697 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e03c6c-4be1-481d-90b3-0b2631f3b2e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:24.784980 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e03c6c-4be1-481d-90b3-0b2631f3b2e9 admin admin] PATH_INFO: `/v3/projects/0a8f1cce7b864affbffa6420f10244d2` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:24.786147 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e03c6c-4be1-481d-90b3-0b2631f3b2e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a8f1cce7b864affbffa6420f10244d2)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:24.788233 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e03c6c-4be1-481d-90b3-0b2631f3b2e9 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:24.794213 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64267410-155d-467f-8f56-62dcc2cb5ca4 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:24.799500 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df37dea0-d444-4a29-88bd-fdf9df6543cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:24.800119 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df37dea0-d444-4a29-88bd-fdf9df6543cb admin admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:24.800432 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df37dea0-d444-4a29-88bd-fdf9df6543cb admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:24.800856 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df37dea0-d444-4a29-88bd-fdf9df6543cb admin admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:24.801516 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df37dea0-d444-4a29-88bd-fdf9df6543cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:24.803260 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df37dea0-d444-4a29-88bd-fdf9df6543cb admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:24.817377 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 940/1875] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:01:24 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:01:24.817377 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b769a3b4-4676-4300-ad0a-9ea9584c6bd0 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:24.817377 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b769a3b4-4676-4300-ad0a-9ea9584c6bd0 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:24.817377 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b769a3b4-4676-4300-ad0a-9ea9584c6bd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:24.836706 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-b769a3b4-4676-4300-ad0a-9ea9584c6bd0 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:01:24.837926 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-b769a3b4-4676-4300-ad0a-9ea9584c6bd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:24.846949 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 941/1876] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:01:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:01:24.852722 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b769a3b4-4676-4300-ad0a-9ea9584c6bd0 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:24.858647 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b769a3b4-4676-4300-ad0a-9ea9584c6bd0 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:24.863584 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cb0e26-a656-472f-8bd6-3fe8752354ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:24.864236 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cb0e26-a656-472f-8bd6-3fe8752354ab admin admin] REQUEST_METHOD: `PUT` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:24.864519 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cb0e26-a656-472f-8bd6-3fe8752354ab admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:24.865236 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cb0e26-a656-472f-8bd6-3fe8752354ab admin admin] PATH_INFO: `/v3/projects/e384c988ce9c47ed8df64dbb02b4579e/users/faa3ccceb2bd48709ae01ceed5c48600/roles/0833202e2a3d47d1b6b3af57006641b1` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:24.880760 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cb0e26-a656-472f-8bd6-3fe8752354ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=e384c988ce9c47ed8df64dbb02b4579e, user_id=faa3ccceb2bd48709ae01ceed5c48600, role_id=0833202e2a3d47d1b6b3af57006641b1)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:24.883434 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cb0e26-a656-472f-8bd6-3fe8752354ab admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:24.989408 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 942/1877] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 18 22:01:24 2022] PUT /identity/v3/projects/e384c988ce9c47ed8df64dbb02b4579e/users/faa3ccceb2bd48709ae01ceed5c48600/roles/0833202e2a3d47d1b6b3af57006641b1 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:01:24.991328 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c64063-634d-460e-b6f8-3761816bdb99 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:24.991748 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c64063-634d-460e-b6f8-3761816bdb99 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:24.992174 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c64063-634d-460e-b6f8-3761816bdb99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:25.007282 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-f4e03c6c-4be1-481d-90b3-0b2631f3b2e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a8f1cce7b864affbffa6420f10244d2', 'request_id': 'req-f4e03c6c-4be1-481d-90b3-0b2631f3b2e9'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:25.013634 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-f4e03c6c-4be1-481d-90b3-0b2631f3b2e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a8f1cce7b864affbffa6420f10244d2', 'request_id': 'req-f4e03c6c-4be1-481d-90b3-0b2631f3b2e9'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:25.018696 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-e7c64063-634d-460e-b6f8-3761816bdb99 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:01:25.020834 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-e7c64063-634d-460e-b6f8-3761816bdb99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:25.110275 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 943/1878] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:01:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:01:25.110275 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c64063-634d-460e-b6f8-3761816bdb99 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:25.110492 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-f4e03c6c-4be1-481d-90b3-0b2631f3b2e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a8f1cce7b864affbffa6420f10244d2', 'request_id': 'req-f4e03c6c-4be1-481d-90b3-0b2631f3b2e9'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:25.120838 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c64063-634d-460e-b6f8-3761816bdb99 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:25.123866 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-f4e03c6c-4be1-481d-90b3-0b2631f3b2e9 admin admin] The token cache is being invalidate because project 0a8f1cce7b864affbffa6420f10244d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88096) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 22:01:25.124350 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-f4e03c6c-4be1-481d-90b3-0b2631f3b2e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:25.125177 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-f4e03c6c-4be1-481d-90b3-0b2631f3b2e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:25.126398 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0077320-5024-410e-884c-4b17d237fee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:25.127102 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0077320-5024-410e-884c-4b17d237fee8 admin admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:25.127267 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 936/1879] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 18 22:01:24 2022] DELETE /identity/v3/projects/0a8f1cce7b864affbffa6420f10244d2 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:01:25.127597 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0077320-5024-410e-884c-4b17d237fee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:25.127872 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0077320-5024-410e-884c-4b17d237fee8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:25.128535 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0077320-5024-410e-884c-4b17d237fee8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:25.130184 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0077320-5024-410e-884c-4b17d237fee8 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:25.130572 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e03c6c-4be1-481d-90b3-0b2631f3b2e9 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:25.132174 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-f4e03c6c-4be1-481d-90b3-0b2631f3b2e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:25.141401 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 944/1880] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:01:25 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:01:25.143410 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0077320-5024-410e-884c-4b17d237fee8 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:25.145160 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-a0077320-5024-410e-884c-4b17d237fee8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:25.149210 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e03c6c-4be1-481d-90b3-0b2631f3b2e9 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:25.154474 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caeb818b-a9bd-4881-84ac-08c94c67b299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:25.155208 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeb818b-a9bd-4881-84ac-08c94c67b299 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:25.155491 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeb818b-a9bd-4881-84ac-08c94c67b299 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:25.155791 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeb818b-a9bd-4881-84ac-08c94c67b299 admin admin] PATH_INFO: `/v3/users/3d626c80895a4c159eb341df2d506092` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:25.157004 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caeb818b-a9bd-4881-84ac-08c94c67b299 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d626c80895a4c159eb341df2d506092)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:25.158778 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0077320-5024-410e-884c-4b17d237fee8 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:25.159127 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caeb818b-a9bd-4881-84ac-08c94c67b299 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:25.163834 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477ffa23-6da1-4832-8c3d-ceeec4e34951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:25.164446 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477ffa23-6da1-4832-8c3d-ceeec4e34951 admin admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:25.164767 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477ffa23-6da1-4832-8c3d-ceeec4e34951 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:25.165044 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477ffa23-6da1-4832-8c3d-ceeec4e34951 admin admin] PATH_INFO: `/v3/domains` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:25.165698 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477ffa23-6da1-4832-8c3d-ceeec4e34951 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 22:01:25.166007 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477ffa23-6da1-4832-8c3d-ceeec4e34951 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:25.167631 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477ffa23-6da1-4832-8c3d-ceeec4e34951 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:25.182756 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 945/1881] 10.222.0.27 () {58 vars in 1153 bytes} [Thu Aug 18 22:01:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 22:01:25.184294 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48017ab1-3d17-4757-85e9-dca1a7a14c7f None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:25.184842 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48017ab1-3d17-4757-85e9-dca1a7a14c7f None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:25.185020 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48017ab1-3d17-4757-85e9-dca1a7a14c7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:25.204756 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-48017ab1-3d17-4757-85e9-dca1a7a14c7f None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:01:25.206468 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-48017ab1-3d17-4757-85e9-dca1a7a14c7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:25.215446 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 946/1882] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:01:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:01:25.216197 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48017ab1-3d17-4757-85e9-dca1a7a14c7f None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:25.217427 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-48017ab1-3d17-4757-85e9-dca1a7a14c7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:25.230257 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48017ab1-3d17-4757-85e9-dca1a7a14c7f None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:25.234878 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bc6a80-bc2d-40f2-9301-7d9e45a15990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:25.235560 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bc6a80-bc2d-40f2-9301-7d9e45a15990 admin admin] REQUEST_METHOD: `PUT` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:25.235997 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bc6a80-bc2d-40f2-9301-7d9e45a15990 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:25.236438 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bc6a80-bc2d-40f2-9301-7d9e45a15990 admin admin] PATH_INFO: `/v3/projects/e384c988ce9c47ed8df64dbb02b4579e/users/faa3ccceb2bd48709ae01ceed5c48600/roles/0833202e2a3d47d1b6b3af57006641b1` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:25.238459 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bc6a80-bc2d-40f2-9301-7d9e45a15990 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e384c988ce9c47ed8df64dbb02b4579e, user_id=faa3ccceb2bd48709ae01ceed5c48600, role_id=0833202e2a3d47d1b6b3af57006641b1)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:25.241140 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bc6a80-bc2d-40f2-9301-7d9e45a15990 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:25.251484 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 947/1883] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 18 22:01:25 2022] PUT /identity/v3/projects/e384c988ce9c47ed8df64dbb02b4579e/users/faa3ccceb2bd48709ae01ceed5c48600/roles/0833202e2a3d47d1b6b3af57006641b1 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:01:25.252491 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bc6a80-bc2d-40f2-9301-7d9e45a15990 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:25.314976 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bc6a80-bc2d-40f2-9301-7d9e45a15990 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:25.319626 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d2df0b-5731-43fe-9d6e-f195125b8ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:25.320235 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d2df0b-5731-43fe-9d6e-f195125b8ffb admin admin] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:25.320514 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d2df0b-5731-43fe-9d6e-f195125b8ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:25.320820 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d2df0b-5731-43fe-9d6e-f195125b8ffb admin admin] PATH_INFO: `/v3/projects` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:25.321452 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d2df0b-5731-43fe-9d6e-f195125b8ffb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:25.323384 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d2df0b-5731-43fe-9d6e-f195125b8ffb admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:25.352630 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-caeb818b-a9bd-4881-84ac-08c94c67b299 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d626c80895a4c159eb341df2d506092'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:25.359870 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-caeb818b-a9bd-4881-84ac-08c94c67b299 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d626c80895a4c159eb341df2d506092'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:25.360705 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-caeb818b-a9bd-4881-84ac-08c94c67b299 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d626c80895a4c159eb341df2d506092'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:25.361554 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-caeb818b-a9bd-4881-84ac-08c94c67b299 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d626c80895a4c159eb341df2d506092'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:25.373326 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-caeb818b-a9bd-4881-84ac-08c94c67b299 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d626c80895a4c159eb341df2d506092'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:25.426052 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 948/1884] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 18 22:01:25 2022] POST /identity/v3/projects => generated 379 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 22:01:25.427323 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4326ead0-265b-47ec-9975-15190e089c53 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:25.427612 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4326ead0-265b-47ec-9975-15190e089c53 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:25.427916 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4326ead0-265b-47ec-9975-15190e089c53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:25.448020 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-4326ead0-265b-47ec-9975-15190e089c53 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:01:25.449270 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-4326ead0-265b-47ec-9975-15190e089c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:25.457496 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 937/1885] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 18 22:01:25 2022] DELETE /identity/v3/users/3d626c80895a4c159eb341df2d506092 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:01:25.457648 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2847b898-7288-4bd5-a3c5-aa6788d2d1c1 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:25.457853 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2847b898-7288-4bd5-a3c5-aa6788d2d1c1 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:25.460516 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2847b898-7288-4bd5-a3c5-aa6788d2d1c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:25.487397 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-2847b898-7288-4bd5-a3c5-aa6788d2d1c1 None None] MFA Rules not processed for user `faa3ccceb2bd48709ae01ceed5c48600`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:01:25.488646 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-2847b898-7288-4bd5-a3c5-aa6788d2d1c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:25.513047 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 949/1886] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:01:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:01:25.513935 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4326ead0-265b-47ec-9975-15190e089c53 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:25.515238 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-4326ead0-265b-47ec-9975-15190e089c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:25.528527 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4326ead0-265b-47ec-9975-15190e089c53 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:25.558647 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 938/1887] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:01:25 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:01:25.560019 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4051ca2b-d8e0-4c0b-be46-630f98206f26 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:25.560466 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4051ca2b-d8e0-4c0b-be46-630f98206f26 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:25.561043 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4051ca2b-d8e0-4c0b-be46-630f98206f26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:25.580938 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-4051ca2b-d8e0-4c0b-be46-630f98206f26 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:01:25.582142 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-4051ca2b-d8e0-4c0b-be46-630f98206f26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:25.587516 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18f63d3-459d-4f87-ac5c-f25b20e0328e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:25.588127 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18f63d3-459d-4f87-ac5c-f25b20e0328e admin admin] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:25.588406 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18f63d3-459d-4f87-ac5c-f25b20e0328e admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:25.588710 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18f63d3-459d-4f87-ac5c-f25b20e0328e admin admin] PATH_INFO: `/v3/users` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:25.589360 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18f63d3-459d-4f87-ac5c-f25b20e0328e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:25.591431 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18f63d3-459d-4f87-ac5c-f25b20e0328e admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:25.641453 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 939/1888] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:01:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:01:25.642588 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4051ca2b-d8e0-4c0b-be46-630f98206f26 None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:25.652812 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4051ca2b-d8e0-4c0b-be46-630f98206f26 None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:25.658314 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc9cb43-f06f-4646-8d44-b23d95c0d7a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:25.658921 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc9cb43-f06f-4646-8d44-b23d95c0d7a6 admin admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:25.659249 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc9cb43-f06f-4646-8d44-b23d95c0d7a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:25.659664 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc9cb43-f06f-4646-8d44-b23d95c0d7a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:25.660313 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc9cb43-f06f-4646-8d44-b23d95c0d7a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 22:01:25.660635 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc9cb43-f06f-4646-8d44-b23d95c0d7a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:25.662206 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc9cb43-f06f-4646-8d44-b23d95c0d7a6 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:25.676900 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 940/1889] 10.222.0.27 () {58 vars in 1153 bytes} [Thu Aug 18 22:01:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 22:01:25.676900 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc9cb43-f06f-4646-8d44-b23d95c0d7a6 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:25.678318 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-efc9cb43-f06f-4646-8d44-b23d95c0d7a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:25.689695 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 950/1890] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 18 22:01:25 2022] POST /identity/v3/users => generated 290 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 22:01:25.689695 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18f63d3-459d-4f87-ac5c-f25b20e0328e admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:25.691379 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-c18f63d3-459d-4f87-ac5c-f25b20e0328e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:25.738974 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc9cb43-f06f-4646-8d44-b23d95c0d7a6 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:25.742648 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a57a60-0dd7-4477-b41b-eed848500803 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22b6a7c36f8a4795a75271b8079821c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:25.743255 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a57a60-0dd7-4477-b41b-eed848500803 service cinder] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:25.743535 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a57a60-0dd7-4477-b41b-eed848500803 service cinder] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:25.743808 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a57a60-0dd7-4477-b41b-eed848500803 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:25.748230 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18f63d3-459d-4f87-ac5c-f25b20e0328e admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:25.752985 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1ec00e-b825-4181-b416-491fa6b2918d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a937971ad1a4b0c8697c764f214d446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:25.753630 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1ec00e-b825-4181-b416-491fa6b2918d service neutron] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:25.753912 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1ec00e-b825-4181-b416-491fa6b2918d service neutron] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:25.754004 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a57a60-0dd7-4477-b41b-eed848500803 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:25.754187 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1ec00e-b825-4181-b416-491fa6b2918d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:25.755398 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a57a60-0dd7-4477-b41b-eed848500803 service cinder] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:25.763816 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1ec00e-b825-4181-b416-491fa6b2918d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:25.765138 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 941/1891] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:01:25 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:01:25.765382 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1ec00e-b825-4181-b416-491fa6b2918d service neutron] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:25.765912 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a57a60-0dd7-4477-b41b-eed848500803 service cinder] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:25.779145 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 951/1892] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:01:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:01:25.779230 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a57a60-0dd7-4477-b41b-eed848500803 service cinder] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:25.779332 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1ec00e-b825-4181-b416-491fa6b2918d service neutron] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:25.782953 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addc2b1c-1281-4f97-a60d-35d034087c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:25.783945 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addc2b1c-1281-4f97-a60d-35d034087c84 admin admin] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:25.784358 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addc2b1c-1281-4f97-a60d-35d034087c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:25.784920 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addc2b1c-1281-4f97-a60d-35d034087c84 admin admin] PATH_INFO: `/v3/projects` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:25.785762 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addc2b1c-1281-4f97-a60d-35d034087c84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:25.787858 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addc2b1c-1281-4f97-a60d-35d034087c84 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:25.788998 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1ec00e-b825-4181-b416-491fa6b2918d service neutron] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:25.794456 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268a7c80-fd05-440a-9dcc-990b6087db9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:25.795062 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268a7c80-fd05-440a-9dcc-990b6087db9c admin admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:25.795689 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268a7c80-fd05-440a-9dcc-990b6087db9c admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:25.795969 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268a7c80-fd05-440a-9dcc-990b6087db9c admin admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:25.796647 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268a7c80-fd05-440a-9dcc-990b6087db9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:25.798428 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268a7c80-fd05-440a-9dcc-990b6087db9c admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:25.815636 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 952/1893] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:01:25 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:01:25.819134 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268a7c80-fd05-440a-9dcc-990b6087db9c admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:25.832224 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268a7c80-fd05-440a-9dcc-990b6087db9c admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:25.837479 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b09791d-1773-441b-9cfd-e8d77b22f5f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:25.844729 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b09791d-1773-441b-9cfd-e8d77b22f5f7 admin admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:25.844729 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b09791d-1773-441b-9cfd-e8d77b22f5f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:25.844729 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b09791d-1773-441b-9cfd-e8d77b22f5f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:25.844729 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b09791d-1773-441b-9cfd-e8d77b22f5f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:25.844729 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b09791d-1773-441b-9cfd-e8d77b22f5f7 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:25.856648 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 953/1894] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:01:25 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:01:25.858837 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b09791d-1773-441b-9cfd-e8d77b22f5f7 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:25.870652 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b09791d-1773-441b-9cfd-e8d77b22f5f7 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:25.877443 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf9834c-afe9-4a32-a947-75013727cb84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:25.878133 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf9834c-afe9-4a32-a947-75013727cb84 admin admin] REQUEST_METHOD: `PUT` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:25.878423 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf9834c-afe9-4a32-a947-75013727cb84 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:25.878701 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf9834c-afe9-4a32-a947-75013727cb84 admin admin] PATH_INFO: `/v3/projects/7ffea6220e8b41959a064594eb5e46be/users/71b1bd20bd1a431e988db9511611d699/roles/de8f2438056f4af9879423f8a59e0e0b` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:25.895025 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf9834c-afe9-4a32-a947-75013727cb84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ffea6220e8b41959a064594eb5e46be, user_id=71b1bd20bd1a431e988db9511611d699, role_id=de8f2438056f4af9879423f8a59e0e0b)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:25.897993 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf9834c-afe9-4a32-a947-75013727cb84 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:25.924422 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 942/1895] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 18 22:01:25 2022] POST /identity/v3/projects => generated 379 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 22:01:25.928500 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addc2b1c-1281-4f97-a60d-35d034087c84 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:25.988896 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addc2b1c-1281-4f97-a60d-35d034087c84 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:25.993589 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ccb156-2a02-4abc-9671-3c4b3122e283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:25.994321 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ccb156-2a02-4abc-9671-3c4b3122e283 admin admin] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:25.994512 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ccb156-2a02-4abc-9671-3c4b3122e283 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:25.994789 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ccb156-2a02-4abc-9671-3c4b3122e283 admin admin] PATH_INFO: `/v3/users` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:25.995414 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ccb156-2a02-4abc-9671-3c4b3122e283 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:25.997382 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ccb156-2a02-4abc-9671-3c4b3122e283 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:26.032936 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 954/1896] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 18 22:01:25 2022] PUT /identity/v3/projects/7ffea6220e8b41959a064594eb5e46be/users/71b1bd20bd1a431e988db9511611d699/roles/de8f2438056f4af9879423f8a59e0e0b => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:01:26.036767 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf9834c-afe9-4a32-a947-75013727cb84 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:26.038870 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-caf9834c-afe9-4a32-a947-75013727cb84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:26.100675 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 943/1897] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 18 22:01:25 2022] POST /identity/v3/users => generated 290 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 22:01:26.102887 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a4ca01-0c76-45b6-a79d-e2f952dd048b None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:26.103324 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a4ca01-0c76-45b6-a79d-e2f952dd048b None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:26.103759 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a4ca01-0c76-45b6-a79d-e2f952dd048b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:26.108122 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf9834c-afe9-4a32-a947-75013727cb84 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:26.114026 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c5d634-08ff-466b-8af0-314a12549f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:26.114669 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c5d634-08ff-466b-8af0-314a12549f84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:26.114951 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c5d634-08ff-466b-8af0-314a12549f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:26.115273 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c5d634-08ff-466b-8af0-314a12549f84 admin admin] PATH_INFO: `/v3/users/64ca3fff459e479fbe4ac02e7aeeefeb` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:26.116445 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c5d634-08ff-466b-8af0-314a12549f84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=64ca3fff459e479fbe4ac02e7aeeefeb)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:26.118464 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c5d634-08ff-466b-8af0-314a12549f84 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:26.143177 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-a5a4ca01-0c76-45b6-a79d-e2f952dd048b None None] MFA Rules not processed for user `71b1bd20bd1a431e988db9511611d699`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:01:26.144772 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-a5a4ca01-0c76-45b6-a79d-e2f952dd048b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:26.233347 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 944/1898] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:01:26 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:01:26.233347 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a4ca01-0c76-45b6-a79d-e2f952dd048b None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:26.244392 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a4ca01-0c76-45b6-a79d-e2f952dd048b None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:26.249603 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee733d93-c81f-4751-b470-07a2ab4772f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:26.250234 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee733d93-c81f-4751-b470-07a2ab4772f0 admin admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:26.250512 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee733d93-c81f-4751-b470-07a2ab4772f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:26.250786 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee733d93-c81f-4751-b470-07a2ab4772f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:26.251596 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee733d93-c81f-4751-b470-07a2ab4772f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:26.253274 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee733d93-c81f-4751-b470-07a2ab4772f0 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:26.275164 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 945/1899] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:01:26 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:01:26.275164 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee733d93-c81f-4751-b470-07a2ab4772f0 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:26.285499 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee733d93-c81f-4751-b470-07a2ab4772f0 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:26.293197 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbca51c-5cde-4a53-8194-f3bb7cafb108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:26.293566 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbca51c-5cde-4a53-8194-f3bb7cafb108 admin admin] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:26.293967 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbca51c-5cde-4a53-8194-f3bb7cafb108 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:26.294240 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbca51c-5cde-4a53-8194-f3bb7cafb108 admin admin] PATH_INFO: `/v3/projects` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:26.294874 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbca51c-5cde-4a53-8194-f3bb7cafb108 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:26.296871 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbca51c-5cde-4a53-8194-f3bb7cafb108 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:26.318962 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-13c5d634-08ff-466b-8af0-314a12549f84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64ca3fff459e479fbe4ac02e7aeeefeb'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:26.326798 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-13c5d634-08ff-466b-8af0-314a12549f84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64ca3fff459e479fbe4ac02e7aeeefeb'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:26.328466 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-13c5d634-08ff-466b-8af0-314a12549f84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64ca3fff459e479fbe4ac02e7aeeefeb'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:26.340479 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-13c5d634-08ff-466b-8af0-314a12549f84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64ca3fff459e479fbe4ac02e7aeeefeb'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:26.389351 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 946/1900] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 18 22:01:26 2022] POST /identity/v3/projects => generated 377 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 22:01:26.389351 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbca51c-5cde-4a53-8194-f3bb7cafb108 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:26.443332 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-13c5d634-08ff-466b-8af0-314a12549f84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64ca3fff459e479fbe4ac02e7aeeefeb'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:26.449647 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 955/1901] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 18 22:01:26 2022] DELETE /identity/v3/users/64ca3fff459e479fbe4ac02e7aeeefeb => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:01:26.450184 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbca51c-5cde-4a53-8194-f3bb7cafb108 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:26.450436 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c5d634-08ff-466b-8af0-314a12549f84 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:26.451847 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-13c5d634-08ff-466b-8af0-314a12549f84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:26.506669 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa48516e-db82-4cf1-9e04-5a4ac27aafba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:26.507282 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa48516e-db82-4cf1-9e04-5a4ac27aafba admin admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:26.507628 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa48516e-db82-4cf1-9e04-5a4ac27aafba admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:26.507937 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa48516e-db82-4cf1-9e04-5a4ac27aafba admin admin] PATH_INFO: `/v3/roles` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:26.508583 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa48516e-db82-4cf1-9e04-5a4ac27aafba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:26.510207 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa48516e-db82-4cf1-9e04-5a4ac27aafba admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:26.516864 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c5d634-08ff-466b-8af0-314a12549f84 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:26.520458 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 947/1902] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:01:26 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:01:26.521337 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa48516e-db82-4cf1-9e04-5a4ac27aafba admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:26.524413 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:01:26.525260 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df951a4-5b93-4c78-a15a-883d9d279244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:26.525637 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-aa48516e-db82-4cf1-9e04-5a4ac27aafba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:26.525945 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df951a4-5b93-4c78-a15a-883d9d279244 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:26.526225 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df951a4-5b93-4c78-a15a-883d9d279244 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:26.526498 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df951a4-5b93-4c78-a15a-883d9d279244 admin admin] PATH_INFO: `/v3/projects/7570a4382e594051b04858725c8b1266` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:26.527627 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df951a4-5b93-4c78-a15a-883d9d279244 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7570a4382e594051b04858725c8b1266)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:26.529558 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df951a4-5b93-4c78-a15a-883d9d279244 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:26.538522 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa48516e-db82-4cf1-9e04-5a4ac27aafba admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:26.543282 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7864749c-9327-43f9-88fe-e67d79235c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:26.543877 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7864749c-9327-43f9-88fe-e67d79235c13 admin admin] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:26.544157 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7864749c-9327-43f9-88fe-e67d79235c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:26.544427 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7864749c-9327-43f9-88fe-e67d79235c13 admin admin] PATH_INFO: `/v3/users` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:26.545086 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7864749c-9327-43f9-88fe-e67d79235c13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:26.546974 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7864749c-9327-43f9-88fe-e67d79235c13 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:26.584540 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:01:26.624416 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-2df951a4-5b93-4c78-a15a-883d9d279244 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7570a4382e594051b04858725c8b1266', 'request_id': 'req-2df951a4-5b93-4c78-a15a-883d9d279244'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:26.630300 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-2df951a4-5b93-4c78-a15a-883d9d279244 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7570a4382e594051b04858725c8b1266', 'request_id': 'req-2df951a4-5b93-4c78-a15a-883d9d279244'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:26.642609 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 948/1903] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 18 22:01:26 2022] POST /identity/v3/users => generated 295 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 22:01:26.643969 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30cc163-1257-41b2-ab7a-e4a790380560 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:26.644256 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30cc163-1257-41b2-ab7a-e4a790380560 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:26.644692 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30cc163-1257-41b2-ab7a-e4a790380560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:26.663980 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-a30cc163-1257-41b2-ab7a-e4a790380560 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:01:26.665515 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-a30cc163-1257-41b2-ab7a-e4a790380560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:26.710054 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-2df951a4-5b93-4c78-a15a-883d9d279244 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7570a4382e594051b04858725c8b1266', 'request_id': 'req-2df951a4-5b93-4c78-a15a-883d9d279244'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:26.722391 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-2df951a4-5b93-4c78-a15a-883d9d279244 admin admin] The token cache is being invalidate because project 7570a4382e594051b04858725c8b1266 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88097) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 22:01:26.722681 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-2df951a4-5b93-4c78-a15a-883d9d279244 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:26.723334 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-2df951a4-5b93-4c78-a15a-883d9d279244 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:26.729649 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 949/1904] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:01:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:01:26.729810 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 956/1905] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 18 22:01:26 2022] DELETE /identity/v3/projects/7570a4382e594051b04858725c8b1266 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:01:26.729901 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30cc163-1257-41b2-ab7a-e4a790380560 None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:26.730106 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df951a4-5b93-4c78-a15a-883d9d279244 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:26.731199 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-a30cc163-1257-41b2-ab7a-e4a790380560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:26.731308 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-2df951a4-5b93-4c78-a15a-883d9d279244 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:26.743273 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30cc163-1257-41b2-ab7a-e4a790380560 None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:26.744092 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df951a4-5b93-4c78-a15a-883d9d279244 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:26.748144 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d38b58-99b6-4431-acd3-ce699d7dd8aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:26.748846 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d38b58-99b6-4431-acd3-ce699d7dd8aa admin admin] REQUEST_METHOD: `PUT` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:26.749126 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d38b58-99b6-4431-acd3-ce699d7dd8aa admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:26.749225 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb74c92-a076-45f1-87b8-27c672f6e948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:26.749406 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d38b58-99b6-4431-acd3-ce699d7dd8aa admin admin] PATH_INFO: `/v3/projects/896cd8e7ab354418b97d859effe899a2/users/b806d412507c4582bac5b20053835386/roles/de8f2438056f4af9879423f8a59e0e0b` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:26.749758 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb74c92-a076-45f1-87b8-27c672f6e948 admin admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:26.750040 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb74c92-a076-45f1-87b8-27c672f6e948 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:26.750315 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb74c92-a076-45f1-87b8-27c672f6e948 admin admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:26.751010 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb74c92-a076-45f1-87b8-27c672f6e948 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:26.752949 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb74c92-a076-45f1-87b8-27c672f6e948 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:26.763293 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 957/1906] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:01:26 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:01:26.763920 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb74c92-a076-45f1-87b8-27c672f6e948 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:26.764317 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d38b58-99b6-4431-acd3-ce699d7dd8aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=896cd8e7ab354418b97d859effe899a2, user_id=b806d412507c4582bac5b20053835386, role_id=de8f2438056f4af9879423f8a59e0e0b)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:26.767712 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d38b58-99b6-4431-acd3-ce699d7dd8aa admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:26.767855 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-ccb74c92-a076-45f1-87b8-27c672f6e948 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:26.780945 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb74c92-a076-45f1-87b8-27c672f6e948 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:26.786368 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4cfe84-c5e2-4644-ba30-4c46a06d929c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:26.786979 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4cfe84-c5e2-4644-ba30-4c46a06d929c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:26.787261 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4cfe84-c5e2-4644-ba30-4c46a06d929c admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:26.787533 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4cfe84-c5e2-4644-ba30-4c46a06d929c admin admin] PATH_INFO: `/v3/users/76ee13d8b81141bea8a4fe405b0b595d` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:26.788811 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4cfe84-c5e2-4644-ba30-4c46a06d929c admin admin] RBAC: Authorizing `identity:delete_user(user_id=76ee13d8b81141bea8a4fe405b0b595d)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:26.790724 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4cfe84-c5e2-4644-ba30-4c46a06d929c admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:26.838251 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 950/1907] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 18 22:01:26 2022] PUT /identity/v3/projects/896cd8e7ab354418b97d859effe899a2/users/b806d412507c4582bac5b20053835386/roles/de8f2438056f4af9879423f8a59e0e0b => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:01:26.839104 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d38b58-99b6-4431-acd3-ce699d7dd8aa admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:26.840795 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-57d38b58-99b6-4431-acd3-ce699d7dd8aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:26.902996 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d38b58-99b6-4431-acd3-ce699d7dd8aa admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:26.906650 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b523f9-280c-4d83-96f9-edb36f40f2c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a937971ad1a4b0c8697c764f214d446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:26.908567 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b523f9-280c-4d83-96f9-edb36f40f2c0 service neutron] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:26.908884 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b523f9-280c-4d83-96f9-edb36f40f2c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:26.909159 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b523f9-280c-4d83-96f9-edb36f40f2c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:26.910975 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-99b523f9-280c-4d83-96f9-edb36f40f2c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:26.973099 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b523f9-280c-4d83-96f9-edb36f40f2c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:26.974534 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b523f9-280c-4d83-96f9-edb36f40f2c0 service neutron] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:26.984051 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 951/1908] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:01:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:01:26.984704 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b523f9-280c-4d83-96f9-edb36f40f2c0 service neutron] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:26.992656 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-5f4cfe84-c5e2-4644-ba30-4c46a06d929c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76ee13d8b81141bea8a4fe405b0b595d'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:26.994438 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b523f9-280c-4d83-96f9-edb36f40f2c0 service neutron] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:26.999918 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9295f243-ed70-4202-b7cd-9859fa505050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:27.000584 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9295f243-ed70-4202-b7cd-9859fa505050 admin admin] REQUEST_METHOD: `PUT` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:27.000898 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9295f243-ed70-4202-b7cd-9859fa505050 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:27.001782 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9295f243-ed70-4202-b7cd-9859fa505050 admin admin] PATH_INFO: `/v3/projects/5908df3b9d8945d19483a859a0889367/users/35fc90d71a654879971cb5b90f9a9802/roles/0833202e2a3d47d1b6b3af57006641b1` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:27.002777 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-5f4cfe84-c5e2-4644-ba30-4c46a06d929c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76ee13d8b81141bea8a4fe405b0b595d'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:27.003543 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-5f4cfe84-c5e2-4644-ba30-4c46a06d929c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76ee13d8b81141bea8a4fe405b0b595d'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:27.022108 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9295f243-ed70-4202-b7cd-9859fa505050 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5908df3b9d8945d19483a859a0889367, user_id=35fc90d71a654879971cb5b90f9a9802, role_id=0833202e2a3d47d1b6b3af57006641b1)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:27.022323 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-5f4cfe84-c5e2-4644-ba30-4c46a06d929c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76ee13d8b81141bea8a4fe405b0b595d'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:27.027637 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9295f243-ed70-4202-b7cd-9859fa505050 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:27.098647 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-5f4cfe84-c5e2-4644-ba30-4c46a06d929c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76ee13d8b81141bea8a4fe405b0b595d'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:27.105182 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 958/1909] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 18 22:01:26 2022] DELETE /identity/v3/users/76ee13d8b81141bea8a4fe405b0b595d => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:01:27.106389 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f356fb3b-049f-4048-9cf2-630187fa1618 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:27.107914 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f356fb3b-049f-4048-9cf2-630187fa1618 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:27.107914 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f356fb3b-049f-4048-9cf2-630187fa1618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:27.137371 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-f356fb3b-049f-4048-9cf2-630187fa1618 None None] MFA Rules not processed for user `b806d412507c4582bac5b20053835386`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:01:27.137765 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 952/1910] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 18 22:01:26 2022] PUT /identity/v3/projects/5908df3b9d8945d19483a859a0889367/users/35fc90d71a654879971cb5b90f9a9802/roles/0833202e2a3d47d1b6b3af57006641b1 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:01:27.138590 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-f356fb3b-049f-4048-9cf2-630187fa1618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:27.139208 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9295f243-ed70-4202-b7cd-9859fa505050 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:27.140879 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-9295f243-ed70-4202-b7cd-9859fa505050 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:27.213369 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9295f243-ed70-4202-b7cd-9859fa505050 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:27.217164 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 959/1911] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:01:27 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:01:27.221713 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f356fb3b-049f-4048-9cf2-630187fa1618 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:27.222243 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db34bee-0a2e-4194-8143-f4dc81549f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:27.222950 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db34bee-0a2e-4194-8143-f4dc81549f2f admin admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:27.223244 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-f356fb3b-049f-4048-9cf2-630187fa1618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:27.223351 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db34bee-0a2e-4194-8143-f4dc81549f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:27.223965 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db34bee-0a2e-4194-8143-f4dc81549f2f admin admin] PATH_INFO: `/v3/roles` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:27.224385 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db34bee-0a2e-4194-8143-f4dc81549f2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:27.226158 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db34bee-0a2e-4194-8143-f4dc81549f2f admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:27.241865 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f356fb3b-049f-4048-9cf2-630187fa1618 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:27.242682 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 953/1912] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:01:27 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:01:27.246881 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db34bee-0a2e-4194-8143-f4dc81549f2f admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:27.249863 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172e804f-ee59-453a-9b55-e2f2b53823d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:27.250897 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172e804f-ee59-453a-9b55-e2f2b53823d4 admin admin] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:27.252270 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172e804f-ee59-453a-9b55-e2f2b53823d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:27.252715 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172e804f-ee59-453a-9b55-e2f2b53823d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:27.253708 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172e804f-ee59-453a-9b55-e2f2b53823d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:27.256653 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172e804f-ee59-453a-9b55-e2f2b53823d4 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:27.260528 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db34bee-0a2e-4194-8143-f4dc81549f2f admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:27.267465 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ea2130-4271-4615-998e-dd0b4217b376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:27.268288 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ea2130-4271-4615-998e-dd0b4217b376 admin admin] REQUEST_METHOD: `PUT` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:27.268700 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ea2130-4271-4615-998e-dd0b4217b376 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:27.269071 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ea2130-4271-4615-998e-dd0b4217b376 admin admin] PATH_INFO: `/v3/projects/5908df3b9d8945d19483a859a0889367/users/35fc90d71a654879971cb5b90f9a9802/roles/0833202e2a3d47d1b6b3af57006641b1` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:27.271696 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ea2130-4271-4615-998e-dd0b4217b376 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5908df3b9d8945d19483a859a0889367, user_id=35fc90d71a654879971cb5b90f9a9802, role_id=0833202e2a3d47d1b6b3af57006641b1)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:27.275096 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ea2130-4271-4615-998e-dd0b4217b376 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:27.289024 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 954/1913] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 18 22:01:27 2022] PUT /identity/v3/projects/5908df3b9d8945d19483a859a0889367/users/35fc90d71a654879971cb5b90f9a9802/roles/0833202e2a3d47d1b6b3af57006641b1 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:01:27.300671 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e274136e-3175-40a9-b15e-b7d4f9726afb None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:27.301014 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e274136e-3175-40a9-b15e-b7d4f9726afb None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:27.301287 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e274136e-3175-40a9-b15e-b7d4f9726afb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:27.330485 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:01:27.334799 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-e274136e-3175-40a9-b15e-b7d4f9726afb None None] MFA Rules not processed for user `35fc90d71a654879971cb5b90f9a9802`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:01:27.336185 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-e274136e-3175-40a9-b15e-b7d4f9726afb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:27.365747 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 960/1914] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 18 22:01:27 2022] POST /identity/v3/projects => generated 381 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 22:01:27.369846 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172e804f-ee59-453a-9b55-e2f2b53823d4 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:27.488699 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 955/1915] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:01:27 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 22:01:27.500762 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e274136e-3175-40a9-b15e-b7d4f9726afb None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:27.504177 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-e274136e-3175-40a9-b15e-b7d4f9726afb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:27.505764 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172e804f-ee59-453a-9b55-e2f2b53823d4 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:27.511472 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e1ab8a-8d28-44a9-a166-8b73fa1f8468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:27.512187 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e1ab8a-8d28-44a9-a166-8b73fa1f8468 admin admin] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:27.512634 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e1ab8a-8d28-44a9-a166-8b73fa1f8468 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:27.512989 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e1ab8a-8d28-44a9-a166-8b73fa1f8468 admin admin] PATH_INFO: `/v3/users` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:27.513915 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e1ab8a-8d28-44a9-a166-8b73fa1f8468 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:27.516150 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e1ab8a-8d28-44a9-a166-8b73fa1f8468 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:27.590860 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e274136e-3175-40a9-b15e-b7d4f9726afb None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:27.613789 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 961/1916] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 18 22:01:27 2022] POST /identity/v3/users => generated 297 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 22:01:27.614713 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e1ab8a-8d28-44a9-a166-8b73fa1f8468 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:27.622479 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-86e1ab8a-8d28-44a9-a166-8b73fa1f8468 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:27.633242 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e1ab8a-8d28-44a9-a166-8b73fa1f8468 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:27.639031 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5034caf5-adac-4495-b6fe-501d7f877296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:27.639680 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5034caf5-adac-4495-b6fe-501d7f877296 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:27.642620 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5034caf5-adac-4495-b6fe-501d7f877296 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:27.643012 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5034caf5-adac-4495-b6fe-501d7f877296 admin admin] PATH_INFO: `/v3/projects/8ee366625cdd4d85b00c18f23671dd4f` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:27.644508 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5034caf5-adac-4495-b6fe-501d7f877296 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ee366625cdd4d85b00c18f23671dd4f)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:27.646659 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5034caf5-adac-4495-b6fe-501d7f877296 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:27.692809 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa08da6-dd49-4276-92f5-60a62acb1cff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22b6a7c36f8a4795a75271b8079821c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:27.693427 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa08da6-dd49-4276-92f5-60a62acb1cff service cinder] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:27.693706 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa08da6-dd49-4276-92f5-60a62acb1cff service cinder] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:27.694528 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa08da6-dd49-4276-92f5-60a62acb1cff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:27.696406 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-0fa08da6-dd49-4276-92f5-60a62acb1cff service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:27.705976 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:01:27.771352 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa08da6-dd49-4276-92f5-60a62acb1cff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:27.773158 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa08da6-dd49-4276-92f5-60a62acb1cff service cinder] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:27.784916 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 956/1917] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:01:27 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:01:27.786224 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa08da6-dd49-4276-92f5-60a62acb1cff service cinder] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:27.797767 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-5034caf5-adac-4495-b6fe-501d7f877296 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ee366625cdd4d85b00c18f23671dd4f', 'request_id': 'req-5034caf5-adac-4495-b6fe-501d7f877296'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:27.798188 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa08da6-dd49-4276-92f5-60a62acb1cff service cinder] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:27.804833 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-5034caf5-adac-4495-b6fe-501d7f877296 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ee366625cdd4d85b00c18f23671dd4f', 'request_id': 'req-5034caf5-adac-4495-b6fe-501d7f877296'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:27.863007 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f753af-3e17-4585-adb7-0c9e918af026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:27.864696 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f753af-3e17-4585-adb7-0c9e918af026 admin admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:27.865040 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f753af-3e17-4585-adb7-0c9e918af026 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:27.866818 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f753af-3e17-4585-adb7-0c9e918af026 admin admin] PATH_INFO: `/v3/roles` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:27.867671 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f753af-3e17-4585-adb7-0c9e918af026 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:27.870101 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f753af-3e17-4585-adb7-0c9e918af026 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:27.884764 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 957/1918] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:01:27 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:01:27.886021 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f753af-3e17-4585-adb7-0c9e918af026 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:27.900529 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f753af-3e17-4585-adb7-0c9e918af026 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:27.903841 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ec882b-b34d-46d5-9d14-84258b327bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:27.904501 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ec882b-b34d-46d5-9d14-84258b327bc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:27.904836 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ec882b-b34d-46d5-9d14-84258b327bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:27.905119 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ec882b-b34d-46d5-9d14-84258b327bc5 admin admin] PATH_INFO: `/v3/projects/210d5e02743d454b965f3a4ee6feab96/users/143a3fccf2034035b69d32609e8e7507/roles/0833202e2a3d47d1b6b3af57006641b1` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:27.920979 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-5034caf5-adac-4495-b6fe-501d7f877296 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ee366625cdd4d85b00c18f23671dd4f', 'request_id': 'req-5034caf5-adac-4495-b6fe-501d7f877296'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:27.921750 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ec882b-b34d-46d5-9d14-84258b327bc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=210d5e02743d454b965f3a4ee6feab96, user_id=143a3fccf2034035b69d32609e8e7507, role_id=0833202e2a3d47d1b6b3af57006641b1)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:27.925176 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ec882b-b34d-46d5-9d14-84258b327bc5 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:27.934642 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-5034caf5-adac-4495-b6fe-501d7f877296 admin admin] The token cache is being invalidate because project 8ee366625cdd4d85b00c18f23671dd4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88097) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 22:01:27.934957 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-5034caf5-adac-4495-b6fe-501d7f877296 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:27.935839 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-5034caf5-adac-4495-b6fe-501d7f877296 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:27.937498 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 962/1919] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 18 22:01:27 2022] DELETE /identity/v3/projects/8ee366625cdd4d85b00c18f23671dd4f => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:01:27.938403 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5034caf5-adac-4495-b6fe-501d7f877296 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:27.941409 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-5034caf5-adac-4495-b6fe-501d7f877296 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:27.955809 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5034caf5-adac-4495-b6fe-501d7f877296 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:27.963746 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0b90e5-6615-41e1-9531-b04156c06d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:27.964929 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0b90e5-6615-41e1-9531-b04156c06d14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:27.965223 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0b90e5-6615-41e1-9531-b04156c06d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:27.965489 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0b90e5-6615-41e1-9531-b04156c06d14 admin admin] PATH_INFO: `/v3/projects/735b338fa0574d259631bcb0761939c5` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:27.967263 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0b90e5-6615-41e1-9531-b04156c06d14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=735b338fa0574d259631bcb0761939c5)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:27.969222 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0b90e5-6615-41e1-9531-b04156c06d14 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:28.010655 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 958/1920] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 18 22:01:27 2022] PUT /identity/v3/projects/210d5e02743d454b965f3a4ee6feab96/users/143a3fccf2034035b69d32609e8e7507/roles/0833202e2a3d47d1b6b3af57006641b1 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:01:28.011646 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ec882b-b34d-46d5-9d14-84258b327bc5 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:28.015667 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-40ec882b-b34d-46d5-9d14-84258b327bc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:28.096231 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ec882b-b34d-46d5-9d14-84258b327bc5 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:28.102213 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7564b76f-4432-41d4-8ed1-40082317ca9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:28.103137 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7564b76f-4432-41d4-8ed1-40082317ca9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:28.103520 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7564b76f-4432-41d4-8ed1-40082317ca9c admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:28.103899 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7564b76f-4432-41d4-8ed1-40082317ca9c admin admin] PATH_INFO: `/v3/users/faa3ccceb2bd48709ae01ceed5c48600` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:28.105246 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7564b76f-4432-41d4-8ed1-40082317ca9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=faa3ccceb2bd48709ae01ceed5c48600)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:28.107412 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7564b76f-4432-41d4-8ed1-40082317ca9c admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:28.119361 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-5d0b90e5-6615-41e1-9531-b04156c06d14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '735b338fa0574d259631bcb0761939c5', 'request_id': 'req-5d0b90e5-6615-41e1-9531-b04156c06d14'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:28.127106 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-5d0b90e5-6615-41e1-9531-b04156c06d14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '735b338fa0574d259631bcb0761939c5', 'request_id': 'req-5d0b90e5-6615-41e1-9531-b04156c06d14'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:28.226984 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-5d0b90e5-6615-41e1-9531-b04156c06d14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '735b338fa0574d259631bcb0761939c5', 'request_id': 'req-5d0b90e5-6615-41e1-9531-b04156c06d14'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:28.239980 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-5d0b90e5-6615-41e1-9531-b04156c06d14 admin admin] The token cache is being invalidate because project 735b338fa0574d259631bcb0761939c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88097) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 22:01:28.240267 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-5d0b90e5-6615-41e1-9531-b04156c06d14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:28.240931 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-5d0b90e5-6615-41e1-9531-b04156c06d14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:28.243378 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 963/1921] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 18 22:01:27 2022] DELETE /identity/v3/projects/735b338fa0574d259631bcb0761939c5 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:01:28.246979 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0b90e5-6615-41e1-9531-b04156c06d14 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:28.246979 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-5d0b90e5-6615-41e1-9531-b04156c06d14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:28.315006 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0b90e5-6615-41e1-9531-b04156c06d14 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:28.319741 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b658d3-1dcc-49ff-8198-6bc2cc09ba89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:28.320343 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b658d3-1dcc-49ff-8198-6bc2cc09ba89 admin admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:28.320682 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b658d3-1dcc-49ff-8198-6bc2cc09ba89 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:28.320966 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b658d3-1dcc-49ff-8198-6bc2cc09ba89 admin admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:28.321612 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b658d3-1dcc-49ff-8198-6bc2cc09ba89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:28.324555 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b658d3-1dcc-49ff-8198-6bc2cc09ba89 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:28.335660 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 964/1922] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:01:28 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:01:28.336918 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff56d90e-69b2-4bcd-8044-6600af9df90b None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:28.337209 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff56d90e-69b2-4bcd-8044-6600af9df90b None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:28.337491 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff56d90e-69b2-4bcd-8044-6600af9df90b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:28.357086 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-ff56d90e-69b2-4bcd-8044-6600af9df90b None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:01:28.358319 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-ff56d90e-69b2-4bcd-8044-6600af9df90b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:28.367587 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 965/1923] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:01:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:01:28.368314 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff56d90e-69b2-4bcd-8044-6600af9df90b None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:28.371867 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-7564b76f-4432-41d4-8ed1-40082317ca9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'faa3ccceb2bd48709ae01ceed5c48600'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:28.380176 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-7564b76f-4432-41d4-8ed1-40082317ca9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'faa3ccceb2bd48709ae01ceed5c48600'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:28.380926 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-7564b76f-4432-41d4-8ed1-40082317ca9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'faa3ccceb2bd48709ae01ceed5c48600'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:28.381170 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff56d90e-69b2-4bcd-8044-6600af9df90b None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:28.381558 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-7564b76f-4432-41d4-8ed1-40082317ca9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'faa3ccceb2bd48709ae01ceed5c48600'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:28.386661 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296f459d-0f31-4adc-9d58-56505bf3fcd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:28.387323 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296f459d-0f31-4adc-9d58-56505bf3fcd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:28.387754 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296f459d-0f31-4adc-9d58-56505bf3fcd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:28.388036 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296f459d-0f31-4adc-9d58-56505bf3fcd2 admin admin] PATH_INFO: `/v3/projects/210d5e02743d454b965f3a4ee6feab96/users/143a3fccf2034035b69d32609e8e7507/roles/0833202e2a3d47d1b6b3af57006641b1` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:28.390023 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296f459d-0f31-4adc-9d58-56505bf3fcd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=210d5e02743d454b965f3a4ee6feab96, user_id=143a3fccf2034035b69d32609e8e7507, role_id=0833202e2a3d47d1b6b3af57006641b1)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:28.392720 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296f459d-0f31-4adc-9d58-56505bf3fcd2 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:28.394556 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-7564b76f-4432-41d4-8ed1-40082317ca9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'faa3ccceb2bd48709ae01ceed5c48600'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:28.413013 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 966/1924] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 18 22:01:28 2022] PUT /identity/v3/projects/210d5e02743d454b965f3a4ee6feab96/users/143a3fccf2034035b69d32609e8e7507/roles/0833202e2a3d47d1b6b3af57006641b1 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:01:28.413013 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5e6794-1dd0-433c-aad7-37202dccc009 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:28.413013 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5e6794-1dd0-433c-aad7-37202dccc009 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:28.413013 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5e6794-1dd0-433c-aad7-37202dccc009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:28.430639 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-8a5e6794-1dd0-433c-aad7-37202dccc009 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:01:28.431873 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-8a5e6794-1dd0-433c-aad7-37202dccc009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:28.488769 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 959/1925] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 18 22:01:28 2022] DELETE /identity/v3/users/faa3ccceb2bd48709ae01ceed5c48600 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:01:28.489733 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b84a11-bc4c-4875-83dd-b4e451952b12 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:28.490030 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b84a11-bc4c-4875-83dd-b4e451952b12 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:28.490361 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b84a11-bc4c-4875-83dd-b4e451952b12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:28.516334 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 967/1926] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:01:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:01:28.520845 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5e6794-1dd0-433c-aad7-37202dccc009 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:28.531734 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5e6794-1dd0-433c-aad7-37202dccc009 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:28.553565 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-24b84a11-bc4c-4875-83dd-b4e451952b12 None None] MFA Rules not processed for user `143a3fccf2034035b69d32609e8e7507`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:01:28.555289 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-24b84a11-bc4c-4875-83dd-b4e451952b12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:28.604810 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3982a59-5b9b-47eb-b8d7-c36d74b28059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:28.605680 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3982a59-5b9b-47eb-b8d7-c36d74b28059 admin admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:28.606116 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3982a59-5b9b-47eb-b8d7-c36d74b28059 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:28.606391 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3982a59-5b9b-47eb-b8d7-c36d74b28059 admin admin] PATH_INFO: `/v3/domains` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:28.607040 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3982a59-5b9b-47eb-b8d7-c36d74b28059 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 22:01:28.607336 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3982a59-5b9b-47eb-b8d7-c36d74b28059 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:28.608992 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3982a59-5b9b-47eb-b8d7-c36d74b28059 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:28.625090 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 968/1927] 10.222.0.27 () {58 vars in 1153 bytes} [Thu Aug 18 22:01:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 22:01:28.626122 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3982a59-5b9b-47eb-b8d7-c36d74b28059 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:28.636347 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3982a59-5b9b-47eb-b8d7-c36d74b28059 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:28.639424 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 960/1928] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:01:28 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:01:28.642223 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ee5cda-f138-4831-b92f-0de6d351dea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:28.642873 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ee5cda-f138-4831-b92f-0de6d351dea2 admin admin] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:28.643153 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ee5cda-f138-4831-b92f-0de6d351dea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:28.643435 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ee5cda-f138-4831-b92f-0de6d351dea2 admin admin] PATH_INFO: `/v3/projects` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:28.644064 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ee5cda-f138-4831-b92f-0de6d351dea2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:28.646158 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ee5cda-f138-4831-b92f-0de6d351dea2 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:28.653158 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b84a11-bc4c-4875-83dd-b4e451952b12 None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:28.654637 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-24b84a11-bc4c-4875-83dd-b4e451952b12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:28.661783 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:01:28.725637 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b84a11-bc4c-4875-83dd-b4e451952b12 None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:28.730266 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c825ed47-c543-4cd3-a862-4f7ec8330fea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22b6a7c36f8a4795a75271b8079821c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:28.730960 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c825ed47-c543-4cd3-a862-4f7ec8330fea service cinder] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:28.731375 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c825ed47-c543-4cd3-a862-4f7ec8330fea service cinder] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:28.731719 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c825ed47-c543-4cd3-a862-4f7ec8330fea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:28.749902 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c825ed47-c543-4cd3-a862-4f7ec8330fea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:28.751991 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c825ed47-c543-4cd3-a862-4f7ec8330fea service cinder] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:28.756043 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 969/1929] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 18 22:01:28 2022] POST /identity/v3/projects => generated 363 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 22:01:28.760431 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ee5cda-f138-4831-b92f-0de6d351dea2 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:28.765827 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 961/1930] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:01:28 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 22:01:28.903667 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ee5cda-f138-4831-b92f-0de6d351dea2 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:28.913081 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e04e544-1384-44a6-814e-e2f9a86b08a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:28.914394 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e04e544-1384-44a6-814e-e2f9a86b08a6 admin admin] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:28.914787 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e04e544-1384-44a6-814e-e2f9a86b08a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:28.916360 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e04e544-1384-44a6-814e-e2f9a86b08a6 admin admin] PATH_INFO: `/v3/users` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:28.917150 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e04e544-1384-44a6-814e-e2f9a86b08a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:28.919959 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e04e544-1384-44a6-814e-e2f9a86b08a6 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:29.031571 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 970/1931] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 18 22:01:28 2022] POST /identity/v3/users => generated 282 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 22:01:29.036094 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c825ed47-c543-4cd3-a862-4f7ec8330fea service cinder] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:29.049153 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c825ed47-c543-4cd3-a862-4f7ec8330fea service cinder] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:29.054603 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba835bf-cad1-40f2-9fb6-4e458eb4b719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:29.055339 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba835bf-cad1-40f2-9fb6-4e458eb4b719 admin admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:29.055662 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba835bf-cad1-40f2-9fb6-4e458eb4b719 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:29.056001 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba835bf-cad1-40f2-9fb6-4e458eb4b719 admin admin] PATH_INFO: `/v3/roles` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:29.056740 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba835bf-cad1-40f2-9fb6-4e458eb4b719 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:29.058375 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba835bf-cad1-40f2-9fb6-4e458eb4b719 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:29.069503 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e04e544-1384-44a6-814e-e2f9a86b08a6 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:29.071464 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-6e04e544-1384-44a6-814e-e2f9a86b08a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:29.075935 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 962/1932] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:01:29 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 22:01:29.077696 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba835bf-cad1-40f2-9fb6-4e458eb4b719 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:29.084876 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e04e544-1384-44a6-814e-e2f9a86b08a6 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:29.090157 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22706d1a-6725-4ac8-aee3-66ac23bbf8d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:29.090558 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba835bf-cad1-40f2-9fb6-4e458eb4b719 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:29.090796 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22706d1a-6725-4ac8-aee3-66ac23bbf8d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:29.094760 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22706d1a-6725-4ac8-aee3-66ac23bbf8d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:29.094760 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22706d1a-6725-4ac8-aee3-66ac23bbf8d9 admin admin] PATH_INFO: `/v3/projects/e384c988ce9c47ed8df64dbb02b4579e` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:29.094760 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22706d1a-6725-4ac8-aee3-66ac23bbf8d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e384c988ce9c47ed8df64dbb02b4579e)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:29.094760 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22706d1a-6725-4ac8-aee3-66ac23bbf8d9 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:29.102760 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4cc2a9-af61-4835-a036-ae6ab5670e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:29.103416 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4cc2a9-af61-4835-a036-ae6ab5670e06 admin admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:29.103715 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4cc2a9-af61-4835-a036-ae6ab5670e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:29.103974 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4cc2a9-af61-4835-a036-ae6ab5670e06 admin admin] PATH_INFO: `/v3/roles` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:29.104652 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4cc2a9-af61-4835-a036-ae6ab5670e06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:29.106299 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4cc2a9-af61-4835-a036-ae6ab5670e06 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:29.119151 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 963/1933] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:01:29 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:01:29.123159 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4cc2a9-af61-4835-a036-ae6ab5670e06 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:29.134294 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4cc2a9-af61-4835-a036-ae6ab5670e06 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:29.139490 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cf5d70-8002-4159-8bc5-bae61396035f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:29.140150 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cf5d70-8002-4159-8bc5-bae61396035f admin admin] REQUEST_METHOD: `PUT` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:29.140432 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cf5d70-8002-4159-8bc5-bae61396035f admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:29.140751 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cf5d70-8002-4159-8bc5-bae61396035f admin admin] PATH_INFO: `/v3/projects/08da8ead2333416e98ab3b96df829abb/users/f3e3074926664c989f482e1d6c8735bb/roles/de8f2438056f4af9879423f8a59e0e0b` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:29.156937 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cf5d70-8002-4159-8bc5-bae61396035f admin admin] RBAC: Authorizing `identity:create_grant(project_id=08da8ead2333416e98ab3b96df829abb, user_id=f3e3074926664c989f482e1d6c8735bb, role_id=de8f2438056f4af9879423f8a59e0e0b)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:29.160668 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cf5d70-8002-4159-8bc5-bae61396035f admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:29.237989 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 964/1934] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 18 22:01:29 2022] PUT /identity/v3/projects/08da8ead2333416e98ab3b96df829abb/users/f3e3074926664c989f482e1d6c8735bb/roles/de8f2438056f4af9879423f8a59e0e0b => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:01:29.245506 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-22706d1a-6725-4ac8-aee3-66ac23bbf8d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e384c988ce9c47ed8df64dbb02b4579e', 'request_id': 'req-22706d1a-6725-4ac8-aee3-66ac23bbf8d9'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:29.248653 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c35dc4-088a-45b1-b6e9-ea6db2338d10 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:29.249000 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c35dc4-088a-45b1-b6e9-ea6db2338d10 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:29.249270 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c35dc4-088a-45b1-b6e9-ea6db2338d10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:29.251040 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-22706d1a-6725-4ac8-aee3-66ac23bbf8d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e384c988ce9c47ed8df64dbb02b4579e', 'request_id': 'req-22706d1a-6725-4ac8-aee3-66ac23bbf8d9'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:29.278596 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-29c35dc4-088a-45b1-b6e9-ea6db2338d10 None None] MFA Rules not processed for user `f3e3074926664c989f482e1d6c8735bb`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:01:29.280075 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-29c35dc4-088a-45b1-b6e9-ea6db2338d10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:29.346957 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 965/1935] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:01:29 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 22:01:29.351487 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c35dc4-088a-45b1-b6e9-ea6db2338d10 None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:29.358100 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-22706d1a-6725-4ac8-aee3-66ac23bbf8d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e384c988ce9c47ed8df64dbb02b4579e', 'request_id': 'req-22706d1a-6725-4ac8-aee3-66ac23bbf8d9'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:29.371672 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-22706d1a-6725-4ac8-aee3-66ac23bbf8d9 admin admin] The token cache is being invalidate because project e384c988ce9c47ed8df64dbb02b4579e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88097) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 22:01:29.371967 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-22706d1a-6725-4ac8-aee3-66ac23bbf8d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:29.372705 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-22706d1a-6725-4ac8-aee3-66ac23bbf8d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:29.374201 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 971/1936] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 18 22:01:29 2022] DELETE /identity/v3/projects/e384c988ce9c47ed8df64dbb02b4579e => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 22:01:29.380173 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8adb1b-e62f-48e0-824d-9c89215c0c36 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:29.380463 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8adb1b-e62f-48e0-824d-9c89215c0c36 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:29.380776 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8adb1b-e62f-48e0-824d-9c89215c0c36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:29.401699 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-bb8adb1b-e62f-48e0-824d-9c89215c0c36 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:01:29.403163 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-bb8adb1b-e62f-48e0-824d-9c89215c0c36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:29.418072 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c35dc4-088a-45b1-b6e9-ea6db2338d10 None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:29.422839 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de00ff2-9d0e-44ea-9022-4b9027e9d890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:29.423641 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de00ff2-9d0e-44ea-9022-4b9027e9d890 admin admin] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:29.424117 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de00ff2-9d0e-44ea-9022-4b9027e9d890 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:29.424401 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de00ff2-9d0e-44ea-9022-4b9027e9d890 admin admin] PATH_INFO: `/v3/projects` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:29.425063 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de00ff2-9d0e-44ea-9022-4b9027e9d890 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:29.426972 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de00ff2-9d0e-44ea-9022-4b9027e9d890 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:29.465813 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 972/1937] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:01:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 22:01:29.474468 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567b2f71-0f52-470b-8450-12141a2f6cff None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:29.474760 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567b2f71-0f52-470b-8450-12141a2f6cff None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:29.475039 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567b2f71-0f52-470b-8450-12141a2f6cff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:29.494680 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-567b2f71-0f52-470b-8450-12141a2f6cff None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:01:29.495881 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-567b2f71-0f52-470b-8450-12141a2f6cff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:29.504977 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 973/1938] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:01:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 22:01:29.509530 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567b2f71-0f52-470b-8450-12141a2f6cff None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:29.519725 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 966/1939] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 18 22:01:29 2022] POST /identity/v3/projects => generated 365 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 22:01:29.519897 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567b2f71-0f52-470b-8450-12141a2f6cff None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:29.527065 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de00ff2-9d0e-44ea-9022-4b9027e9d890 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:29.530338 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-7de00ff2-9d0e-44ea-9022-4b9027e9d890 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:29.580413 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4ed2c0-391f-4f12-be78-26ca062d0507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:29.583013 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4ed2c0-391f-4f12-be78-26ca062d0507 admin admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:29.583287 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4ed2c0-391f-4f12-be78-26ca062d0507 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:29.583569 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4ed2c0-391f-4f12-be78-26ca062d0507 admin admin] PATH_INFO: `/v3/domains` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:29.585500 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4ed2c0-391f-4f12-be78-26ca062d0507 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 22:01:29.585500 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4ed2c0-391f-4f12-be78-26ca062d0507 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:29.586467 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4ed2c0-391f-4f12-be78-26ca062d0507 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:29.601609 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 974/1940] 10.222.0.27 () {58 vars in 1153 bytes} [Thu Aug 18 22:01:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 22:01:29.606348 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4ed2c0-391f-4f12-be78-26ca062d0507 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:29.612987 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de00ff2-9d0e-44ea-9022-4b9027e9d890 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:29.619529 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4ed2c0-391f-4f12-be78-26ca062d0507 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:29.625554 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474045ad-ba53-4287-8619-838e7fcf07a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:29.626269 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474045ad-ba53-4287-8619-838e7fcf07a8 admin admin] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:29.627310 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474045ad-ba53-4287-8619-838e7fcf07a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:29.627676 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474045ad-ba53-4287-8619-838e7fcf07a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:29.628581 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474045ad-ba53-4287-8619-838e7fcf07a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:29.630813 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474045ad-ba53-4287-8619-838e7fcf07a8 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:29.632872 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb6308b-f156-4ec7-b996-ee94021fb33f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:29.633670 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb6308b-f156-4ec7-b996-ee94021fb33f admin admin] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:29.634114 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb6308b-f156-4ec7-b996-ee94021fb33f admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:29.634543 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb6308b-f156-4ec7-b996-ee94021fb33f admin admin] PATH_INFO: `/v3/users` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:29.635311 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb6308b-f156-4ec7-b996-ee94021fb33f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:29.637764 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb6308b-f156-4ec7-b996-ee94021fb33f admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:29.744004 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 967/1941] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 18 22:01:29 2022] POST /identity/v3/users => generated 289 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 22:01:29.751187 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 975/1942] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 18 22:01:29 2022] POST /identity/v3/projects => generated 377 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 22:01:29.751187 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474045ad-ba53-4287-8619-838e7fcf07a8 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:29.753058 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb6308b-f156-4ec7-b996-ee94021fb33f admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:29.754859 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-fcb6308b-f156-4ec7-b996-ee94021fb33f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:29.814665 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb6308b-f156-4ec7-b996-ee94021fb33f admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:29.817517 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474045ad-ba53-4287-8619-838e7fcf07a8 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:29.830478 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0f1d7e-0876-4972-8acd-f246b7f6965f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:29.831660 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0f1d7e-0876-4972-8acd-f246b7f6965f admin admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:29.831938 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0f1d7e-0876-4972-8acd-f246b7f6965f admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:29.832226 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0f1d7e-0876-4972-8acd-f246b7f6965f admin admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:29.832896 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0f1d7e-0876-4972-8acd-f246b7f6965f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:29.834618 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0f1d7e-0876-4972-8acd-f246b7f6965f admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:29.849295 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 976/1943] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:01:29 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:01:29.849295 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0f1d7e-0876-4972-8acd-f246b7f6965f admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:29.857416 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0f1d7e-0876-4972-8acd-f246b7f6965f admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:29.862917 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76577c2-0f3f-4200-a8d5-4c22d7163295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:29.863527 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76577c2-0f3f-4200-a8d5-4c22d7163295 admin admin] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:29.863802 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76577c2-0f3f-4200-a8d5-4c22d7163295 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:29.864251 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76577c2-0f3f-4200-a8d5-4c22d7163295 admin admin] PATH_INFO: `/v3/users` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:29.864983 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76577c2-0f3f-4200-a8d5-4c22d7163295 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:29.866944 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76577c2-0f3f-4200-a8d5-4c22d7163295 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:29.893562 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bb054e-0848-4234-b27d-6f362fc9027f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22b6a7c36f8a4795a75271b8079821c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:29.894226 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bb054e-0848-4234-b27d-6f362fc9027f service cinder] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:29.894504 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bb054e-0848-4234-b27d-6f362fc9027f service cinder] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:29.894770 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bb054e-0848-4234-b27d-6f362fc9027f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:29.896648 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-26bb054e-0848-4234-b27d-6f362fc9027f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:29.935066 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 977/1944] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 18 22:01:29 2022] POST /identity/v3/users => generated 289 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 22:01:29.940188 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76577c2-0f3f-4200-a8d5-4c22d7163295 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:29.965718 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76577c2-0f3f-4200-a8d5-4c22d7163295 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:29.972045 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:01:29.984284 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4143537a-2fdf-4dc3-9935-b3b8f0c05eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:29.985313 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4143537a-2fdf-4dc3-9935-b3b8f0c05eca admin admin] REQUEST_METHOD: `PUT` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:29.986285 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4143537a-2fdf-4dc3-9935-b3b8f0c05eca admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:29.986856 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4143537a-2fdf-4dc3-9935-b3b8f0c05eca admin admin] PATH_INFO: `/v3/projects/f6072ca4f3954493bdf930eea4e31fe8/users/0f6f3ad5f73a40519ce6a4a79c5a49dd/roles/0833202e2a3d47d1b6b3af57006641b1` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:29.994267 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bb054e-0848-4234-b27d-6f362fc9027f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:29.995789 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bb054e-0848-4234-b27d-6f362fc9027f service cinder] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:30.004024 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4143537a-2fdf-4dc3-9935-b3b8f0c05eca admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6072ca4f3954493bdf930eea4e31fe8, user_id=0f6f3ad5f73a40519ce6a4a79c5a49dd, role_id=0833202e2a3d47d1b6b3af57006641b1)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:30.006832 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 968/1945] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:01:29 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:01:30.007355 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4143537a-2fdf-4dc3-9935-b3b8f0c05eca admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:30.009527 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bb054e-0848-4234-b27d-6f362fc9027f service cinder] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:30.011064 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-26bb054e-0848-4234-b27d-6f362fc9027f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:30.099377 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 978/1946] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 18 22:01:29 2022] PUT /identity/v3/projects/f6072ca4f3954493bdf930eea4e31fe8/users/0f6f3ad5f73a40519ce6a4a79c5a49dd/roles/0833202e2a3d47d1b6b3af57006641b1 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:01:30.100287 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4143537a-2fdf-4dc3-9935-b3b8f0c05eca admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:30.102571 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bb054e-0848-4234-b27d-6f362fc9027f service cinder] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:30.229495 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4143537a-2fdf-4dc3-9935-b3b8f0c05eca admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:30.253704 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401ee940-420a-4399-91a0-7094fd06b023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:30.255126 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401ee940-420a-4399-91a0-7094fd06b023 admin admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:30.255556 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401ee940-420a-4399-91a0-7094fd06b023 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:30.258029 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd65882-645f-46c8-950f-870b4f215901 tempest-VolumeQuotaClassesTest-1971834422 tempest-VolumeQuotaClassesTest-1971834422-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '143a3fccf2034035b69d32609e8e7507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '210d5e02743d454b965f3a4ee6feab96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:30.258843 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401ee940-420a-4399-91a0-7094fd06b023 admin admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:30.259000 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd65882-645f-46c8-950f-870b4f215901 tempest-VolumeQuotaClassesTest-1971834422 tempest-VolumeQuotaClassesTest-1971834422-project-admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:30.259400 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd65882-645f-46c8-950f-870b4f215901 tempest-VolumeQuotaClassesTest-1971834422 tempest-VolumeQuotaClassesTest-1971834422-project-admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:30.259769 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd65882-645f-46c8-950f-870b4f215901 tempest-VolumeQuotaClassesTest-1971834422 tempest-VolumeQuotaClassesTest-1971834422-project-admin] PATH_INFO: `/v3/domains` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:30.260774 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd65882-645f-46c8-950f-870b4f215901 tempest-VolumeQuotaClassesTest-1971834422 tempest-VolumeQuotaClassesTest-1971834422-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 22:01:30.261288 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd65882-645f-46c8-950f-870b4f215901 tempest-VolumeQuotaClassesTest-1971834422 tempest-VolumeQuotaClassesTest-1971834422-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:30.261588 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401ee940-420a-4399-91a0-7094fd06b023 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:30.263710 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd65882-645f-46c8-950f-870b4f215901 tempest-VolumeQuotaClassesTest-1971834422 tempest-VolumeQuotaClassesTest-1971834422-project-admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:30.266463 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401ee940-420a-4399-91a0-7094fd06b023 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:30.280890 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 969/1947] 10.222.0.27 () {58 vars in 1153 bytes} [Thu Aug 18 22:01:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 22:01:30.288912 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 979/1948] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:01:30 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:01:30.290105 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd65882-645f-46c8-950f-870b4f215901 tempest-VolumeQuotaClassesTest-1971834422 tempest-VolumeQuotaClassesTest-1971834422-project-admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:30.290222 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401ee940-420a-4399-91a0-7094fd06b023 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:30.309409 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd65882-645f-46c8-950f-870b4f215901 tempest-VolumeQuotaClassesTest-1971834422 tempest-VolumeQuotaClassesTest-1971834422-project-admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:30.313611 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401ee940-420a-4399-91a0-7094fd06b023 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:30.316824 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbabefaf-4688-4e45-9d15-7dc7cd31d96d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:30.317989 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbabefaf-4688-4e45-9d15-7dc7cd31d96d admin admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:30.318335 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbabefaf-4688-4e45-9d15-7dc7cd31d96d admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:30.318702 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbabefaf-4688-4e45-9d15-7dc7cd31d96d admin admin] PATH_INFO: `/v3/roles` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:30.318810 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c440c0-b166-4769-b161-2a7a3a025e7b tempest-VolumeQuotaClassesTest-1971834422 tempest-VolumeQuotaClassesTest-1971834422-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '143a3fccf2034035b69d32609e8e7507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '210d5e02743d454b965f3a4ee6feab96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:30.319431 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c440c0-b166-4769-b161-2a7a3a025e7b tempest-VolumeQuotaClassesTest-1971834422 tempest-VolumeQuotaClassesTest-1971834422-project-admin] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:30.319757 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c440c0-b166-4769-b161-2a7a3a025e7b tempest-VolumeQuotaClassesTest-1971834422 tempest-VolumeQuotaClassesTest-1971834422-project-admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:30.320212 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c440c0-b166-4769-b161-2a7a3a025e7b tempest-VolumeQuotaClassesTest-1971834422 tempest-VolumeQuotaClassesTest-1971834422-project-admin] PATH_INFO: `/v3/projects` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:30.320671 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbabefaf-4688-4e45-9d15-7dc7cd31d96d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:30.320874 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c440c0-b166-4769-b161-2a7a3a025e7b tempest-VolumeQuotaClassesTest-1971834422 tempest-VolumeQuotaClassesTest-1971834422-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:30.322286 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbabefaf-4688-4e45-9d15-7dc7cd31d96d admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:30.322809 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c440c0-b166-4769-b161-2a7a3a025e7b tempest-VolumeQuotaClassesTest-1971834422 tempest-VolumeQuotaClassesTest-1971834422-project-admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:30.344502 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 970/1949] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:01:30 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:01:30.344502 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbabefaf-4688-4e45-9d15-7dc7cd31d96d admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:30.353369 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbabefaf-4688-4e45-9d15-7dc7cd31d96d admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:30.359973 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf6afd4-81d1-4388-b046-dd47cf399acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:30.361627 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf6afd4-81d1-4388-b046-dd47cf399acd admin admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:30.361903 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf6afd4-81d1-4388-b046-dd47cf399acd admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:30.362395 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf6afd4-81d1-4388-b046-dd47cf399acd admin admin] PATH_INFO: `/v3/roles` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:30.363110 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf6afd4-81d1-4388-b046-dd47cf399acd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:30.364820 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf6afd4-81d1-4388-b046-dd47cf399acd admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:30.380367 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 971/1950] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:01:30 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:01:30.381242 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf6afd4-81d1-4388-b046-dd47cf399acd admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:30.391094 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf6afd4-81d1-4388-b046-dd47cf399acd admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:30.395745 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e0051a-c994-412e-9279-f69670e94774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:30.396389 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e0051a-c994-412e-9279-f69670e94774 admin admin] REQUEST_METHOD: `PUT` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:30.396827 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e0051a-c994-412e-9279-f69670e94774 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:30.397104 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e0051a-c994-412e-9279-f69670e94774 admin admin] PATH_INFO: `/v3/projects/f6072ca4f3954493bdf930eea4e31fe8/users/0f6f3ad5f73a40519ce6a4a79c5a49dd/roles/0833202e2a3d47d1b6b3af57006641b1` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:30.399257 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e0051a-c994-412e-9279-f69670e94774 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6072ca4f3954493bdf930eea4e31fe8, user_id=0f6f3ad5f73a40519ce6a4a79c5a49dd, role_id=0833202e2a3d47d1b6b3af57006641b1)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:30.401957 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e0051a-c994-412e-9279-f69670e94774 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:30.412712 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 972/1951] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 18 22:01:30 2022] PUT /identity/v3/projects/f6072ca4f3954493bdf930eea4e31fe8/users/0f6f3ad5f73a40519ce6a4a79c5a49dd/roles/0833202e2a3d47d1b6b3af57006641b1 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:01:30.413500 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e0051a-c994-412e-9279-f69670e94774 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:30.426324 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 980/1952] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 18 22:01:30 2022] POST /identity/v3/projects => generated 355 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 22:01:30.427623 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8856ac22-8e68-4313-afa8-e6269b87a0da None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:30.427933 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8856ac22-8e68-4313-afa8-e6269b87a0da None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:30.428307 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8856ac22-8e68-4313-afa8-e6269b87a0da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:30.460654 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-8856ac22-8e68-4313-afa8-e6269b87a0da None None] MFA Rules not processed for user `0f6f3ad5f73a40519ce6a4a79c5a49dd`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:01:30.462061 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-8856ac22-8e68-4313-afa8-e6269b87a0da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:30.494379 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e0051a-c994-412e-9279-f69670e94774 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:30.549156 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 981/1953] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:01:30 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:01:30.553388 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8856ac22-8e68-4313-afa8-e6269b87a0da None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:30.569692 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eba683-201f-4547-aa8a-478b02028d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:30.570751 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eba683-201f-4547-aa8a-478b02028d8f admin admin] REQUEST_METHOD: `PUT` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:30.571034 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eba683-201f-4547-aa8a-478b02028d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:30.571310 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eba683-201f-4547-aa8a-478b02028d8f admin admin] PATH_INFO: `/v3/projects/214782863fc04003af7f13c04f383720/users/053829b1f9844d2081f5adc7604ca073/roles/de8f2438056f4af9879423f8a59e0e0b` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:30.587789 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eba683-201f-4547-aa8a-478b02028d8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=214782863fc04003af7f13c04f383720, user_id=053829b1f9844d2081f5adc7604ca073, role_id=de8f2438056f4af9879423f8a59e0e0b)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:30.590568 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eba683-201f-4547-aa8a-478b02028d8f admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:30.616919 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8856ac22-8e68-4313-afa8-e6269b87a0da None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:30.621589 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2877f4-8e25-484a-876a-abd18b15c8b7 tempest-VolumeQuotaClassesTest-1971834422 tempest-VolumeQuotaClassesTest-1971834422-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '143a3fccf2034035b69d32609e8e7507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '210d5e02743d454b965f3a4ee6feab96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:30.622193 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2877f4-8e25-484a-876a-abd18b15c8b7 tempest-VolumeQuotaClassesTest-1971834422 tempest-VolumeQuotaClassesTest-1971834422-project-admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:30.622468 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2877f4-8e25-484a-876a-abd18b15c8b7 tempest-VolumeQuotaClassesTest-1971834422 tempest-VolumeQuotaClassesTest-1971834422-project-admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:30.622745 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2877f4-8e25-484a-876a-abd18b15c8b7 tempest-VolumeQuotaClassesTest-1971834422 tempest-VolumeQuotaClassesTest-1971834422-project-admin] PATH_INFO: `/v3/domains` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:30.623402 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2877f4-8e25-484a-876a-abd18b15c8b7 tempest-VolumeQuotaClassesTest-1971834422 tempest-VolumeQuotaClassesTest-1971834422-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 22:01:30.623703 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2877f4-8e25-484a-876a-abd18b15c8b7 tempest-VolumeQuotaClassesTest-1971834422 tempest-VolumeQuotaClassesTest-1971834422-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:30.625419 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2877f4-8e25-484a-876a-abd18b15c8b7 tempest-VolumeQuotaClassesTest-1971834422 tempest-VolumeQuotaClassesTest-1971834422-project-admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:30.639487 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 982/1954] 10.222.0.27 () {58 vars in 1153 bytes} [Thu Aug 18 22:01:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 22:01:30.641391 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2877f4-8e25-484a-876a-abd18b15c8b7 tempest-VolumeQuotaClassesTest-1971834422 tempest-VolumeQuotaClassesTest-1971834422-project-admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:30.642147 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-de2877f4-8e25-484a-876a-abd18b15c8b7 tempest-VolumeQuotaClassesTest-1971834422 tempest-VolumeQuotaClassesTest-1971834422-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:30.687528 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 973/1955] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 18 22:01:30 2022] PUT /identity/v3/projects/214782863fc04003af7f13c04f383720/users/053829b1f9844d2081f5adc7604ca073/roles/de8f2438056f4af9879423f8a59e0e0b => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:01:30.688561 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eba683-201f-4547-aa8a-478b02028d8f admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:30.726432 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2877f4-8e25-484a-876a-abd18b15c8b7 tempest-VolumeQuotaClassesTest-1971834422 tempest-VolumeQuotaClassesTest-1971834422-project-admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:30.950528 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eba683-201f-4547-aa8a-478b02028d8f admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:30.950528 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dc70d6-52dc-4897-9deb-bfddd89e289b tempest-VolumeQuotaClassesTest-1971834422 tempest-VolumeQuotaClassesTest-1971834422-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '143a3fccf2034035b69d32609e8e7507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '210d5e02743d454b965f3a4ee6feab96', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:30.950528 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dc70d6-52dc-4897-9deb-bfddd89e289b tempest-VolumeQuotaClassesTest-1971834422 tempest-VolumeQuotaClassesTest-1971834422-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:30.951875 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dc70d6-52dc-4897-9deb-bfddd89e289b tempest-VolumeQuotaClassesTest-1971834422 tempest-VolumeQuotaClassesTest-1971834422-project-admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:30.951875 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dc70d6-52dc-4897-9deb-bfddd89e289b tempest-VolumeQuotaClassesTest-1971834422 tempest-VolumeQuotaClassesTest-1971834422-project-admin] PATH_INFO: `/v3/projects/3802464be6864b5c88690f92b6e816b8` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:30.951875 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dc70d6-52dc-4897-9deb-bfddd89e289b tempest-VolumeQuotaClassesTest-1971834422 tempest-VolumeQuotaClassesTest-1971834422-project-admin] RBAC: Authorizing `identity:delete_project(project_id=3802464be6864b5c88690f92b6e816b8)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:30.951875 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dc70d6-52dc-4897-9deb-bfddd89e289b tempest-VolumeQuotaClassesTest-1971834422 tempest-VolumeQuotaClassesTest-1971834422-project-admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:30.952186 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d35f93-9796-469b-afe9-ac45fc3f8bce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22b6a7c36f8a4795a75271b8079821c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:30.952186 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d35f93-9796-469b-afe9-ac45fc3f8bce service cinder] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:30.952186 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d35f93-9796-469b-afe9-ac45fc3f8bce service cinder] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:30.952186 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d35f93-9796-469b-afe9-ac45fc3f8bce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:30.952506 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d35f93-9796-469b-afe9-ac45fc3f8bce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:30.952506 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d35f93-9796-469b-afe9-ac45fc3f8bce service cinder] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:30.952506 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 983/1956] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:01:30 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:01:30.952506 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebbb6e9-6406-4dd5-a97b-30c8a6799258 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:30.952506 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebbb6e9-6406-4dd5-a97b-30c8a6799258 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:30.952506 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebbb6e9-6406-4dd5-a97b-30c8a6799258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:30.952982 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-3ebbb6e9-6406-4dd5-a97b-30c8a6799258 None None] MFA Rules not processed for user `053829b1f9844d2081f5adc7604ca073`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:01:30.952982 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-3ebbb6e9-6406-4dd5-a97b-30c8a6799258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:30.956924 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 984/1957] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:01:30 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:01:30.961392 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebbb6e9-6406-4dd5-a97b-30c8a6799258 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:30.986903 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:01:31.023675 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebbb6e9-6406-4dd5-a97b-30c8a6799258 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:31.028515 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dd7dd6-2f8c-4f36-9259-1e555fd422d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:31.029172 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dd7dd6-2f8c-4f36-9259-1e555fd422d4 admin admin] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:31.029452 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dd7dd6-2f8c-4f36-9259-1e555fd422d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:31.029723 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dd7dd6-2f8c-4f36-9259-1e555fd422d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:31.030347 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dd7dd6-2f8c-4f36-9259-1e555fd422d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:31.032236 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dd7dd6-2f8c-4f36-9259-1e555fd422d4 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:31.232664 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-27dc70d6-52dc-4897-9deb-bfddd89e289b tempest-VolumeQuotaClassesTest-1971834422 tempest-VolumeQuotaClassesTest-1971834422-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3802464be6864b5c88690f92b6e816b8', 'request_id': 'req-27dc70d6-52dc-4897-9deb-bfddd89e289b'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:31.232664 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-27dc70d6-52dc-4897-9deb-bfddd89e289b tempest-VolumeQuotaClassesTest-1971834422 tempest-VolumeQuotaClassesTest-1971834422-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3802464be6864b5c88690f92b6e816b8', 'request_id': 'req-27dc70d6-52dc-4897-9deb-bfddd89e289b'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:31.321105 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 985/1958] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 18 22:01:30 2022] POST /identity/v3/projects => generated 379 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 22:01:31.323941 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dd7dd6-2f8c-4f36-9259-1e555fd422d4 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:31.338221 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-27dc70d6-52dc-4897-9deb-bfddd89e289b tempest-VolumeQuotaClassesTest-1971834422 tempest-VolumeQuotaClassesTest-1971834422-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3802464be6864b5c88690f92b6e816b8', 'request_id': 'req-27dc70d6-52dc-4897-9deb-bfddd89e289b'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:31.364485 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-27dc70d6-52dc-4897-9deb-bfddd89e289b tempest-VolumeQuotaClassesTest-1971834422 tempest-VolumeQuotaClassesTest-1971834422-project-admin] The token cache is being invalidate because project 3802464be6864b5c88690f92b6e816b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88096) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 22:01:31.366699 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-27dc70d6-52dc-4897-9deb-bfddd89e289b tempest-VolumeQuotaClassesTest-1971834422 tempest-VolumeQuotaClassesTest-1971834422-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:31.366699 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-27dc70d6-52dc-4897-9deb-bfddd89e289b tempest-VolumeQuotaClassesTest-1971834422 tempest-VolumeQuotaClassesTest-1971834422-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:31.367884 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 974/1959] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 18 22:01:30 2022] DELETE /identity/v3/projects/3802464be6864b5c88690f92b6e816b8 => generated 0 bytes in 679 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:01:31.371882 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dc70d6-52dc-4897-9deb-bfddd89e289b tempest-VolumeQuotaClassesTest-1971834422 tempest-VolumeQuotaClassesTest-1971834422-project-admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:31.373631 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-27dc70d6-52dc-4897-9deb-bfddd89e289b tempest-VolumeQuotaClassesTest-1971834422 tempest-VolumeQuotaClassesTest-1971834422-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:31.397657 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dd7dd6-2f8c-4f36-9259-1e555fd422d4 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:31.410813 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4e5cc1-5c2a-421b-8c7e-b1b8adf22a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:31.412150 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4e5cc1-5c2a-421b-8c7e-b1b8adf22a0d admin admin] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:31.414065 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4e5cc1-5c2a-421b-8c7e-b1b8adf22a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:31.414811 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4e5cc1-5c2a-421b-8c7e-b1b8adf22a0d admin admin] PATH_INFO: `/v3/users` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:31.416396 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4e5cc1-5c2a-421b-8c7e-b1b8adf22a0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:31.419440 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4e5cc1-5c2a-421b-8c7e-b1b8adf22a0d admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:31.447508 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dc70d6-52dc-4897-9deb-bfddd89e289b tempest-VolumeQuotaClassesTest-1971834422 tempest-VolumeQuotaClassesTest-1971834422-project-admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:31.500815 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1085de-6133-4ab3-8797-35e4f5f94ff7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22b6a7c36f8a4795a75271b8079821c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:31.501578 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1085de-6133-4ab3-8797-35e4f5f94ff7 service cinder] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:31.502156 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1085de-6133-4ab3-8797-35e4f5f94ff7 service cinder] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:31.502861 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1085de-6133-4ab3-8797-35e4f5f94ff7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:31.504880 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-bb1085de-6133-4ab3-8797-35e4f5f94ff7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:31.553679 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 986/1960] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 18 22:01:31 2022] POST /identity/v3/users => generated 290 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 22:01:31.557383 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4e5cc1-5c2a-421b-8c7e-b1b8adf22a0d admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:31.558982 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-0a4e5cc1-5c2a-421b-8c7e-b1b8adf22a0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:31.565421 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1085de-6133-4ab3-8797-35e4f5f94ff7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:31.566844 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1085de-6133-4ab3-8797-35e4f5f94ff7 service cinder] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:31.570941 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4e5cc1-5c2a-421b-8c7e-b1b8adf22a0d admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:31.576164 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad754c30-1099-4068-b756-f30352381dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:31.576423 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 975/1961] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:01:31 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:01:31.576798 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad754c30-1099-4068-b756-f30352381dba admin admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:31.577085 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad754c30-1099-4068-b756-f30352381dba admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:31.577510 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad754c30-1099-4068-b756-f30352381dba admin admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:31.578228 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad754c30-1099-4068-b756-f30352381dba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:31.579952 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad754c30-1099-4068-b756-f30352381dba admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:31.592637 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 987/1962] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:01:31 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 22:01:31.595811 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1085de-6133-4ab3-8797-35e4f5f94ff7 service cinder] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:31.607235 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1085de-6133-4ab3-8797-35e4f5f94ff7 service cinder] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:31.612751 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391b5488-7b26-4522-878d-a398211e38b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:31.613358 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391b5488-7b26-4522-878d-a398211e38b9 admin admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:31.613642 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391b5488-7b26-4522-878d-a398211e38b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:31.619633 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391b5488-7b26-4522-878d-a398211e38b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:31.619633 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391b5488-7b26-4522-878d-a398211e38b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:31.619633 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391b5488-7b26-4522-878d-a398211e38b9 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:31.625945 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 976/1963] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:01:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:01:31.630639 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad754c30-1099-4068-b756-f30352381dba admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:31.640882 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad754c30-1099-4068-b756-f30352381dba admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:31.645715 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dce361-ec6b-4f8c-9543-1ccbd21c2f3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:31.649030 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dce361-ec6b-4f8c-9543-1ccbd21c2f3f admin admin] REQUEST_METHOD: `PUT` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:31.649030 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dce361-ec6b-4f8c-9543-1ccbd21c2f3f admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:31.649030 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dce361-ec6b-4f8c-9543-1ccbd21c2f3f admin admin] PATH_INFO: `/v3/projects/3ea86b96f71e463c84e9e918840fc615/users/a25bf71b515449cd907b4c03e3cf9eb5/roles/de8f2438056f4af9879423f8a59e0e0b` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:31.662282 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dce361-ec6b-4f8c-9543-1ccbd21c2f3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ea86b96f71e463c84e9e918840fc615, user_id=a25bf71b515449cd907b4c03e3cf9eb5, role_id=de8f2438056f4af9879423f8a59e0e0b)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:31.665201 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dce361-ec6b-4f8c-9543-1ccbd21c2f3f admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:31.777197 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 988/1964] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 18 22:01:31 2022] PUT /identity/v3/projects/3ea86b96f71e463c84e9e918840fc615/users/a25bf71b515449cd907b4c03e3cf9eb5/roles/de8f2438056f4af9879423f8a59e0e0b => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:01:31.789410 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce849029-e0b7-4027-8d30-a5c398b71553 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:31.789704 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce849029-e0b7-4027-8d30-a5c398b71553 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:31.790000 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce849029-e0b7-4027-8d30-a5c398b71553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:31.820391 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-ce849029-e0b7-4027-8d30-a5c398b71553 None None] MFA Rules not processed for user `a25bf71b515449cd907b4c03e3cf9eb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:01:31.821663 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-ce849029-e0b7-4027-8d30-a5c398b71553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:31.886561 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 977/1965] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:01:31 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:01:31.891195 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dce361-ec6b-4f8c-9543-1ccbd21c2f3f admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:31.958452 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dce361-ec6b-4f8c-9543-1ccbd21c2f3f admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:31.963183 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910ee459-73b2-4644-bc29-3a0d7c716703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:31.963785 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910ee459-73b2-4644-bc29-3a0d7c716703 admin admin] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:31.964065 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910ee459-73b2-4644-bc29-3a0d7c716703 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:31.964337 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910ee459-73b2-4644-bc29-3a0d7c716703 admin admin] PATH_INFO: `/v3/projects` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:31.965004 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910ee459-73b2-4644-bc29-3a0d7c716703 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:31.966910 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910ee459-73b2-4644-bc29-3a0d7c716703 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:32.118893 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce849029-e0b7-4027-8d30-a5c398b71553 None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:32.131222 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 989/1966] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 18 22:01:31 2022] POST /identity/v3/projects => generated 379 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 22:01:32.135717 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce849029-e0b7-4027-8d30-a5c398b71553 None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:32.202916 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86bb508-26d4-48ca-9017-540f2edd4af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:32.203717 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86bb508-26d4-48ca-9017-540f2edd4af9 admin admin] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:32.204088 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86bb508-26d4-48ca-9017-540f2edd4af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:32.204476 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86bb508-26d4-48ca-9017-540f2edd4af9 admin admin] PATH_INFO: `/v3/users` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:32.205742 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86bb508-26d4-48ca-9017-540f2edd4af9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:32.208087 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86bb508-26d4-48ca-9017-540f2edd4af9 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:32.215926 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910ee459-73b2-4644-bc29-3a0d7c716703 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:32.217712 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-910ee459-73b2-4644-bc29-3a0d7c716703 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:32.236320 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910ee459-73b2-4644-bc29-3a0d7c716703 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:32.242183 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be626b70-83d9-4566-a0ae-dec7f313136f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:32.242899 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be626b70-83d9-4566-a0ae-dec7f313136f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:32.243186 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be626b70-83d9-4566-a0ae-dec7f313136f admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:32.243465 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be626b70-83d9-4566-a0ae-dec7f313136f admin admin] PATH_INFO: `/v3/users/b806d412507c4582bac5b20053835386` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:32.244740 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be626b70-83d9-4566-a0ae-dec7f313136f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b806d412507c4582bac5b20053835386)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:32.246706 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be626b70-83d9-4566-a0ae-dec7f313136f admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:32.321504 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 978/1967] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 18 22:01:32 2022] POST /identity/v3/users => generated 296 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 22:01:32.324686 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86bb508-26d4-48ca-9017-540f2edd4af9 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:32.332359 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86bb508-26d4-48ca-9017-540f2edd4af9 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:32.337085 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d5ac21-41c2-4484-a1a9-d5bfacc2ac61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:32.337682 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d5ac21-41c2-4484-a1a9-d5bfacc2ac61 admin admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:32.337964 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d5ac21-41c2-4484-a1a9-d5bfacc2ac61 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:32.338236 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d5ac21-41c2-4484-a1a9-d5bfacc2ac61 admin admin] PATH_INFO: `/v3/roles` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:32.338874 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d5ac21-41c2-4484-a1a9-d5bfacc2ac61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:32.340481 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d5ac21-41c2-4484-a1a9-d5bfacc2ac61 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:32.353345 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 979/1968] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:01:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:01:32.362485 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d5ac21-41c2-4484-a1a9-d5bfacc2ac61 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:32.373313 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d5ac21-41c2-4484-a1a9-d5bfacc2ac61 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:32.378233 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc58d242-c5dc-4ac7-8fe7-ca2ca10d32b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:32.378962 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc58d242-c5dc-4ac7-8fe7-ca2ca10d32b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:32.379585 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc58d242-c5dc-4ac7-8fe7-ca2ca10d32b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:32.379700 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc58d242-c5dc-4ac7-8fe7-ca2ca10d32b6 admin admin] PATH_INFO: `/v3/projects/2c03ab9912a14887a0bb67c71a29ff6d/users/f6a3652a62794d7692b167c49e37ce25/roles/0833202e2a3d47d1b6b3af57006641b1` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:32.394964 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc58d242-c5dc-4ac7-8fe7-ca2ca10d32b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c03ab9912a14887a0bb67c71a29ff6d, user_id=f6a3652a62794d7692b167c49e37ce25, role_id=0833202e2a3d47d1b6b3af57006641b1)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:32.397684 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc58d242-c5dc-4ac7-8fe7-ca2ca10d32b6 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:32.455139 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-be626b70-83d9-4566-a0ae-dec7f313136f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b806d412507c4582bac5b20053835386'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:32.462291 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-be626b70-83d9-4566-a0ae-dec7f313136f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b806d412507c4582bac5b20053835386'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:32.463051 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-be626b70-83d9-4566-a0ae-dec7f313136f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b806d412507c4582bac5b20053835386'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:32.484275 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 980/1969] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 18 22:01:32 2022] PUT /identity/v3/projects/2c03ab9912a14887a0bb67c71a29ff6d/users/f6a3652a62794d7692b167c49e37ce25/roles/0833202e2a3d47d1b6b3af57006641b1 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:01:32.487561 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-be626b70-83d9-4566-a0ae-dec7f313136f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b806d412507c4582bac5b20053835386'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:32.490217 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc58d242-c5dc-4ac7-8fe7-ca2ca10d32b6 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:32.560377 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc58d242-c5dc-4ac7-8fe7-ca2ca10d32b6 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:32.566017 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11868ea7-28fc-42ad-8b3a-e6680c47d66d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:32.576945 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11868ea7-28fc-42ad-8b3a-e6680c47d66d admin admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:32.576945 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11868ea7-28fc-42ad-8b3a-e6680c47d66d admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:32.576945 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11868ea7-28fc-42ad-8b3a-e6680c47d66d admin admin] PATH_INFO: `/v3/roles` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:32.576945 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11868ea7-28fc-42ad-8b3a-e6680c47d66d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:32.576945 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11868ea7-28fc-42ad-8b3a-e6680c47d66d admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:32.580586 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 981/1970] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:01:32 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:01:32.584716 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11868ea7-28fc-42ad-8b3a-e6680c47d66d admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:32.595788 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11868ea7-28fc-42ad-8b3a-e6680c47d66d admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:32.600364 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-be626b70-83d9-4566-a0ae-dec7f313136f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b806d412507c4582bac5b20053835386'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:32.601296 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf37c2a-69a0-46c3-8634-06ec6c71c276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:32.602285 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf37c2a-69a0-46c3-8634-06ec6c71c276 admin admin] REQUEST_METHOD: `PUT` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:32.602630 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf37c2a-69a0-46c3-8634-06ec6c71c276 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:32.602917 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf37c2a-69a0-46c3-8634-06ec6c71c276 admin admin] PATH_INFO: `/v3/projects/2c03ab9912a14887a0bb67c71a29ff6d/users/f6a3652a62794d7692b167c49e37ce25/roles/0833202e2a3d47d1b6b3af57006641b1` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:32.605527 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf37c2a-69a0-46c3-8634-06ec6c71c276 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c03ab9912a14887a0bb67c71a29ff6d, user_id=f6a3652a62794d7692b167c49e37ce25, role_id=0833202e2a3d47d1b6b3af57006641b1)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:32.607780 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf37c2a-69a0-46c3-8634-06ec6c71c276 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:32.618824 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 990/1971] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 18 22:01:32 2022] DELETE /identity/v3/users/b806d412507c4582bac5b20053835386 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 22:01:32.623366 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 982/1972] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 18 22:01:32 2022] PUT /identity/v3/projects/2c03ab9912a14887a0bb67c71a29ff6d/users/f6a3652a62794d7692b167c49e37ce25/roles/0833202e2a3d47d1b6b3af57006641b1 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:01:32.628780 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8216de-08ad-4141-88ea-92d4732180af None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:32.628780 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8216de-08ad-4141-88ea-92d4732180af None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:32.636737 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:01:32.639542 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45384126-dfc4-424e-9878-fe4215aef9d3 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:32.639698 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8216de-08ad-4141-88ea-92d4732180af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:32.640009 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45384126-dfc4-424e-9878-fe4215aef9d3 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:32.640364 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45384126-dfc4-424e-9878-fe4215aef9d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:32.670148 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-7f8216de-08ad-4141-88ea-92d4732180af None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:01:32.671409 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-7f8216de-08ad-4141-88ea-92d4732180af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:32.674433 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-45384126-dfc4-424e-9878-fe4215aef9d3 None None] MFA Rules not processed for user `f6a3652a62794d7692b167c49e37ce25`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:01:32.675845 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-45384126-dfc4-424e-9878-fe4215aef9d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:32.761489 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 991/1973] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:01:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:01:32.767875 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 983/1974] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:01:32 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:01:32.780460 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8216de-08ad-4141-88ea-92d4732180af None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:32.782062 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-7f8216de-08ad-4141-88ea-92d4732180af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:32.786154 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45384126-dfc4-424e-9878-fe4215aef9d3 None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:32.787875 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-45384126-dfc4-424e-9878-fe4215aef9d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:32.907156 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45384126-dfc4-424e-9878-fe4215aef9d3 None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:32.912285 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15227f2-665b-4f99-a056-6e08c6e39687 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a937971ad1a4b0c8697c764f214d446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:32.912938 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8216de-08ad-4141-88ea-92d4732180af None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:32.913747 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15227f2-665b-4f99-a056-6e08c6e39687 service neutron] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:32.914349 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15227f2-665b-4f99-a056-6e08c6e39687 service neutron] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:32.914887 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15227f2-665b-4f99-a056-6e08c6e39687 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:32.917572 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a2df3f-cd54-42d9-8b50-e198c07e8fe2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22b6a7c36f8a4795a75271b8079821c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:32.919026 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a2df3f-cd54-42d9-8b50-e198c07e8fe2 service cinder] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:32.919026 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a2df3f-cd54-42d9-8b50-e198c07e8fe2 service cinder] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:32.919026 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a2df3f-cd54-42d9-8b50-e198c07e8fe2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:32.926777 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15227f2-665b-4f99-a056-6e08c6e39687 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:32.928290 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15227f2-665b-4f99-a056-6e08c6e39687 service neutron] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:32.930468 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a2df3f-cd54-42d9-8b50-e198c07e8fe2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:32.932242 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a2df3f-cd54-42d9-8b50-e198c07e8fe2 service cinder] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:32.944891 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 984/1975] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:01:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:01:32.947457 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 992/1976] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:01:32 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 22:01:33.073880 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15227f2-665b-4f99-a056-6e08c6e39687 service neutron] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:33.075393 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-d15227f2-665b-4f99-a056-6e08c6e39687 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:33.088410 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15227f2-665b-4f99-a056-6e08c6e39687 service neutron] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:33.092768 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d286721f-e56a-4928-a25e-b7429384464c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22b6a7c36f8a4795a75271b8079821c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:33.092893 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d286721f-e56a-4928-a25e-b7429384464c service cinder] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:33.093213 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d286721f-e56a-4928-a25e-b7429384464c service cinder] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:33.093486 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d286721f-e56a-4928-a25e-b7429384464c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:33.095421 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-d286721f-e56a-4928-a25e-b7429384464c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:33.186106 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d286721f-e56a-4928-a25e-b7429384464c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:33.187590 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d286721f-e56a-4928-a25e-b7429384464c service cinder] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:33.203411 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 985/1977] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:01:33 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 22:01:33.256133 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:01:33.406645 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a2df3f-cd54-42d9-8b50-e198c07e8fe2 service cinder] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:33.407847 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-91a2df3f-cd54-42d9-8b50-e198c07e8fe2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:33.422523 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a2df3f-cd54-42d9-8b50-e198c07e8fe2 service cinder] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:33.427981 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce519b39-0393-47a6-a814-22bb3712c54e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:33.428641 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce519b39-0393-47a6-a814-22bb3712c54e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:33.428928 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce519b39-0393-47a6-a814-22bb3712c54e admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:33.429200 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce519b39-0393-47a6-a814-22bb3712c54e admin admin] PATH_INFO: `/v3/projects/896cd8e7ab354418b97d859effe899a2` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:33.430383 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce519b39-0393-47a6-a814-22bb3712c54e admin admin] RBAC: Authorizing `identity:delete_project(project_id=896cd8e7ab354418b97d859effe899a2)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:33.432307 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce519b39-0393-47a6-a814-22bb3712c54e admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:33.550801 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-ce519b39-0393-47a6-a814-22bb3712c54e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '896cd8e7ab354418b97d859effe899a2', 'request_id': 'req-ce519b39-0393-47a6-a814-22bb3712c54e'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:33.552378 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-ce519b39-0393-47a6-a814-22bb3712c54e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '896cd8e7ab354418b97d859effe899a2', 'request_id': 'req-ce519b39-0393-47a6-a814-22bb3712c54e'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:33.653539 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-ce519b39-0393-47a6-a814-22bb3712c54e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '896cd8e7ab354418b97d859effe899a2', 'request_id': 'req-ce519b39-0393-47a6-a814-22bb3712c54e'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:33.668219 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-ce519b39-0393-47a6-a814-22bb3712c54e admin admin] The token cache is being invalidate because project 896cd8e7ab354418b97d859effe899a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88097) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 22:01:33.668525 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-ce519b39-0393-47a6-a814-22bb3712c54e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:33.669261 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-ce519b39-0393-47a6-a814-22bb3712c54e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:33.670851 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 993/1978] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 18 22:01:33 2022] DELETE /identity/v3/projects/896cd8e7ab354418b97d859effe899a2 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:01:33.676376 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d286721f-e56a-4928-a25e-b7429384464c service cinder] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:33.698006 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d286721f-e56a-4928-a25e-b7429384464c service cinder] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:33.786885 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbddbde-888c-4504-b166-f86362b56793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:33.787554 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbddbde-888c-4504-b166-f86362b56793 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:33.787831 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbddbde-888c-4504-b166-f86362b56793 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:33.788103 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbddbde-888c-4504-b166-f86362b56793 admin admin] PATH_INFO: `/v3/users/143a3fccf2034035b69d32609e8e7507` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:33.789265 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbddbde-888c-4504-b166-f86362b56793 admin admin] RBAC: Authorizing `identity:delete_user(user_id=143a3fccf2034035b69d32609e8e7507)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:33.791248 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbddbde-888c-4504-b166-f86362b56793 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:33.985604 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-4bbddbde-888c-4504-b166-f86362b56793 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '143a3fccf2034035b69d32609e8e7507'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:33.994766 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-4bbddbde-888c-4504-b166-f86362b56793 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '143a3fccf2034035b69d32609e8e7507'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:33.999361 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-4bbddbde-888c-4504-b166-f86362b56793 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '143a3fccf2034035b69d32609e8e7507'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:33.999361 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-4bbddbde-888c-4504-b166-f86362b56793 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '143a3fccf2034035b69d32609e8e7507'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:34.011234 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-4bbddbde-888c-4504-b166-f86362b56793 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '143a3fccf2034035b69d32609e8e7507'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:34.077989 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 986/1979] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 18 22:01:33 2022] DELETE /identity/v3/users/143a3fccf2034035b69d32609e8e7507 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:01:34.573738 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:01:34.581698 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce519b39-0393-47a6-a814-22bb3712c54e admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:34.583764 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-ce519b39-0393-47a6-a814-22bb3712c54e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:34.599648 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce519b39-0393-47a6-a814-22bb3712c54e admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:34.670854 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b6eb7c-ee8d-4530-a53e-e4c3f1835d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:34.671575 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b6eb7c-ee8d-4530-a53e-e4c3f1835d38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:34.671868 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b6eb7c-ee8d-4530-a53e-e4c3f1835d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:34.672150 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b6eb7c-ee8d-4530-a53e-e4c3f1835d38 admin admin] PATH_INFO: `/v3/projects/210d5e02743d454b965f3a4ee6feab96` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:34.674274 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b6eb7c-ee8d-4530-a53e-e4c3f1835d38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=210d5e02743d454b965f3a4ee6feab96)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:34.676473 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b6eb7c-ee8d-4530-a53e-e4c3f1835d38 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:34.807344 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-b2b6eb7c-ee8d-4530-a53e-e4c3f1835d38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '210d5e02743d454b965f3a4ee6feab96', 'request_id': 'req-b2b6eb7c-ee8d-4530-a53e-e4c3f1835d38'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:34.813892 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-b2b6eb7c-ee8d-4530-a53e-e4c3f1835d38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '210d5e02743d454b965f3a4ee6feab96', 'request_id': 'req-b2b6eb7c-ee8d-4530-a53e-e4c3f1835d38'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:34.918320 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-b2b6eb7c-ee8d-4530-a53e-e4c3f1835d38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '210d5e02743d454b965f3a4ee6feab96', 'request_id': 'req-b2b6eb7c-ee8d-4530-a53e-e4c3f1835d38'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:34.930530 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-b2b6eb7c-ee8d-4530-a53e-e4c3f1835d38 admin admin] The token cache is being invalidate because project 210d5e02743d454b965f3a4ee6feab96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88097) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 22:01:34.930821 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-b2b6eb7c-ee8d-4530-a53e-e4c3f1835d38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:34.931449 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-b2b6eb7c-ee8d-4530-a53e-e4c3f1835d38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:34.933006 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 994/1980] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 18 22:01:34 2022] DELETE /identity/v3/projects/210d5e02743d454b965f3a4ee6feab96 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:01:34.938153 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5c7f1b-233d-4b75-9b9d-4fb9719e5730 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:34.938666 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5c7f1b-233d-4b75-9b9d-4fb9719e5730 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:34.938829 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5c7f1b-233d-4b75-9b9d-4fb9719e5730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:34.959786 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-1f5c7f1b-233d-4b75-9b9d-4fb9719e5730 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:01:34.961044 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-1f5c7f1b-233d-4b75-9b9d-4fb9719e5730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:35.026313 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 987/1981] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:01:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:01:35.035631 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c560e51b-f834-436b-9c6e-8b34638e07b9 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:35.035921 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c560e51b-f834-436b-9c6e-8b34638e07b9 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:35.036377 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c560e51b-f834-436b-9c6e-8b34638e07b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:35.056807 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-c560e51b-f834-436b-9c6e-8b34638e07b9 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:01:35.058039 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-c560e51b-f834-436b-9c6e-8b34638e07b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:35.067510 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 995/1982] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:01:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:01:35.072132 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5c7f1b-233d-4b75-9b9d-4fb9719e5730 None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:35.084071 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5c7f1b-233d-4b75-9b9d-4fb9719e5730 None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:35.089421 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f39c400-57e7-4feb-a0fa-e85b82e89630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:35.090037 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f39c400-57e7-4feb-a0fa-e85b82e89630 admin admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:35.090318 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f39c400-57e7-4feb-a0fa-e85b82e89630 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:35.090595 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f39c400-57e7-4feb-a0fa-e85b82e89630 admin admin] PATH_INFO: `/v3/domains` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:35.091416 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f39c400-57e7-4feb-a0fa-e85b82e89630 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 22:01:35.091905 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f39c400-57e7-4feb-a0fa-e85b82e89630 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:35.093869 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f39c400-57e7-4feb-a0fa-e85b82e89630 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:35.111308 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 988/1983] 10.222.0.27 () {58 vars in 1153 bytes} [Thu Aug 18 22:01:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 22:01:35.116314 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c560e51b-f834-436b-9c6e-8b34638e07b9 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:35.125783 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c560e51b-f834-436b-9c6e-8b34638e07b9 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:35.131811 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9816833e-ec8b-4091-853d-d6f7a7a6d559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:35.132567 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9816833e-ec8b-4091-853d-d6f7a7a6d559 admin admin] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:35.132950 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9816833e-ec8b-4091-853d-d6f7a7a6d559 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:35.133290 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9816833e-ec8b-4091-853d-d6f7a7a6d559 admin admin] PATH_INFO: `/v3/projects` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:35.134123 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9816833e-ec8b-4091-853d-d6f7a7a6d559 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:35.136157 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9816833e-ec8b-4091-853d-d6f7a7a6d559 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:35.164358 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:01:35.290413 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 996/1984] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 18 22:01:35 2022] POST /identity/v3/projects => generated 393 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 22:01:35.296039 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f39c400-57e7-4feb-a0fa-e85b82e89630 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:35.311805 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f39c400-57e7-4feb-a0fa-e85b82e89630 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:35.390996 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d61bdb9-2e22-4053-94d6-c4d1b9ae6a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:35.391458 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d61bdb9-2e22-4053-94d6-c4d1b9ae6a71 admin admin] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:35.391740 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d61bdb9-2e22-4053-94d6-c4d1b9ae6a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:35.392830 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d61bdb9-2e22-4053-94d6-c4d1b9ae6a71 admin admin] PATH_INFO: `/v3/users` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:35.393477 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d61bdb9-2e22-4053-94d6-c4d1b9ae6a71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:35.395429 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d61bdb9-2e22-4053-94d6-c4d1b9ae6a71 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:35.499515 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 989/1985] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 18 22:01:35 2022] POST /identity/v3/users => generated 297 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 22:01:35.500839 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9816833e-ec8b-4091-853d-d6f7a7a6d559 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:35.512240 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9816833e-ec8b-4091-853d-d6f7a7a6d559 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:35.519907 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedb134b-5d47-4b91-b5bc-d77a9378ce6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:35.520654 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedb134b-5d47-4b91-b5bc-d77a9378ce6e admin admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:35.521034 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedb134b-5d47-4b91-b5bc-d77a9378ce6e admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:35.521405 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedb134b-5d47-4b91-b5bc-d77a9378ce6e admin admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:35.522131 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedb134b-5d47-4b91-b5bc-d77a9378ce6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:35.524273 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedb134b-5d47-4b91-b5bc-d77a9378ce6e admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:35.538775 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 997/1986] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:01:35 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:01:35.543104 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d61bdb9-2e22-4053-94d6-c4d1b9ae6a71 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:35.553324 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedb134b-5d47-4b91-b5bc-d77a9378ce6e admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:35.555229 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-fedb134b-5d47-4b91-b5bc-d77a9378ce6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:35.560172 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d61bdb9-2e22-4053-94d6-c4d1b9ae6a71 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:35.563099 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4366d90-ea69-4499-b051-ff1f3aa69837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:35.563721 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4366d90-ea69-4499-b051-ff1f3aa69837 admin admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:35.565642 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4366d90-ea69-4499-b051-ff1f3aa69837 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:35.565916 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4366d90-ea69-4499-b051-ff1f3aa69837 admin admin] PATH_INFO: `/v3/roles` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:35.566579 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4366d90-ea69-4499-b051-ff1f3aa69837 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:35.568190 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4366d90-ea69-4499-b051-ff1f3aa69837 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:35.572341 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedb134b-5d47-4b91-b5bc-d77a9378ce6e admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:35.577839 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e0dbad-6b16-430d-b112-bc1f31685967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:35.578513 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e0dbad-6b16-430d-b112-bc1f31685967 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:35.578760 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e0dbad-6b16-430d-b112-bc1f31685967 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:35.581113 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 990/1987] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:01:35 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 22:01:35.581241 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e0dbad-6b16-430d-b112-bc1f31685967 admin admin] PATH_INFO: `/v3/users/71b1bd20bd1a431e988db9511611d699` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:35.583382 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e0dbad-6b16-430d-b112-bc1f31685967 admin admin] RBAC: Authorizing `identity:delete_user(user_id=71b1bd20bd1a431e988db9511611d699)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:35.585082 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4366d90-ea69-4499-b051-ff1f3aa69837 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:35.585823 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e0dbad-6b16-430d-b112-bc1f31685967 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:35.614880 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4366d90-ea69-4499-b051-ff1f3aa69837 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:35.620023 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b861e0-3681-4463-8f14-bb92b7824e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:35.620727 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b861e0-3681-4463-8f14-bb92b7824e1b admin admin] REQUEST_METHOD: `PUT` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:35.621075 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b861e0-3681-4463-8f14-bb92b7824e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:35.621384 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b861e0-3681-4463-8f14-bb92b7824e1b admin admin] PATH_INFO: `/v3/projects/35501ba83ee34e4da7966cb4726cd8b5/users/0d5feb6ed8b941ac8b93914ebc039844/roles/de8f2438056f4af9879423f8a59e0e0b` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:35.640072 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b861e0-3681-4463-8f14-bb92b7824e1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=35501ba83ee34e4da7966cb4726cd8b5, user_id=0d5feb6ed8b941ac8b93914ebc039844, role_id=de8f2438056f4af9879423f8a59e0e0b)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:35.645075 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b861e0-3681-4463-8f14-bb92b7824e1b admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:35.727516 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 991/1988] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 18 22:01:35 2022] PUT /identity/v3/projects/35501ba83ee34e4da7966cb4726cd8b5/users/0d5feb6ed8b941ac8b93914ebc039844/roles/de8f2438056f4af9879423f8a59e0e0b => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 22:01:35.727516 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b861e0-3681-4463-8f14-bb92b7824e1b admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:35.728418 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-04b861e0-3681-4463-8f14-bb92b7824e1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:35.797600 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b861e0-3681-4463-8f14-bb92b7824e1b admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:35.804399 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b489e069-b11e-48b5-b5fe-6f5f91d474f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:35.805092 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b489e069-b11e-48b5-b5fe-6f5f91d474f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:35.805435 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b489e069-b11e-48b5-b5fe-6f5f91d474f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:35.805710 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b489e069-b11e-48b5-b5fe-6f5f91d474f7 admin admin] PATH_INFO: `/v3/users/f3e3074926664c989f482e1d6c8735bb` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:35.807090 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b489e069-b11e-48b5-b5fe-6f5f91d474f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3e3074926664c989f482e1d6c8735bb)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:35.809118 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b489e069-b11e-48b5-b5fe-6f5f91d474f7 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:35.866930 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-b5e0dbad-6b16-430d-b112-bc1f31685967 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71b1bd20bd1a431e988db9511611d699'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:35.877064 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-b5e0dbad-6b16-430d-b112-bc1f31685967 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71b1bd20bd1a431e988db9511611d699'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:35.877064 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-b5e0dbad-6b16-430d-b112-bc1f31685967 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71b1bd20bd1a431e988db9511611d699'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:35.890316 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-b5e0dbad-6b16-430d-b112-bc1f31685967 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71b1bd20bd1a431e988db9511611d699'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:35.958398 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-b5e0dbad-6b16-430d-b112-bc1f31685967 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71b1bd20bd1a431e988db9511611d699'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:35.966642 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 998/1989] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 18 22:01:35 2022] DELETE /identity/v3/users/71b1bd20bd1a431e988db9511611d699 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:01:35.968462 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1f0d93-5631-4d98-b119-905c61039626 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:35.968462 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1f0d93-5631-4d98-b119-905c61039626 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:35.972484 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1f0d93-5631-4d98-b119-905c61039626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:36.007586 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-5b1f0d93-5631-4d98-b119-905c61039626 None None] MFA Rules not processed for user `0d5feb6ed8b941ac8b93914ebc039844`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:01:36.008404 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-b489e069-b11e-48b5-b5fe-6f5f91d474f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3e3074926664c989f482e1d6c8735bb'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:36.008901 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-5b1f0d93-5631-4d98-b119-905c61039626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:36.019123 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-b489e069-b11e-48b5-b5fe-6f5f91d474f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3e3074926664c989f482e1d6c8735bb'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:36.019481 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-b489e069-b11e-48b5-b5fe-6f5f91d474f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3e3074926664c989f482e1d6c8735bb'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:36.020702 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-b489e069-b11e-48b5-b5fe-6f5f91d474f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3e3074926664c989f482e1d6c8735bb'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:36.046380 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-b489e069-b11e-48b5-b5fe-6f5f91d474f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3e3074926664c989f482e1d6c8735bb'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:36.087346 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 999/1990] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:01:35 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:01:36.089314 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde7d722-09d2-482f-bf0e-675c88fc5106 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:36.089773 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde7d722-09d2-482f-bf0e-675c88fc5106 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:36.090202 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde7d722-09d2-482f-bf0e-675c88fc5106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:36.111343 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-cde7d722-09d2-482f-bf0e-675c88fc5106 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:01:36.113033 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-cde7d722-09d2-482f-bf0e-675c88fc5106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:36.137138 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 992/1991] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 18 22:01:35 2022] DELETE /identity/v3/users/f3e3074926664c989f482e1d6c8735bb => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:01:36.138613 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b489e069-b11e-48b5-b5fe-6f5f91d474f7 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:36.140193 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-b489e069-b11e-48b5-b5fe-6f5f91d474f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:36.185690 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1000/1992] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:01:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:01:36.185690 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f503cc86-65e4-42d4-ae2f-e0efb0ebff77 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:36.186089 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f503cc86-65e4-42d4-ae2f-e0efb0ebff77 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:36.186631 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f503cc86-65e4-42d4-ae2f-e0efb0ebff77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:36.206706 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-f503cc86-65e4-42d4-ae2f-e0efb0ebff77 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:01:36.208081 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-f503cc86-65e4-42d4-ae2f-e0efb0ebff77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:36.230557 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b489e069-b11e-48b5-b5fe-6f5f91d474f7 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:36.239078 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfd00ec-0263-4f14-93a8-6fa955011fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:36.240293 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfd00ec-0263-4f14-93a8-6fa955011fa0 admin admin] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:36.240581 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfd00ec-0263-4f14-93a8-6fa955011fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:36.240930 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfd00ec-0263-4f14-93a8-6fa955011fa0 admin admin] PATH_INFO: `/v3/projects` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:36.241855 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfd00ec-0263-4f14-93a8-6fa955011fa0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:36.244424 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfd00ec-0263-4f14-93a8-6fa955011fa0 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:36.281945 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1001/1993] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:01:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:01:36.284009 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f503cc86-65e4-42d4-ae2f-e0efb0ebff77 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:36.293457 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-f503cc86-65e4-42d4-ae2f-e0efb0ebff77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:36.343087 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 993/1994] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 18 22:01:36 2022] POST /identity/v3/projects => generated 391 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 22:01:36.343180 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfd00ec-0263-4f14-93a8-6fa955011fa0 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:36.348629 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-9bfd00ec-0263-4f14-93a8-6fa955011fa0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:36.395655 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f503cc86-65e4-42d4-ae2f-e0efb0ebff77 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:36.398291 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:01:36.431496 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfd00ec-0263-4f14-93a8-6fa955011fa0 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:36.436692 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf4aa69-18cf-4174-952c-ac9ad72490dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a937971ad1a4b0c8697c764f214d446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:36.437410 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf4aa69-18cf-4174-952c-ac9ad72490dc service neutron] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:36.437785 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf4aa69-18cf-4174-952c-ac9ad72490dc service neutron] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:36.438162 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf4aa69-18cf-4174-952c-ac9ad72490dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:36.499401 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcac0db-ff27-40b3-857d-539313ab027b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a937971ad1a4b0c8697c764f214d446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:36.500430 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcac0db-ff27-40b3-857d-539313ab027b service neutron] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:36.500908 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcac0db-ff27-40b3-857d-539313ab027b service neutron] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:36.502039 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcac0db-ff27-40b3-857d-539313ab027b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:36.554144 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf4aa69-18cf-4174-952c-ac9ad72490dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:36.555610 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf4aa69-18cf-4174-952c-ac9ad72490dc service neutron] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:36.570593 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 994/1995] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:01:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:01:36.571490 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf4aa69-18cf-4174-952c-ac9ad72490dc service neutron] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:36.583514 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf4aa69-18cf-4174-952c-ac9ad72490dc service neutron] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:36.589062 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ca4a65-2072-49db-a21b-f8b193212cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:36.590177 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ca4a65-2072-49db-a21b-f8b193212cfd admin admin] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:36.590651 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ca4a65-2072-49db-a21b-f8b193212cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:36.591077 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ca4a65-2072-49db-a21b-f8b193212cfd admin admin] PATH_INFO: `/v3/users` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:36.591950 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ca4a65-2072-49db-a21b-f8b193212cfd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:36.594268 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ca4a65-2072-49db-a21b-f8b193212cfd admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:36.594739 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcac0db-ff27-40b3-857d-539313ab027b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:36.597314 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcac0db-ff27-40b3-857d-539313ab027b service neutron] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:36.610448 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1002/1996] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:01:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:01:36.707513 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 995/1997] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 18 22:01:36 2022] POST /identity/v3/users => generated 302 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 22:01:36.711612 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcac0db-ff27-40b3-857d-539313ab027b service neutron] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:36.722057 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcac0db-ff27-40b3-857d-539313ab027b service neutron] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:36.726730 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db14ced-2b70-4ba1-a92b-ff69551e6b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:36.727307 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db14ced-2b70-4ba1-a92b-ff69551e6b7d admin admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:36.727588 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db14ced-2b70-4ba1-a92b-ff69551e6b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:36.727860 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db14ced-2b70-4ba1-a92b-ff69551e6b7d admin admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:36.728545 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db14ced-2b70-4ba1-a92b-ff69551e6b7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:36.730159 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db14ced-2b70-4ba1-a92b-ff69551e6b7d admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:36.740927 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1003/1998] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:01:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:01:36.745397 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ca4a65-2072-49db-a21b-f8b193212cfd admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:36.755589 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ca4a65-2072-49db-a21b-f8b193212cfd admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:36.760237 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5c30e6-f328-45d6-8be3-9dec8c93391b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:36.760911 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5c30e6-f328-45d6-8be3-9dec8c93391b admin admin] REQUEST_METHOD: `PUT` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:36.761190 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5c30e6-f328-45d6-8be3-9dec8c93391b admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:36.761464 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5c30e6-f328-45d6-8be3-9dec8c93391b admin admin] PATH_INFO: `/v3/projects/6cf25c6e8dd8408ba26dbdc76619fc4f/users/8a775fe43a294c47b834babbb2ab13fb/roles/0833202e2a3d47d1b6b3af57006641b1` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:36.784481 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db14ced-2b70-4ba1-a92b-ff69551e6b7d admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:36.787429 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-1db14ced-2b70-4ba1-a92b-ff69551e6b7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:36.794453 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5c30e6-f328-45d6-8be3-9dec8c93391b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cf25c6e8dd8408ba26dbdc76619fc4f, user_id=8a775fe43a294c47b834babbb2ab13fb, role_id=0833202e2a3d47d1b6b3af57006641b1)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:36.802896 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5c30e6-f328-45d6-8be3-9dec8c93391b admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:36.826886 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db14ced-2b70-4ba1-a92b-ff69551e6b7d admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:36.826886 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ae41c3-f8ab-404d-87d1-1e13d261dd04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:36.826886 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ae41c3-f8ab-404d-87d1-1e13d261dd04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:36.826886 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ae41c3-f8ab-404d-87d1-1e13d261dd04 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:36.827269 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ae41c3-f8ab-404d-87d1-1e13d261dd04 admin admin] PATH_INFO: `/v3/users/093ed86a33304fde999010cde45be396` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:36.827269 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ae41c3-f8ab-404d-87d1-1e13d261dd04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=093ed86a33304fde999010cde45be396)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:36.827269 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ae41c3-f8ab-404d-87d1-1e13d261dd04 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:36.927109 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 996/1999] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 18 22:01:36 2022] PUT /identity/v3/projects/6cf25c6e8dd8408ba26dbdc76619fc4f/users/8a775fe43a294c47b834babbb2ab13fb/roles/0833202e2a3d47d1b6b3af57006641b1 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:01:36.928552 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5c30e6-f328-45d6-8be3-9dec8c93391b admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:37.007099 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5c30e6-f328-45d6-8be3-9dec8c93391b admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:37.011762 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b999ed-ad2c-4990-b43c-a194b9f6a5a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:37.012399 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b999ed-ad2c-4990-b43c-a194b9f6a5a1 admin admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:37.012661 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b999ed-ad2c-4990-b43c-a194b9f6a5a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:37.019758 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b999ed-ad2c-4990-b43c-a194b9f6a5a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:37.019758 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b999ed-ad2c-4990-b43c-a194b9f6a5a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:37.019758 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b999ed-ad2c-4990-b43c-a194b9f6a5a1 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:37.025660 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 997/2000] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:01:36 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:01:37.029680 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b999ed-ad2c-4990-b43c-a194b9f6a5a1 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:37.039501 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b999ed-ad2c-4990-b43c-a194b9f6a5a1 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:37.044294 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8d1712-2ccb-432b-bef8-6970a7e8b4b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:37.045090 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8d1712-2ccb-432b-bef8-6970a7e8b4b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:37.045375 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8d1712-2ccb-432b-bef8-6970a7e8b4b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:37.045649 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8d1712-2ccb-432b-bef8-6970a7e8b4b1 admin admin] PATH_INFO: `/v3/projects/6cf25c6e8dd8408ba26dbdc76619fc4f/users/8a775fe43a294c47b834babbb2ab13fb/roles/0833202e2a3d47d1b6b3af57006641b1` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:37.047569 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8d1712-2ccb-432b-bef8-6970a7e8b4b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cf25c6e8dd8408ba26dbdc76619fc4f, user_id=8a775fe43a294c47b834babbb2ab13fb, role_id=0833202e2a3d47d1b6b3af57006641b1)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:37.050925 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8d1712-2ccb-432b-bef8-6970a7e8b4b1 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:37.060948 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 998/2001] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 18 22:01:37 2022] PUT /identity/v3/projects/6cf25c6e8dd8408ba26dbdc76619fc4f/users/8a775fe43a294c47b834babbb2ab13fb/roles/0833202e2a3d47d1b6b3af57006641b1 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 22:01:37.071872 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3796500c-11a5-47b4-9910-3a5d90c32d95 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:37.072172 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3796500c-11a5-47b4-9910-3a5d90c32d95 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:37.072439 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3796500c-11a5-47b4-9910-3a5d90c32d95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:37.090333 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-c0ae41c3-f8ab-404d-87d1-1e13d261dd04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '093ed86a33304fde999010cde45be396'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:37.099220 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-c0ae41c3-f8ab-404d-87d1-1e13d261dd04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '093ed86a33304fde999010cde45be396'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:37.099972 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-c0ae41c3-f8ab-404d-87d1-1e13d261dd04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '093ed86a33304fde999010cde45be396'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:37.101568 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-3796500c-11a5-47b4-9910-3a5d90c32d95 None None] MFA Rules not processed for user `8a775fe43a294c47b834babbb2ab13fb`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:01:37.102778 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-3796500c-11a5-47b4-9910-3a5d90c32d95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:37.124282 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-c0ae41c3-f8ab-404d-87d1-1e13d261dd04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '093ed86a33304fde999010cde45be396'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:37.195987 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 999/2002] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:01:37 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 22:01:37.195987 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3796500c-11a5-47b4-9910-3a5d90c32d95 None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:37.195987 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-3796500c-11a5-47b4-9910-3a5d90c32d95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:37.241746 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-c0ae41c3-f8ab-404d-87d1-1e13d261dd04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '093ed86a33304fde999010cde45be396'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:37.249167 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1004/2003] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 18 22:01:36 2022] DELETE /identity/v3/users/093ed86a33304fde999010cde45be396 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 22:01:37.254352 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ae41c3-f8ab-404d-87d1-1e13d261dd04 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:37.255775 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-c0ae41c3-f8ab-404d-87d1-1e13d261dd04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:37.264048 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3796500c-11a5-47b4-9910-3a5d90c32d95 None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:37.310347 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:01:37.341725 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca6988d-f920-4530-8801-2072a4a7d837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:37.342590 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ae41c3-f8ab-404d-87d1-1e13d261dd04 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:37.343093 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca6988d-f920-4530-8801-2072a4a7d837 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:37.343379 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca6988d-f920-4530-8801-2072a4a7d837 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:37.343754 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca6988d-f920-4530-8801-2072a4a7d837 admin admin] PATH_INFO: `/v3/projects/7ffea6220e8b41959a064594eb5e46be` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:37.344996 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca6988d-f920-4530-8801-2072a4a7d837 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ffea6220e8b41959a064594eb5e46be)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:37.348891 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca6988d-f920-4530-8801-2072a4a7d837 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:37.348980 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42003897-0fd0-4051-bbd4-0b219bc573d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:37.348980 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42003897-0fd0-4051-bbd4-0b219bc573d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:37.349363 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42003897-0fd0-4051-bbd4-0b219bc573d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:37.349523 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42003897-0fd0-4051-bbd4-0b219bc573d6 admin admin] PATH_INFO: `/v3/projects/08da8ead2333416e98ab3b96df829abb` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:37.350768 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42003897-0fd0-4051-bbd4-0b219bc573d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08da8ead2333416e98ab3b96df829abb)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:37.353026 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42003897-0fd0-4051-bbd4-0b219bc573d6 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:37.499186 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-7ca6988d-f920-4530-8801-2072a4a7d837 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ffea6220e8b41959a064594eb5e46be', 'request_id': 'req-7ca6988d-f920-4530-8801-2072a4a7d837'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:37.504814 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-7ca6988d-f920-4530-8801-2072a4a7d837 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ffea6220e8b41959a064594eb5e46be', 'request_id': 'req-7ca6988d-f920-4530-8801-2072a4a7d837'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:37.521531 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-42003897-0fd0-4051-bbd4-0b219bc573d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08da8ead2333416e98ab3b96df829abb', 'request_id': 'req-42003897-0fd0-4051-bbd4-0b219bc573d6'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:37.527172 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-42003897-0fd0-4051-bbd4-0b219bc573d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08da8ead2333416e98ab3b96df829abb', 'request_id': 'req-42003897-0fd0-4051-bbd4-0b219bc573d6'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:37.620993 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-7ca6988d-f920-4530-8801-2072a4a7d837 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ffea6220e8b41959a064594eb5e46be', 'request_id': 'req-7ca6988d-f920-4530-8801-2072a4a7d837'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:37.633126 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-7ca6988d-f920-4530-8801-2072a4a7d837 admin admin] The token cache is being invalidate because project 7ffea6220e8b41959a064594eb5e46be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88096) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 22:01:37.633427 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-7ca6988d-f920-4530-8801-2072a4a7d837 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:37.634142 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-7ca6988d-f920-4530-8801-2072a4a7d837 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:37.635840 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1000/2004] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 18 22:01:37 2022] DELETE /identity/v3/projects/7ffea6220e8b41959a064594eb5e46be => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:01:37.636689 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca6988d-f920-4530-8801-2072a4a7d837 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:37.638010 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-7ca6988d-f920-4530-8801-2072a4a7d837 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:37.701432 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca6988d-f920-4530-8801-2072a4a7d837 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:37.722959 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-42003897-0fd0-4051-bbd4-0b219bc573d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08da8ead2333416e98ab3b96df829abb', 'request_id': 'req-42003897-0fd0-4051-bbd4-0b219bc573d6'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:37.737269 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-42003897-0fd0-4051-bbd4-0b219bc573d6 admin admin] The token cache is being invalidate because project 08da8ead2333416e98ab3b96df829abb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88097) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 22:01:37.737269 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-42003897-0fd0-4051-bbd4-0b219bc573d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:37.748434 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-42003897-0fd0-4051-bbd4-0b219bc573d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:37.750348 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1005/2005] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 18 22:01:37 2022] DELETE /identity/v3/projects/08da8ead2333416e98ab3b96df829abb => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:01:37.750889 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42003897-0fd0-4051-bbd4-0b219bc573d6 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:37.752896 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-42003897-0fd0-4051-bbd4-0b219bc573d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:37.759428 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262583de-8567-4bae-80b2-7bad1b522ed3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22b6a7c36f8a4795a75271b8079821c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:37.760048 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262583de-8567-4bae-80b2-7bad1b522ed3 service cinder] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:37.760331 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262583de-8567-4bae-80b2-7bad1b522ed3 service cinder] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:37.760664 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262583de-8567-4bae-80b2-7bad1b522ed3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:37.765756 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-262583de-8567-4bae-80b2-7bad1b522ed3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:37.824885 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42003897-0fd0-4051-bbd4-0b219bc573d6 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:37.830088 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76efc5e-c9cb-4d34-b4d8-cd9bad769ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:37.830829 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76efc5e-c9cb-4d34-b4d8-cd9bad769ec4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:37.831102 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76efc5e-c9cb-4d34-b4d8-cd9bad769ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:37.831382 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76efc5e-c9cb-4d34-b4d8-cd9bad769ec4 admin admin] PATH_INFO: `/v3/projects/af4b1c89ec6346408721a643b137ba08` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:37.832511 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76efc5e-c9cb-4d34-b4d8-cd9bad769ec4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af4b1c89ec6346408721a643b137ba08)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:37.833553 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262583de-8567-4bae-80b2-7bad1b522ed3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:37.834482 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76efc5e-c9cb-4d34-b4d8-cd9bad769ec4 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:37.835143 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262583de-8567-4bae-80b2-7bad1b522ed3 service cinder] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:37.846293 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1001/2006] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:01:37 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:01:37.847210 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262583de-8567-4bae-80b2-7bad1b522ed3 service cinder] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:37.848754 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-262583de-8567-4bae-80b2-7bad1b522ed3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:37.862975 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262583de-8567-4bae-80b2-7bad1b522ed3 service cinder] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:37.867938 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55467d8c-b4bf-4b51-9dd1-a6282ca8d79c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:37.868575 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55467d8c-b4bf-4b51-9dd1-a6282ca8d79c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:37.868881 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55467d8c-b4bf-4b51-9dd1-a6282ca8d79c admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:37.869177 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55467d8c-b4bf-4b51-9dd1-a6282ca8d79c admin admin] PATH_INFO: `/v3/users/35fc90d71a654879971cb5b90f9a9802` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:37.870301 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55467d8c-b4bf-4b51-9dd1-a6282ca8d79c admin admin] RBAC: Authorizing `identity:delete_user(user_id=35fc90d71a654879971cb5b90f9a9802)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:37.872283 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55467d8c-b4bf-4b51-9dd1-a6282ca8d79c admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:37.930000 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-d76efc5e-c9cb-4d34-b4d8-cd9bad769ec4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af4b1c89ec6346408721a643b137ba08', 'request_id': 'req-d76efc5e-c9cb-4d34-b4d8-cd9bad769ec4'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:37.935650 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-d76efc5e-c9cb-4d34-b4d8-cd9bad769ec4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af4b1c89ec6346408721a643b137ba08', 'request_id': 'req-d76efc5e-c9cb-4d34-b4d8-cd9bad769ec4'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:38.035464 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-d76efc5e-c9cb-4d34-b4d8-cd9bad769ec4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af4b1c89ec6346408721a643b137ba08', 'request_id': 'req-d76efc5e-c9cb-4d34-b4d8-cd9bad769ec4'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:38.047054 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-d76efc5e-c9cb-4d34-b4d8-cd9bad769ec4 admin admin] The token cache is being invalidate because project af4b1c89ec6346408721a643b137ba08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88097) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 22:01:38.047370 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-d76efc5e-c9cb-4d34-b4d8-cd9bad769ec4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:38.048025 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-d76efc5e-c9cb-4d34-b4d8-cd9bad769ec4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:38.050631 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1006/2007] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 18 22:01:37 2022] DELETE /identity/v3/projects/af4b1c89ec6346408721a643b137ba08 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:01:38.051487 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76efc5e-c9cb-4d34-b4d8-cd9bad769ec4 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:38.052806 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-d76efc5e-c9cb-4d34-b4d8-cd9bad769ec4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:38.079237 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-55467d8c-b4bf-4b51-9dd1-a6282ca8d79c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35fc90d71a654879971cb5b90f9a9802'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:38.086370 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-55467d8c-b4bf-4b51-9dd1-a6282ca8d79c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35fc90d71a654879971cb5b90f9a9802'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:38.087052 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-55467d8c-b4bf-4b51-9dd1-a6282ca8d79c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35fc90d71a654879971cb5b90f9a9802'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:38.087651 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-55467d8c-b4bf-4b51-9dd1-a6282ca8d79c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35fc90d71a654879971cb5b90f9a9802'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:38.101453 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-55467d8c-b4bf-4b51-9dd1-a6282ca8d79c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35fc90d71a654879971cb5b90f9a9802'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:38.120348 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76efc5e-c9cb-4d34-b4d8-cd9bad769ec4 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:38.125046 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2b5464-4eee-4693-8f14-ea81bbb049ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:38.125671 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2b5464-4eee-4693-8f14-ea81bbb049ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:38.125948 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2b5464-4eee-4693-8f14-ea81bbb049ec admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:38.126221 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2b5464-4eee-4693-8f14-ea81bbb049ec admin admin] PATH_INFO: `/v3/users/0f6f3ad5f73a40519ce6a4a79c5a49dd` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:38.128307 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2b5464-4eee-4693-8f14-ea81bbb049ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f6f3ad5f73a40519ce6a4a79c5a49dd)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:38.130357 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2b5464-4eee-4693-8f14-ea81bbb049ec admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:38.242576 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1002/2008] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 18 22:01:37 2022] DELETE /identity/v3/users/35fc90d71a654879971cb5b90f9a9802 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:01:38.243460 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55467d8c-b4bf-4b51-9dd1-a6282ca8d79c admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:38.244880 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-55467d8c-b4bf-4b51-9dd1-a6282ca8d79c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:38.307323 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55467d8c-b4bf-4b51-9dd1-a6282ca8d79c admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:38.311152 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5afd9f-ce24-4eeb-a70b-2a15b9dcc027 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22b6a7c36f8a4795a75271b8079821c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:38.311766 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5afd9f-ce24-4eeb-a70b-2a15b9dcc027 service cinder] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:38.312050 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5afd9f-ce24-4eeb-a70b-2a15b9dcc027 service cinder] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:38.312325 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5afd9f-ce24-4eeb-a70b-2a15b9dcc027 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:38.314262 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-eb5afd9f-ce24-4eeb-a70b-2a15b9dcc027 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:38.353555 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-9c2b5464-4eee-4693-8f14-ea81bbb049ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f6f3ad5f73a40519ce6a4a79c5a49dd'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:38.360638 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-9c2b5464-4eee-4693-8f14-ea81bbb049ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f6f3ad5f73a40519ce6a4a79c5a49dd'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:38.362259 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-9c2b5464-4eee-4693-8f14-ea81bbb049ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f6f3ad5f73a40519ce6a4a79c5a49dd'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:38.374766 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-9c2b5464-4eee-4693-8f14-ea81bbb049ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f6f3ad5f73a40519ce6a4a79c5a49dd'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:38.375762 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5afd9f-ce24-4eeb-a70b-2a15b9dcc027 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:38.377550 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5afd9f-ce24-4eeb-a70b-2a15b9dcc027 service cinder] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:38.386596 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1003/2009] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:01:38 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:01:38.387812 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315d0a1b-fb8f-4937-8e7d-03e49040307b None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:38.388096 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315d0a1b-fb8f-4937-8e7d-03e49040307b None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:38.389818 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315d0a1b-fb8f-4937-8e7d-03e49040307b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:38.409565 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-315d0a1b-fb8f-4937-8e7d-03e49040307b None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:01:38.410779 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-315d0a1b-fb8f-4937-8e7d-03e49040307b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:38.458901 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-9c2b5464-4eee-4693-8f14-ea81bbb049ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f6f3ad5f73a40519ce6a4a79c5a49dd'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:38.471480 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1007/2010] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 18 22:01:38 2022] DELETE /identity/v3/users/0f6f3ad5f73a40519ce6a4a79c5a49dd => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:01:38.480180 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1004/2011] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:01:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:01:38.490767 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46575aa-ccff-456b-be4f-f6d5a2691b4a None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:38.491051 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46575aa-ccff-456b-be4f-f6d5a2691b4a None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:38.491323 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46575aa-ccff-456b-be4f-f6d5a2691b4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:38.517905 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-b46575aa-ccff-456b-be4f-f6d5a2691b4a None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:01:38.519650 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-b46575aa-ccff-456b-be4f-f6d5a2691b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:38.597926 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1008/2012] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:01:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:01:38.602534 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315d0a1b-fb8f-4937-8e7d-03e49040307b None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:38.603064 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:01:38.612786 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315d0a1b-fb8f-4937-8e7d-03e49040307b None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:38.617613 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad131ec6-feb4-434c-91f1-b7eac6782942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:38.618216 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad131ec6-feb4-434c-91f1-b7eac6782942 admin admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:38.618496 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad131ec6-feb4-434c-91f1-b7eac6782942 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:38.618764 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad131ec6-feb4-434c-91f1-b7eac6782942 admin admin] PATH_INFO: `/v3/domains` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:38.619407 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad131ec6-feb4-434c-91f1-b7eac6782942 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 22:01:38.619703 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad131ec6-feb4-434c-91f1-b7eac6782942 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:38.621458 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad131ec6-feb4-434c-91f1-b7eac6782942 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:38.633502 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1005/2013] 10.222.0.27 () {58 vars in 1153 bytes} [Thu Aug 18 22:01:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 22:01:38.638585 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46575aa-ccff-456b-be4f-f6d5a2691b4a None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:38.648562 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46575aa-ccff-456b-be4f-f6d5a2691b4a None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:38.653401 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf35b5a-0713-487d-97b5-267d9408dc9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:38.654078 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf35b5a-0713-487d-97b5-267d9408dc9e admin admin] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:38.654360 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf35b5a-0713-487d-97b5-267d9408dc9e admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:38.658355 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf35b5a-0713-487d-97b5-267d9408dc9e admin admin] PATH_INFO: `/v3/projects` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:38.658355 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf35b5a-0713-487d-97b5-267d9408dc9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:38.658355 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf35b5a-0713-487d-97b5-267d9408dc9e admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:38.749139 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad131ec6-feb4-434c-91f1-b7eac6782942 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:38.757162 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-ad131ec6-feb4-434c-91f1-b7eac6782942 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:38.792495 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1009/2014] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 18 22:01:38 2022] POST /identity/v3/projects => generated 385 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 22:01:38.794220 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad131ec6-feb4-434c-91f1-b7eac6782942 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:38.796527 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf35b5a-0713-487d-97b5-267d9408dc9e admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:38.880111 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24eb82c-adf0-4791-98e6-f3dbfb884786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:38.880940 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24eb82c-adf0-4791-98e6-f3dbfb884786 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:38.881704 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24eb82c-adf0-4791-98e6-f3dbfb884786 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:38.882089 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24eb82c-adf0-4791-98e6-f3dbfb884786 admin admin] PATH_INFO: `/v3/projects/5908df3b9d8945d19483a859a0889367` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:38.884167 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24eb82c-adf0-4791-98e6-f3dbfb884786 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5908df3b9d8945d19483a859a0889367)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:38.887330 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24eb82c-adf0-4791-98e6-f3dbfb884786 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:38.903955 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf35b5a-0713-487d-97b5-267d9408dc9e admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:38.909295 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5d09ca-f72e-4ee2-a6b5-ad80baee018c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:38.909965 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5d09ca-f72e-4ee2-a6b5-ad80baee018c admin admin] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:38.910278 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5d09ca-f72e-4ee2-a6b5-ad80baee018c admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:38.910610 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5d09ca-f72e-4ee2-a6b5-ad80baee018c admin admin] PATH_INFO: `/v3/users` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:38.911254 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5d09ca-f72e-4ee2-a6b5-ad80baee018c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:38.913360 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5d09ca-f72e-4ee2-a6b5-ad80baee018c admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:39.029084 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1010/2015] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 18 22:01:38 2022] POST /identity/v3/users => generated 293 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 22:01:39.030329 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5d09ca-f72e-4ee2-a6b5-ad80baee018c admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:39.035401 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-7e5d09ca-f72e-4ee2-a6b5-ad80baee018c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:39.054668 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-f24eb82c-adf0-4791-98e6-f3dbfb884786 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5908df3b9d8945d19483a859a0889367', 'request_id': 'req-f24eb82c-adf0-4791-98e6-f3dbfb884786'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:39.055285 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5d09ca-f72e-4ee2-a6b5-ad80baee018c admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:39.063772 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-f24eb82c-adf0-4791-98e6-f3dbfb884786 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5908df3b9d8945d19483a859a0889367', 'request_id': 'req-f24eb82c-adf0-4791-98e6-f3dbfb884786'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:39.117795 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428d631a-3da3-4dd6-98f8-afcb61e3df50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:39.118441 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428d631a-3da3-4dd6-98f8-afcb61e3df50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:39.118722 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428d631a-3da3-4dd6-98f8-afcb61e3df50 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:39.118994 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428d631a-3da3-4dd6-98f8-afcb61e3df50 admin admin] PATH_INFO: `/v3/projects/f6072ca4f3954493bdf930eea4e31fe8` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:39.120142 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428d631a-3da3-4dd6-98f8-afcb61e3df50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6072ca4f3954493bdf930eea4e31fe8)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:39.122210 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428d631a-3da3-4dd6-98f8-afcb61e3df50 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:39.133067 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-f24eb82c-adf0-4791-98e6-f3dbfb884786 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5908df3b9d8945d19483a859a0889367', 'request_id': 'req-f24eb82c-adf0-4791-98e6-f3dbfb884786'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:39.145948 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-f24eb82c-adf0-4791-98e6-f3dbfb884786 admin admin] The token cache is being invalidate because project 5908df3b9d8945d19483a859a0889367 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88096) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 22:01:39.146248 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-f24eb82c-adf0-4791-98e6-f3dbfb884786 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:39.146966 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-f24eb82c-adf0-4791-98e6-f3dbfb884786 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:39.149243 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1006/2016] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 18 22:01:38 2022] DELETE /identity/v3/projects/5908df3b9d8945d19483a859a0889367 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:01:39.150022 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24eb82c-adf0-4791-98e6-f3dbfb884786 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:39.151543 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-f24eb82c-adf0-4791-98e6-f3dbfb884786 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:39.165581 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24eb82c-adf0-4791-98e6-f3dbfb884786 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:39.179265 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88332eb0-aebf-4a0d-9bac-ba4691d75db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:39.179891 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88332eb0-aebf-4a0d-9bac-ba4691d75db4 admin admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:39.180172 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88332eb0-aebf-4a0d-9bac-ba4691d75db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:39.180444 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88332eb0-aebf-4a0d-9bac-ba4691d75db4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:39.181119 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88332eb0-aebf-4a0d-9bac-ba4691d75db4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:39.183094 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88332eb0-aebf-4a0d-9bac-ba4691d75db4 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:39.195244 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1007/2017] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:01:39 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:01:39.196234 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88332eb0-aebf-4a0d-9bac-ba4691d75db4 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:39.198557 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-88332eb0-aebf-4a0d-9bac-ba4691d75db4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:39.222853 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88332eb0-aebf-4a0d-9bac-ba4691d75db4 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:39.242304 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-428d631a-3da3-4dd6-98f8-afcb61e3df50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6072ca4f3954493bdf930eea4e31fe8', 'request_id': 'req-428d631a-3da3-4dd6-98f8-afcb61e3df50'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:39.242304 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-428d631a-3da3-4dd6-98f8-afcb61e3df50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6072ca4f3954493bdf930eea4e31fe8', 'request_id': 'req-428d631a-3da3-4dd6-98f8-afcb61e3df50'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:39.281224 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4604e4-a1a6-4a79-b068-292df0474ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:39.281856 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4604e4-a1a6-4a79-b068-292df0474ee0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:39.282133 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4604e4-a1a6-4a79-b068-292df0474ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:39.282404 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4604e4-a1a6-4a79-b068-292df0474ee0 admin admin] PATH_INFO: `/v3/users/053829b1f9844d2081f5adc7604ca073` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:39.284164 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4604e4-a1a6-4a79-b068-292df0474ee0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=053829b1f9844d2081f5adc7604ca073)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:39.286127 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4604e4-a1a6-4a79-b068-292df0474ee0 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:39.318444 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-428d631a-3da3-4dd6-98f8-afcb61e3df50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6072ca4f3954493bdf930eea4e31fe8', 'request_id': 'req-428d631a-3da3-4dd6-98f8-afcb61e3df50'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:39.331926 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-428d631a-3da3-4dd6-98f8-afcb61e3df50 admin admin] The token cache is being invalidate because project f6072ca4f3954493bdf930eea4e31fe8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88097) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 22:01:39.332550 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-428d631a-3da3-4dd6-98f8-afcb61e3df50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:39.333468 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-428d631a-3da3-4dd6-98f8-afcb61e3df50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:39.338434 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1011/2018] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 18 22:01:39 2022] DELETE /identity/v3/projects/f6072ca4f3954493bdf930eea4e31fe8 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:01:39.338434 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9983b3-94bb-4070-8e9b-9a4e25d88588 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:39.338434 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9983b3-94bb-4070-8e9b-9a4e25d88588 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:39.338434 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9983b3-94bb-4070-8e9b-9a4e25d88588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:39.356960 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-dd9983b3-94bb-4070-8e9b-9a4e25d88588 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:01:39.361433 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-dd9983b3-94bb-4070-8e9b-9a4e25d88588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:39.366880 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1012/2019] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:01:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:01:39.367673 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9983b3-94bb-4070-8e9b-9a4e25d88588 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:39.368961 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-dd9983b3-94bb-4070-8e9b-9a4e25d88588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:39.382071 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9983b3-94bb-4070-8e9b-9a4e25d88588 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:39.386996 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22fd063-fbdc-4344-802a-249d331bdb9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:39.387587 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22fd063-fbdc-4344-802a-249d331bdb9f admin admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:39.387866 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22fd063-fbdc-4344-802a-249d331bdb9f admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:39.388137 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22fd063-fbdc-4344-802a-249d331bdb9f admin admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:39.388810 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22fd063-fbdc-4344-802a-249d331bdb9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:39.390433 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22fd063-fbdc-4344-802a-249d331bdb9f admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:39.401809 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1013/2020] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:01:39 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:01:39.403020 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fe4a94-b809-43fc-827b-45a01f7f9ef6 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:39.403281 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fe4a94-b809-43fc-827b-45a01f7f9ef6 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:39.403583 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fe4a94-b809-43fc-827b-45a01f7f9ef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:39.406831 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:01:39.424191 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-87fe4a94-b809-43fc-827b-45a01f7f9ef6 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:01:39.425526 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-87fe4a94-b809-43fc-827b-45a01f7f9ef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:39.433569 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1014/2021] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:01:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:01:39.434759 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f9a459-1499-4c81-9b22-b9e78701d466 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:39.435040 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f9a459-1499-4c81-9b22-b9e78701d466 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:39.441464 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f9a459-1499-4c81-9b22-b9e78701d466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:39.454589 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-d7f9a459-1499-4c81-9b22-b9e78701d466 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:01:39.455780 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-d7f9a459-1499-4c81-9b22-b9e78701d466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:39.463678 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1015/2022] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:01:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:01:39.464733 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f9a459-1499-4c81-9b22-b9e78701d466 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:39.475931 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f9a459-1499-4c81-9b22-b9e78701d466 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:39.481078 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2197d1-64a0-4aaf-8f63-877013239170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:39.481721 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2197d1-64a0-4aaf-8f63-877013239170 admin admin] REQUEST_METHOD: `PUT` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:39.481998 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2197d1-64a0-4aaf-8f63-877013239170 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:39.482277 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2197d1-64a0-4aaf-8f63-877013239170 admin admin] PATH_INFO: `/v3/projects/3ebdd1b8003240aabe50804032eb7407/users/b4fb9ff29f09419cb6d67f3ae2788b6e/roles/de8f2438056f4af9879423f8a59e0e0b` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:39.498063 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2197d1-64a0-4aaf-8f63-877013239170 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ebdd1b8003240aabe50804032eb7407, user_id=b4fb9ff29f09419cb6d67f3ae2788b6e, role_id=de8f2438056f4af9879423f8a59e0e0b)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:39.500829 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2197d1-64a0-4aaf-8f63-877013239170 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:39.509718 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-ab4604e4-a1a6-4a79-b068-292df0474ee0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '053829b1f9844d2081f5adc7604ca073'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:39.516570 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-ab4604e4-a1a6-4a79-b068-292df0474ee0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '053829b1f9844d2081f5adc7604ca073'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:39.517382 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-ab4604e4-a1a6-4a79-b068-292df0474ee0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '053829b1f9844d2081f5adc7604ca073'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:39.517987 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-ab4604e4-a1a6-4a79-b068-292df0474ee0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '053829b1f9844d2081f5adc7604ca073'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:39.530994 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-ab4604e4-a1a6-4a79-b068-292df0474ee0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '053829b1f9844d2081f5adc7604ca073'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:39.597784 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1016/2023] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 18 22:01:39 2022] PUT /identity/v3/projects/3ebdd1b8003240aabe50804032eb7407/users/b4fb9ff29f09419cb6d67f3ae2788b6e/roles/de8f2438056f4af9879423f8a59e0e0b => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:01:39.599172 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0724c102-9da1-4b88-8858-bf53b3e4f74d None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:39.599495 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0724c102-9da1-4b88-8858-bf53b3e4f74d None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:39.599772 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0724c102-9da1-4b88-8858-bf53b3e4f74d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:39.616024 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1008/2024] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 18 22:01:39 2022] DELETE /identity/v3/users/053829b1f9844d2081f5adc7604ca073 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:01:39.617619 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4604e4-a1a6-4a79-b068-292df0474ee0 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:39.619686 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-0724c102-9da1-4b88-8858-bf53b3e4f74d None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:01:39.619936 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-ab4604e4-a1a6-4a79-b068-292df0474ee0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:39.621051 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-0724c102-9da1-4b88-8858-bf53b3e4f74d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:39.684420 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1017/2025] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:01:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:01:39.685711 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d13e9a9-4b88-456e-b1d9-35b709f0f719 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:39.686000 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d13e9a9-4b88-456e-b1d9-35b709f0f719 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:39.686276 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d13e9a9-4b88-456e-b1d9-35b709f0f719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:39.687387 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4604e4-a1a6-4a79-b068-292df0474ee0 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:39.693273 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01abc0f-1ac2-40ce-9491-781798d359a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:39.693887 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01abc0f-1ac2-40ce-9491-781798d359a1 admin admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:39.694891 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01abc0f-1ac2-40ce-9491-781798d359a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:39.694891 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01abc0f-1ac2-40ce-9491-781798d359a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:39.695188 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01abc0f-1ac2-40ce-9491-781798d359a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 22:01:39.695491 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01abc0f-1ac2-40ce-9491-781798d359a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:39.697151 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01abc0f-1ac2-40ce-9491-781798d359a1 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:39.713388 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1009/2026] 10.222.0.27 () {58 vars in 1153 bytes} [Thu Aug 18 22:01:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 22:01:39.713388 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816cdb81-7895-4b80-96cc-262bc1ace53a None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:39.713388 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816cdb81-7895-4b80-96cc-262bc1ace53a None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:39.713388 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816cdb81-7895-4b80-96cc-262bc1ace53a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:39.715444 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-9d13e9a9-4b88-456e-b1d9-35b709f0f719 None None] MFA Rules not processed for user `b4fb9ff29f09419cb6d67f3ae2788b6e`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:01:39.716695 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-9d13e9a9-4b88-456e-b1d9-35b709f0f719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:39.732314 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-816cdb81-7895-4b80-96cc-262bc1ace53a None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:01:39.733526 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-816cdb81-7895-4b80-96cc-262bc1ace53a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:39.741963 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1010/2027] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:01:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:01:39.742738 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816cdb81-7895-4b80-96cc-262bc1ace53a None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:39.753364 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816cdb81-7895-4b80-96cc-262bc1ace53a None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:39.758892 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798f5eef-bca8-4913-9d54-62842accc09b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:39.759503 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798f5eef-bca8-4913-9d54-62842accc09b admin admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:39.767883 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798f5eef-bca8-4913-9d54-62842accc09b admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:39.767883 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798f5eef-bca8-4913-9d54-62842accc09b admin admin] PATH_INFO: `/v3/domains` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:39.767883 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798f5eef-bca8-4913-9d54-62842accc09b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 22:01:39.767883 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798f5eef-bca8-4913-9d54-62842accc09b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:39.767883 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798f5eef-bca8-4913-9d54-62842accc09b admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:39.775875 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1011/2028] 10.222.0.27 () {58 vars in 1153 bytes} [Thu Aug 18 22:01:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 22:01:39.776573 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798f5eef-bca8-4913-9d54-62842accc09b admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:39.785433 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1018/2029] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:01:39 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:01:39.786740 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798f5eef-bca8-4913-9d54-62842accc09b admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:39.786922 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d13e9a9-4b88-456e-b1d9-35b709f0f719 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:39.788538 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-9d13e9a9-4b88-456e-b1d9-35b709f0f719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:39.793901 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e702a5-a098-4008-a47c-6981095d28fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:39.794519 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e702a5-a098-4008-a47c-6981095d28fc admin admin] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:39.794799 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e702a5-a098-4008-a47c-6981095d28fc admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:39.795077 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e702a5-a098-4008-a47c-6981095d28fc admin admin] PATH_INFO: `/v3/projects` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:39.795709 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e702a5-a098-4008-a47c-6981095d28fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:39.797753 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e702a5-a098-4008-a47c-6981095d28fc admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:39.847189 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d13e9a9-4b88-456e-b1d9-35b709f0f719 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:39.850813 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b87cd31-8430-4226-aee4-a456877eb3dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a937971ad1a4b0c8697c764f214d446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:39.851420 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b87cd31-8430-4226-aee4-a456877eb3dc service neutron] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:39.851703 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b87cd31-8430-4226-aee4-a456877eb3dc service neutron] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:39.851982 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b87cd31-8430-4226-aee4-a456877eb3dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:39.861536 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:01:39.865255 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b87cd31-8430-4226-aee4-a456877eb3dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:39.865255 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b87cd31-8430-4226-aee4-a456877eb3dc service neutron] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:39.874183 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1019/2030] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:01:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:01:39.874940 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b87cd31-8430-4226-aee4-a456877eb3dc service neutron] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:39.885279 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b87cd31-8430-4226-aee4-a456877eb3dc service neutron] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:39.890123 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9831b02a-7131-4ea6-b19e-0a9d09604e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:39.890716 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9831b02a-7131-4ea6-b19e-0a9d09604e2a admin admin] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:39.891001 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9831b02a-7131-4ea6-b19e-0a9d09604e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:39.891281 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9831b02a-7131-4ea6-b19e-0a9d09604e2a admin admin] PATH_INFO: `/v3/projects` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:39.891905 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9831b02a-7131-4ea6-b19e-0a9d09604e2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:39.894940 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9831b02a-7131-4ea6-b19e-0a9d09604e2a admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:39.920530 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1012/2031] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 18 22:01:39 2022] POST /identity/v3/projects => generated 385 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 22:01:39.922837 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e702a5-a098-4008-a47c-6981095d28fc admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:39.923891 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-37e702a5-a098-4008-a47c-6981095d28fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:40.002534 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e702a5-a098-4008-a47c-6981095d28fc admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:40.007997 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14d312f-aaa3-44ef-be2f-b3056deb7696 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a39cd50340184779ac589bbcb7cac9aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:40.008610 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14d312f-aaa3-44ef-be2f-b3056deb7696 service nova] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:40.008903 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14d312f-aaa3-44ef-be2f-b3056deb7696 service nova] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:40.009173 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14d312f-aaa3-44ef-be2f-b3056deb7696 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:40.034707 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1020/2032] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 18 22:01:39 2022] POST /identity/v3/projects => generated 371 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 22:01:40.035594 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9831b02a-7131-4ea6-b19e-0a9d09604e2a admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:40.069990 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14d312f-aaa3-44ef-be2f-b3056deb7696 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:40.071586 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14d312f-aaa3-44ef-be2f-b3056deb7696 service nova] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:40.081696 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1013/2033] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:01:39 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:01:40.082500 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14d312f-aaa3-44ef-be2f-b3056deb7696 service nova] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:40.118533 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9831b02a-7131-4ea6-b19e-0a9d09604e2a admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:40.125407 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282db06d-83fe-4ad9-9cb9-56b89295dbc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:40.126052 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282db06d-83fe-4ad9-9cb9-56b89295dbc7 admin admin] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:40.126354 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282db06d-83fe-4ad9-9cb9-56b89295dbc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:40.127322 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282db06d-83fe-4ad9-9cb9-56b89295dbc7 admin admin] PATH_INFO: `/v3/users` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:40.127981 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282db06d-83fe-4ad9-9cb9-56b89295dbc7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:40.130635 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282db06d-83fe-4ad9-9cb9-56b89295dbc7 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:40.167684 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14d312f-aaa3-44ef-be2f-b3056deb7696 service nova] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:40.172643 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecebcbea-4f67-405a-ace6-9107bae5c89a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:40.173963 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecebcbea-4f67-405a-ace6-9107bae5c89a admin admin] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:40.174273 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecebcbea-4f67-405a-ace6-9107bae5c89a admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:40.174543 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecebcbea-4f67-405a-ace6-9107bae5c89a admin admin] PATH_INFO: `/v3/users` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:40.175401 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecebcbea-4f67-405a-ace6-9107bae5c89a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:40.177623 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecebcbea-4f67-405a-ace6-9107bae5c89a admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:40.219915 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1021/2034] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 18 22:01:40 2022] POST /identity/v3/users => generated 293 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 22:01:40.224503 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282db06d-83fe-4ad9-9cb9-56b89295dbc7 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:40.236374 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282db06d-83fe-4ad9-9cb9-56b89295dbc7 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:40.248642 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1014/2035] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 18 22:01:40 2022] POST /identity/v3/users => generated 286 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 22:01:40.252508 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a417b6-4a66-4275-bd61-02247462ad6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:40.252957 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a417b6-4a66-4275-bd61-02247462ad6f admin admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:40.253264 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a417b6-4a66-4275-bd61-02247462ad6f admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:40.253532 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a417b6-4a66-4275-bd61-02247462ad6f admin admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:40.253867 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecebcbea-4f67-405a-ace6-9107bae5c89a admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:40.254198 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a417b6-4a66-4275-bd61-02247462ad6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:40.257342 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a417b6-4a66-4275-bd61-02247462ad6f admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:40.280442 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecebcbea-4f67-405a-ace6-9107bae5c89a admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:40.282017 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1022/2036] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:01:40 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 22:01:40.286058 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a417b6-4a66-4275-bd61-02247462ad6f admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:40.300081 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a417b6-4a66-4275-bd61-02247462ad6f admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:40.304176 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c724e00-21ea-4ac2-8fea-d955a4f3902e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:40.305676 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c724e00-21ea-4ac2-8fea-d955a4f3902e admin admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:40.306511 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c724e00-21ea-4ac2-8fea-d955a4f3902e admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:40.307391 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c724e00-21ea-4ac2-8fea-d955a4f3902e admin admin] PATH_INFO: `/v3/roles` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:40.307933 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240fcd9d-fb5c-420b-9e34-167b0ae3403d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:40.308468 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c724e00-21ea-4ac2-8fea-d955a4f3902e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:40.308753 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240fcd9d-fb5c-420b-9e34-167b0ae3403d admin admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:40.309267 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240fcd9d-fb5c-420b-9e34-167b0ae3403d admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:40.309626 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240fcd9d-fb5c-420b-9e34-167b0ae3403d admin admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:40.310358 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240fcd9d-fb5c-420b-9e34-167b0ae3403d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:40.312062 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240fcd9d-fb5c-420b-9e34-167b0ae3403d admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:40.312504 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c724e00-21ea-4ac2-8fea-d955a4f3902e admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:40.326017 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1015/2037] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:01:40 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 22:01:40.326425 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1023/2038] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:01:40 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:01:40.330514 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c724e00-21ea-4ac2-8fea-d955a4f3902e admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:40.332629 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240fcd9d-fb5c-420b-9e34-167b0ae3403d admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:40.341595 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c724e00-21ea-4ac2-8fea-d955a4f3902e admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:40.344437 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240fcd9d-fb5c-420b-9e34-167b0ae3403d admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:40.347496 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2461e71b-08d8-4265-aa43-0831c9f2e0cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:40.348367 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2461e71b-08d8-4265-aa43-0831c9f2e0cd admin admin] REQUEST_METHOD: `PUT` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:40.348829 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2461e71b-08d8-4265-aa43-0831c9f2e0cd admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:40.349390 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2461e71b-08d8-4265-aa43-0831c9f2e0cd admin admin] PATH_INFO: `/v3/projects/26cab4cc68f34e8396cbb1846f12fe3a/users/03909a1620d84e0b9be6a754230057f9/roles/de8f2438056f4af9879423f8a59e0e0b` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:40.351435 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cff32b9-e8a8-4bca-bd4d-f247f8b0d1e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:40.352065 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cff32b9-e8a8-4bca-bd4d-f247f8b0d1e9 admin admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:40.352349 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cff32b9-e8a8-4bca-bd4d-f247f8b0d1e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:40.352645 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cff32b9-e8a8-4bca-bd4d-f247f8b0d1e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:40.353476 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cff32b9-e8a8-4bca-bd4d-f247f8b0d1e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:40.355172 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cff32b9-e8a8-4bca-bd4d-f247f8b0d1e9 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:40.371114 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1024/2039] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:01:40 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 22:01:40.371114 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cff32b9-e8a8-4bca-bd4d-f247f8b0d1e9 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:40.371114 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-5cff32b9-e8a8-4bca-bd4d-f247f8b0d1e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:40.373765 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2461e71b-08d8-4265-aa43-0831c9f2e0cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=26cab4cc68f34e8396cbb1846f12fe3a, user_id=03909a1620d84e0b9be6a754230057f9, role_id=de8f2438056f4af9879423f8a59e0e0b)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:40.377931 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2461e71b-08d8-4265-aa43-0831c9f2e0cd admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:40.392113 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cff32b9-e8a8-4bca-bd4d-f247f8b0d1e9 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:40.397574 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e71831-68b9-45cc-83cc-c0cb8e852846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:40.398707 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e71831-68b9-45cc-83cc-c0cb8e852846 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:40.399087 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e71831-68b9-45cc-83cc-c0cb8e852846 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:40.399439 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e71831-68b9-45cc-83cc-c0cb8e852846 admin admin] PATH_INFO: `/v3/projects/214782863fc04003af7f13c04f383720` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:40.401699 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e71831-68b9-45cc-83cc-c0cb8e852846 admin admin] RBAC: Authorizing `identity:delete_project(project_id=214782863fc04003af7f13c04f383720)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:40.404234 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e71831-68b9-45cc-83cc-c0cb8e852846 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:40.479246 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1016/2040] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 18 22:01:40 2022] PUT /identity/v3/projects/26cab4cc68f34e8396cbb1846f12fe3a/users/03909a1620d84e0b9be6a754230057f9/roles/de8f2438056f4af9879423f8a59e0e0b => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:01:40.480232 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2461e71b-08d8-4265-aa43-0831c9f2e0cd admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:40.522588 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-d5e71831-68b9-45cc-83cc-c0cb8e852846 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '214782863fc04003af7f13c04f383720', 'request_id': 'req-d5e71831-68b9-45cc-83cc-c0cb8e852846'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:40.528548 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-d5e71831-68b9-45cc-83cc-c0cb8e852846 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '214782863fc04003af7f13c04f383720', 'request_id': 'req-d5e71831-68b9-45cc-83cc-c0cb8e852846'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:40.543773 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2461e71b-08d8-4265-aa43-0831c9f2e0cd admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:40.599875 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25216a4-0792-42ea-999b-84bf175f89c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:40.600467 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25216a4-0792-42ea-999b-84bf175f89c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:40.600785 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25216a4-0792-42ea-999b-84bf175f89c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:40.601064 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25216a4-0792-42ea-999b-84bf175f89c8 admin admin] PATH_INFO: `/v3/projects/7ca17663cd16420bb43baeabba552750/users/01556142475c4fa49dba434d6865d39c/roles/de8f2438056f4af9879423f8a59e0e0b` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:40.615799 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25216a4-0792-42ea-999b-84bf175f89c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ca17663cd16420bb43baeabba552750, user_id=01556142475c4fa49dba434d6865d39c, role_id=de8f2438056f4af9879423f8a59e0e0b)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:40.618504 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25216a4-0792-42ea-999b-84bf175f89c8 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:40.647546 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-d5e71831-68b9-45cc-83cc-c0cb8e852846 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '214782863fc04003af7f13c04f383720', 'request_id': 'req-d5e71831-68b9-45cc-83cc-c0cb8e852846'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:40.662305 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-d5e71831-68b9-45cc-83cc-c0cb8e852846 admin admin] The token cache is being invalidate because project 214782863fc04003af7f13c04f383720 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88097) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 22:01:40.662599 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-d5e71831-68b9-45cc-83cc-c0cb8e852846 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:40.663356 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-d5e71831-68b9-45cc-83cc-c0cb8e852846 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:40.664876 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1025/2041] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 18 22:01:40 2022] DELETE /identity/v3/projects/214782863fc04003af7f13c04f383720 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:01:40.668886 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84e17fb-fb3e-474c-bfed-4d7db4163b44 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:40.669173 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84e17fb-fb3e-474c-bfed-4d7db4163b44 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:40.669451 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84e17fb-fb3e-474c-bfed-4d7db4163b44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:40.697958 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-c84e17fb-fb3e-474c-bfed-4d7db4163b44 None None] MFA Rules not processed for user `03909a1620d84e0b9be6a754230057f9`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:01:40.699221 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-c84e17fb-fb3e-474c-bfed-4d7db4163b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:40.757667 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1017/2042] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 18 22:01:40 2022] PUT /identity/v3/projects/7ca17663cd16420bb43baeabba552750/users/01556142475c4fa49dba434d6865d39c/roles/de8f2438056f4af9879423f8a59e0e0b => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:01:40.758620 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25216a4-0792-42ea-999b-84bf175f89c8 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:40.760450 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-b25216a4-0792-42ea-999b-84bf175f89c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:40.771015 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1026/2043] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:01:40 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:01:40.772491 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13045c89-3d37-440a-b299-2718b8e572a2 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:40.773684 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13045c89-3d37-440a-b299-2718b8e572a2 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:40.773684 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13045c89-3d37-440a-b299-2718b8e572a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:40.803479 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-13045c89-3d37-440a-b299-2718b8e572a2 None None] MFA Rules not processed for user `01556142475c4fa49dba434d6865d39c`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:01:40.804771 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-13045c89-3d37-440a-b299-2718b8e572a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:40.834325 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25216a4-0792-42ea-999b-84bf175f89c8 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:40.839039 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729cf924-5016-42b1-828c-a0ffbf054ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:40.839672 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729cf924-5016-42b1-828c-a0ffbf054ada admin admin] REQUEST_METHOD: `DELETE` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:40.839948 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729cf924-5016-42b1-828c-a0ffbf054ada admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:40.840222 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729cf924-5016-42b1-828c-a0ffbf054ada admin admin] PATH_INFO: `/v3/users/a25bf71b515449cd907b4c03e3cf9eb5` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:40.841416 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729cf924-5016-42b1-828c-a0ffbf054ada admin admin] RBAC: Authorizing `identity:delete_user(user_id=a25bf71b515449cd907b4c03e3cf9eb5)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:40.848929 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729cf924-5016-42b1-828c-a0ffbf054ada admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:40.879354 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1027/2044] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:01:40 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:01:40.879354 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13045c89-3d37-440a-b299-2718b8e572a2 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:40.880566 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-13045c89-3d37-440a-b299-2718b8e572a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:40.896558 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13045c89-3d37-440a-b299-2718b8e572a2 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:40.902744 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d18692-0d03-4de6-864d-f2d94a911c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:40.903479 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d18692-0d03-4de6-864d-f2d94a911c60 admin admin] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:40.903911 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d18692-0d03-4de6-864d-f2d94a911c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:40.904220 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d18692-0d03-4de6-864d-f2d94a911c60 admin admin] PATH_INFO: `/v3/projects` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:40.905312 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d18692-0d03-4de6-864d-f2d94a911c60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:40.907305 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d18692-0d03-4de6-864d-f2d94a911c60 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:41.011578 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1028/2045] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 18 22:01:40 2022] POST /identity/v3/projects => generated 387 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 22:01:41.012478 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d18692-0d03-4de6-864d-f2d94a911c60 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:41.014287 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-58d18692-0d03-4de6-864d-f2d94a911c60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:41.055983 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-729cf924-5016-42b1-828c-a0ffbf054ada admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a25bf71b515449cd907b4c03e3cf9eb5'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:41.063040 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-729cf924-5016-42b1-828c-a0ffbf054ada admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a25bf71b515449cd907b4c03e3cf9eb5'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:41.063719 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-729cf924-5016-42b1-828c-a0ffbf054ada admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a25bf71b515449cd907b4c03e3cf9eb5'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:41.064662 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-729cf924-5016-42b1-828c-a0ffbf054ada admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a25bf71b515449cd907b4c03e3cf9eb5'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:41.072660 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d18692-0d03-4de6-864d-f2d94a911c60 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:41.076372 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecee897-a852-47a7-a54e-81eb5ee4de3e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22b6a7c36f8a4795a75271b8079821c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:41.076597 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-729cf924-5016-42b1-828c-a0ffbf054ada admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a25bf71b515449cd907b4c03e3cf9eb5'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:41.077051 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecee897-a852-47a7-a54e-81eb5ee4de3e service cinder] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:41.077336 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecee897-a852-47a7-a54e-81eb5ee4de3e service cinder] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:41.077612 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecee897-a852-47a7-a54e-81eb5ee4de3e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:41.083393 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-cecee897-a852-47a7-a54e-81eb5ee4de3e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:41.140430 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecee897-a852-47a7-a54e-81eb5ee4de3e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:41.143065 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1018/2046] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 18 22:01:40 2022] DELETE /identity/v3/users/a25bf71b515449cd907b4c03e3cf9eb5 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:01:41.143661 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecee897-a852-47a7-a54e-81eb5ee4de3e service cinder] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:41.144016 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729cf924-5016-42b1-828c-a0ffbf054ada admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:41.156483 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1029/2047] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:01:41 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:01:41.165080 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-729cf924-5016-42b1-828c-a0ffbf054ada admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:41.180654 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecee897-a852-47a7-a54e-81eb5ee4de3e service cinder] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:41.181198 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-cecee897-a852-47a7-a54e-81eb5ee4de3e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:41.232806 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:01:41.306106 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729cf924-5016-42b1-828c-a0ffbf054ada admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:41.306922 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecee897-a852-47a7-a54e-81eb5ee4de3e service cinder] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:41.311278 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218b100a-8358-47ed-ba42-2d3dd8730c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:41.312103 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218b100a-8358-47ed-ba42-2d3dd8730c33 admin admin] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:41.312546 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb4d8f3-4e56-41cc-833b-c0a87c422c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:41.312711 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218b100a-8358-47ed-ba42-2d3dd8730c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:41.313031 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218b100a-8358-47ed-ba42-2d3dd8730c33 admin admin] PATH_INFO: `/v3/users` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:41.313229 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb4d8f3-4e56-41cc-833b-c0a87c422c41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:41.313511 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb4d8f3-4e56-41cc-833b-c0a87c422c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:41.313800 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb4d8f3-4e56-41cc-833b-c0a87c422c41 admin admin] PATH_INFO: `/v3/users/01556142475c4fa49dba434d6865d39c` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:41.315804 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb4d8f3-4e56-41cc-833b-c0a87c422c41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=01556142475c4fa49dba434d6865d39c)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:41.316152 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:01:41.317134 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218b100a-8358-47ed-ba42-2d3dd8730c33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:41.317803 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb4d8f3-4e56-41cc-833b-c0a87c422c41 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:41.321423 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218b100a-8358-47ed-ba42-2d3dd8730c33 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:41.430359 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1019/2048] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 18 22:01:41 2022] POST /identity/v3/users => generated 294 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 22:01:41.431525 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218b100a-8358-47ed-ba42-2d3dd8730c33 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:41.442271 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218b100a-8358-47ed-ba42-2d3dd8730c33 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:41.447397 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13539ddf-bfc3-4b91-a0f2-749c8aa75af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:41.448028 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13539ddf-bfc3-4b91-a0f2-749c8aa75af0 admin admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:41.448390 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13539ddf-bfc3-4b91-a0f2-749c8aa75af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:41.448608 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13539ddf-bfc3-4b91-a0f2-749c8aa75af0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:41.449255 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13539ddf-bfc3-4b91-a0f2-749c8aa75af0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:41.450846 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13539ddf-bfc3-4b91-a0f2-749c8aa75af0 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:41.462097 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1020/2049] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:01:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:01:41.472563 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13539ddf-bfc3-4b91-a0f2-749c8aa75af0 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:41.483458 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13539ddf-bfc3-4b91-a0f2-749c8aa75af0 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:41.490187 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b74e568-0400-4651-8804-b8c0e2af4cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:41.493846 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b74e568-0400-4651-8804-b8c0e2af4cd0 admin admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:41.493846 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b74e568-0400-4651-8804-b8c0e2af4cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:41.493846 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b74e568-0400-4651-8804-b8c0e2af4cd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:41.493846 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b74e568-0400-4651-8804-b8c0e2af4cd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:41.494603 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b74e568-0400-4651-8804-b8c0e2af4cd0 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:41.515931 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1021/2050] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:01:41 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 22:01:41.522601 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b74e568-0400-4651-8804-b8c0e2af4cd0 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:41.538051 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-efb4d8f3-4e56-41cc-833b-c0a87c422c41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01556142475c4fa49dba434d6865d39c'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:41.547196 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b74e568-0400-4651-8804-b8c0e2af4cd0 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:41.547384 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-efb4d8f3-4e56-41cc-833b-c0a87c422c41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01556142475c4fa49dba434d6865d39c'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:41.547384 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-efb4d8f3-4e56-41cc-833b-c0a87c422c41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01556142475c4fa49dba434d6865d39c'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:41.553006 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f876f3cf-94b8-4c6f-b0d8-dfc6cb9b33fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:41.553795 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f876f3cf-94b8-4c6f-b0d8-dfc6cb9b33fc admin admin] REQUEST_METHOD: `PUT` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:41.554180 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f876f3cf-94b8-4c6f-b0d8-dfc6cb9b33fc admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:41.554821 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f876f3cf-94b8-4c6f-b0d8-dfc6cb9b33fc admin admin] PATH_INFO: `/v3/projects/3f41e78e994f46a3aa626c70eecaafeb/users/42b1645b50bc43ed8a52145fad275f2d/roles/de8f2438056f4af9879423f8a59e0e0b` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:41.564765 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-efb4d8f3-4e56-41cc-833b-c0a87c422c41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01556142475c4fa49dba434d6865d39c'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:41.572923 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f876f3cf-94b8-4c6f-b0d8-dfc6cb9b33fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f41e78e994f46a3aa626c70eecaafeb, user_id=42b1645b50bc43ed8a52145fad275f2d, role_id=de8f2438056f4af9879423f8a59e0e0b)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:41.575586 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f876f3cf-94b8-4c6f-b0d8-dfc6cb9b33fc admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:41.641758 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-efb4d8f3-4e56-41cc-833b-c0a87c422c41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01556142475c4fa49dba434d6865d39c'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:41.648639 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1030/2051] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 18 22:01:41 2022] DELETE /identity/v3/users/01556142475c4fa49dba434d6865d39c => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 22:01:41.652559 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb4d8f3-4e56-41cc-833b-c0a87c422c41 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:41.654047 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-efb4d8f3-4e56-41cc-833b-c0a87c422c41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:41.685261 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1022/2052] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 18 22:01:41 2022] PUT /identity/v3/projects/3f41e78e994f46a3aa626c70eecaafeb/users/42b1645b50bc43ed8a52145fad275f2d/roles/de8f2438056f4af9879423f8a59e0e0b => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:01:41.693079 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7af8a9-e9c0-49de-b752-079b2637c0df None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:41.693079 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7af8a9-e9c0-49de-b752-079b2637c0df None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:41.693079 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7af8a9-e9c0-49de-b752-079b2637c0df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:41.712021 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-7c7af8a9-e9c0-49de-b752-079b2637c0df None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:01:41.713248 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-7c7af8a9-e9c0-49de-b752-079b2637c0df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:41.726757 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb4d8f3-4e56-41cc-833b-c0a87c422c41 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:41.773840 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1023/2053] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:01:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:01:41.775470 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645918a6-5ff3-4416-964f-956fbff03307 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:41.775855 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645918a6-5ff3-4416-964f-956fbff03307 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:41.776226 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645918a6-5ff3-4416-964f-956fbff03307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:41.792297 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053f4f18-9f44-49bb-bea2-62ba6e24bc29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:41.792973 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053f4f18-9f44-49bb-bea2-62ba6e24bc29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:41.793280 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053f4f18-9f44-49bb-bea2-62ba6e24bc29 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:41.793582 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053f4f18-9f44-49bb-bea2-62ba6e24bc29 admin admin] PATH_INFO: `/v3/projects/3ea86b96f71e463c84e9e918840fc615` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:41.794814 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053f4f18-9f44-49bb-bea2-62ba6e24bc29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ea86b96f71e463c84e9e918840fc615)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:41.796873 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053f4f18-9f44-49bb-bea2-62ba6e24bc29 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:41.804254 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-645918a6-5ff3-4416-964f-956fbff03307 None None] MFA Rules not processed for user `42b1645b50bc43ed8a52145fad275f2d`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:01:41.805535 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-645918a6-5ff3-4416-964f-956fbff03307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:41.871961 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1024/2054] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:01:41 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:01:41.872844 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645918a6-5ff3-4416-964f-956fbff03307 None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:41.874129 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-645918a6-5ff3-4416-964f-956fbff03307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:41.931761 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645918a6-5ff3-4416-964f-956fbff03307 None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:41.935301 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10566dcd-0257-49dd-a823-ed28d5e41c02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a937971ad1a4b0c8697c764f214d446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:41.935897 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10566dcd-0257-49dd-a823-ed28d5e41c02 service neutron] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:41.936170 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10566dcd-0257-49dd-a823-ed28d5e41c02 service neutron] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:41.936436 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10566dcd-0257-49dd-a823-ed28d5e41c02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:41.946166 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10566dcd-0257-49dd-a823-ed28d5e41c02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:41.947577 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10566dcd-0257-49dd-a823-ed28d5e41c02 service neutron] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:41.956876 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1025/2055] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:01:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:01:41.957708 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10566dcd-0257-49dd-a823-ed28d5e41c02 service neutron] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:41.959142 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-10566dcd-0257-49dd-a823-ed28d5e41c02 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:41.971960 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10566dcd-0257-49dd-a823-ed28d5e41c02 service neutron] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:41.976586 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d2c429-ac5c-451f-be42-80559f67019b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:41.977224 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d2c429-ac5c-451f-be42-80559f67019b admin admin] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:41.977493 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d2c429-ac5c-451f-be42-80559f67019b admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:41.977760 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d2c429-ac5c-451f-be42-80559f67019b admin admin] PATH_INFO: `/v3/projects` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:41.978425 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d2c429-ac5c-451f-be42-80559f67019b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:41.980322 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d2c429-ac5c-451f-be42-80559f67019b admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:42.010626 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-053f4f18-9f44-49bb-bea2-62ba6e24bc29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ea86b96f71e463c84e9e918840fc615', 'request_id': 'req-053f4f18-9f44-49bb-bea2-62ba6e24bc29'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:42.016841 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-053f4f18-9f44-49bb-bea2-62ba6e24bc29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ea86b96f71e463c84e9e918840fc615', 'request_id': 'req-053f4f18-9f44-49bb-bea2-62ba6e24bc29'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:42.062411 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1026/2056] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 18 22:01:41 2022] POST /identity/v3/projects => generated 387 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 22:01:42.064004 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d2c429-ac5c-451f-be42-80559f67019b admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:42.075739 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-053f4f18-9f44-49bb-bea2-62ba6e24bc29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ea86b96f71e463c84e9e918840fc615', 'request_id': 'req-053f4f18-9f44-49bb-bea2-62ba6e24bc29'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:42.087673 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-053f4f18-9f44-49bb-bea2-62ba6e24bc29 admin admin] The token cache is being invalidate because project 3ea86b96f71e463c84e9e918840fc615 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88097) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 22:01:42.089594 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-053f4f18-9f44-49bb-bea2-62ba6e24bc29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:42.089594 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-053f4f18-9f44-49bb-bea2-62ba6e24bc29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:42.090203 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1031/2057] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 18 22:01:41 2022] DELETE /identity/v3/projects/3ea86b96f71e463c84e9e918840fc615 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:01:42.094088 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053f4f18-9f44-49bb-bea2-62ba6e24bc29 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:42.096200 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-053f4f18-9f44-49bb-bea2-62ba6e24bc29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:42.133426 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d2c429-ac5c-451f-be42-80559f67019b admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:42.139620 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6aabc1-7f60-401c-9b65-20b5260ca6e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:42.140455 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6aabc1-7f60-401c-9b65-20b5260ca6e0 admin admin] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:42.140834 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6aabc1-7f60-401c-9b65-20b5260ca6e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:42.141106 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6aabc1-7f60-401c-9b65-20b5260ca6e0 admin admin] PATH_INFO: `/v3/users` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:42.141734 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6aabc1-7f60-401c-9b65-20b5260ca6e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:42.144112 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6aabc1-7f60-401c-9b65-20b5260ca6e0 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:42.169604 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053f4f18-9f44-49bb-bea2-62ba6e24bc29 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:42.175459 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12742d21-9be0-4992-9bdd-b17a748c4c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:42.176146 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12742d21-9be0-4992-9bdd-b17a748c4c94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:42.176425 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12742d21-9be0-4992-9bdd-b17a748c4c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:42.176736 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12742d21-9be0-4992-9bdd-b17a748c4c94 admin admin] PATH_INFO: `/v3/users/f6a3652a62794d7692b167c49e37ce25` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:42.177874 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12742d21-9be0-4992-9bdd-b17a748c4c94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6a3652a62794d7692b167c49e37ce25)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:42.180082 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12742d21-9be0-4992-9bdd-b17a748c4c94 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:42.265719 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1027/2058] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 18 22:01:42 2022] POST /identity/v3/users => generated 300 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 22:01:42.270450 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6aabc1-7f60-401c-9b65-20b5260ca6e0 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:42.272310 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-9b6aabc1-7f60-401c-9b65-20b5260ca6e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:42.285131 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6aabc1-7f60-401c-9b65-20b5260ca6e0 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:42.290143 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e027fc-f12f-43b1-b094-244797b109e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:42.290763 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e027fc-f12f-43b1-b094-244797b109e3 admin admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:42.291043 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e027fc-f12f-43b1-b094-244797b109e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:42.291533 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e027fc-f12f-43b1-b094-244797b109e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:42.292374 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e027fc-f12f-43b1-b094-244797b109e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:42.296745 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e027fc-f12f-43b1-b094-244797b109e3 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:42.308011 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1028/2059] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:01:42 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 22:01:42.309692 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e027fc-f12f-43b1-b094-244797b109e3 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:42.320708 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e027fc-f12f-43b1-b094-244797b109e3 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:42.332996 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c0d5e5-acc2-49c7-8669-1b8348a2fdb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:42.332996 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c0d5e5-acc2-49c7-8669-1b8348a2fdb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:42.332996 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c0d5e5-acc2-49c7-8669-1b8348a2fdb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:42.332996 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c0d5e5-acc2-49c7-8669-1b8348a2fdb8 admin admin] PATH_INFO: `/v3/projects/a266e6916fb8421c89c2cf1960442290/users/3a08caa2fe6540f481f93a8b8e900170/roles/0833202e2a3d47d1b6b3af57006641b1` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:42.342626 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c0d5e5-acc2-49c7-8669-1b8348a2fdb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a266e6916fb8421c89c2cf1960442290, user_id=3a08caa2fe6540f481f93a8b8e900170, role_id=0833202e2a3d47d1b6b3af57006641b1)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:42.345420 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c0d5e5-acc2-49c7-8669-1b8348a2fdb8 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:42.436476 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-12742d21-9be0-4992-9bdd-b17a748c4c94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6a3652a62794d7692b167c49e37ce25'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:42.445056 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-12742d21-9be0-4992-9bdd-b17a748c4c94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6a3652a62794d7692b167c49e37ce25'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:42.445903 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-12742d21-9be0-4992-9bdd-b17a748c4c94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6a3652a62794d7692b167c49e37ce25'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:42.451865 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1029/2060] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 18 22:01:42 2022] PUT /identity/v3/projects/a266e6916fb8421c89c2cf1960442290/users/3a08caa2fe6540f481f93a8b8e900170/roles/0833202e2a3d47d1b6b3af57006641b1 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:01:42.453796 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c0d5e5-acc2-49c7-8669-1b8348a2fdb8 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:42.455794 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-d4c0d5e5-acc2-49c7-8669-1b8348a2fdb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:42.466687 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-12742d21-9be0-4992-9bdd-b17a748c4c94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6a3652a62794d7692b167c49e37ce25'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:42.530331 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c0d5e5-acc2-49c7-8669-1b8348a2fdb8 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:42.535678 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a5a7ee-8966-4c76-84a6-5b80bce6b096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:42.536316 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a5a7ee-8966-4c76-84a6-5b80bce6b096 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:42.536618 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a5a7ee-8966-4c76-84a6-5b80bce6b096 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:42.536901 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a5a7ee-8966-4c76-84a6-5b80bce6b096 admin admin] PATH_INFO: `/v3/projects/7ca17663cd16420bb43baeabba552750` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:42.538030 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a5a7ee-8966-4c76-84a6-5b80bce6b096 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ca17663cd16420bb43baeabba552750)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:42.540194 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a5a7ee-8966-4c76-84a6-5b80bce6b096 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:42.542018 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-12742d21-9be0-4992-9bdd-b17a748c4c94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6a3652a62794d7692b167c49e37ce25'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:42.549340 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1032/2061] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 18 22:01:42 2022] DELETE /identity/v3/users/f6a3652a62794d7692b167c49e37ce25 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 22:01:42.553234 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12742d21-9be0-4992-9bdd-b17a748c4c94 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:42.554714 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-12742d21-9be0-4992-9bdd-b17a748c4c94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:42.622183 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12742d21-9be0-4992-9bdd-b17a748c4c94 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:42.627572 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d261ce2e-4041-4395-a854-df6cd5f43f4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:42.628185 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d261ce2e-4041-4395-a854-df6cd5f43f4b admin admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:42.628578 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d261ce2e-4041-4395-a854-df6cd5f43f4b admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:42.628891 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d261ce2e-4041-4395-a854-df6cd5f43f4b admin admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:42.629678 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d261ce2e-4041-4395-a854-df6cd5f43f4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:42.631222 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d261ce2e-4041-4395-a854-df6cd5f43f4b admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:42.641172 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1033/2062] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:01:42 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:01:42.646096 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d261ce2e-4041-4395-a854-df6cd5f43f4b admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:42.656074 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d261ce2e-4041-4395-a854-df6cd5f43f4b admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:42.661276 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4245824c-19eb-4a6f-ae1e-2fad56c5c258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:42.661929 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4245824c-19eb-4a6f-ae1e-2fad56c5c258 admin admin] REQUEST_METHOD: `PUT` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:42.662209 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4245824c-19eb-4a6f-ae1e-2fad56c5c258 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:42.662486 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4245824c-19eb-4a6f-ae1e-2fad56c5c258 admin admin] PATH_INFO: `/v3/projects/a266e6916fb8421c89c2cf1960442290/users/3a08caa2fe6540f481f93a8b8e900170/roles/0833202e2a3d47d1b6b3af57006641b1` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:42.664406 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4245824c-19eb-4a6f-ae1e-2fad56c5c258 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a266e6916fb8421c89c2cf1960442290, user_id=3a08caa2fe6540f481f93a8b8e900170, role_id=0833202e2a3d47d1b6b3af57006641b1)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:42.667104 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4245824c-19eb-4a6f-ae1e-2fad56c5c258 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:42.677876 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1034/2063] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 18 22:01:42 2022] PUT /identity/v3/projects/a266e6916fb8421c89c2cf1960442290/users/3a08caa2fe6540f481f93a8b8e900170/roles/0833202e2a3d47d1b6b3af57006641b1 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:01:42.688401 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b71f4ed-d5fa-4e20-8bbd-ddf226e1f90a None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:42.688689 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b71f4ed-d5fa-4e20-8bbd-ddf226e1f90a None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:42.690525 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b71f4ed-d5fa-4e20-8bbd-ddf226e1f90a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:42.690647 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-32a5a7ee-8966-4c76-84a6-5b80bce6b096 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ca17663cd16420bb43baeabba552750', 'request_id': 'req-32a5a7ee-8966-4c76-84a6-5b80bce6b096'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:42.695305 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-32a5a7ee-8966-4c76-84a6-5b80bce6b096 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ca17663cd16420bb43baeabba552750', 'request_id': 'req-32a5a7ee-8966-4c76-84a6-5b80bce6b096'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:42.720041 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-6b71f4ed-d5fa-4e20-8bbd-ddf226e1f90a None None] MFA Rules not processed for user `3a08caa2fe6540f481f93a8b8e900170`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:01:42.722098 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-6b71f4ed-d5fa-4e20-8bbd-ddf226e1f90a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:42.778865 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-32a5a7ee-8966-4c76-84a6-5b80bce6b096 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ca17663cd16420bb43baeabba552750', 'request_id': 'req-32a5a7ee-8966-4c76-84a6-5b80bce6b096'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:42.793095 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-32a5a7ee-8966-4c76-84a6-5b80bce6b096 admin admin] The token cache is being invalidate because project 7ca17663cd16420bb43baeabba552750 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88096) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 22:01:42.793095 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-32a5a7ee-8966-4c76-84a6-5b80bce6b096 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:42.793848 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-32a5a7ee-8966-4c76-84a6-5b80bce6b096 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:42.799612 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1030/2064] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 18 22:01:42 2022] DELETE /identity/v3/projects/7ca17663cd16420bb43baeabba552750 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:01:42.799776 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1035/2065] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:01:42 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 22:01:42.801424 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb43bfb-1238-4bde-9948-bbc5e70b74d3 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:42.801814 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb43bfb-1238-4bde-9948-bbc5e70b74d3 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:42.802189 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb43bfb-1238-4bde-9948-bbc5e70b74d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:42.812517 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b71f4ed-d5fa-4e20-8bbd-ddf226e1f90a None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:42.819582 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-6b71f4ed-d5fa-4e20-8bbd-ddf226e1f90a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:42.833934 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-cfb43bfb-1238-4bde-9948-bbc5e70b74d3 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:01:42.835671 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-cfb43bfb-1238-4bde-9948-bbc5e70b74d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:42.932093 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b71f4ed-d5fa-4e20-8bbd-ddf226e1f90a None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:42.935700 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1031/2066] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:01:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:01:42.942540 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290e6883-12d0-4754-a16c-df463df73a31 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22b6a7c36f8a4795a75271b8079821c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:42.943133 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290e6883-12d0-4754-a16c-df463df73a31 service cinder] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:42.943421 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290e6883-12d0-4754-a16c-df463df73a31 service cinder] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:42.943702 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290e6883-12d0-4754-a16c-df463df73a31 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:42.943878 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af5c1b4-16fe-48cd-a084-06246a03cc36 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:42.944336 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af5c1b4-16fe-48cd-a084-06246a03cc36 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:42.944804 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af5c1b4-16fe-48cd-a084-06246a03cc36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:42.946538 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-290e6883-12d0-4754-a16c-df463df73a31 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:42.960056 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290e6883-12d0-4754-a16c-df463df73a31 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:42.961677 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290e6883-12d0-4754-a16c-df463df73a31 service cinder] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:42.973019 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-0af5c1b4-16fe-48cd-a084-06246a03cc36 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:01:42.974095 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1036/2067] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:01:42 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:01:42.975859 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-0af5c1b4-16fe-48cd-a084-06246a03cc36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:42.986943 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1032/2068] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:01:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 22:01:42.994942 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290e6883-12d0-4754-a16c-df463df73a31 service cinder] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:43.006703 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290e6883-12d0-4754-a16c-df463df73a31 service cinder] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:43.014264 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca9ca7f-1278-40af-8dbe-8b4eebf00467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:43.014264 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca9ca7f-1278-40af-8dbe-8b4eebf00467 admin admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:43.014264 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca9ca7f-1278-40af-8dbe-8b4eebf00467 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:43.014992 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca9ca7f-1278-40af-8dbe-8b4eebf00467 admin admin] PATH_INFO: `/v3/domains` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:43.015356 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca9ca7f-1278-40af-8dbe-8b4eebf00467 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 22:01:43.015722 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca9ca7f-1278-40af-8dbe-8b4eebf00467 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:43.017558 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca9ca7f-1278-40af-8dbe-8b4eebf00467 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:43.033913 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1037/2069] 10.222.0.27 () {58 vars in 1153 bytes} [Thu Aug 18 22:01:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 22:01:43.038180 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af5c1b4-16fe-48cd-a084-06246a03cc36 None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:43.048956 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af5c1b4-16fe-48cd-a084-06246a03cc36 None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:43.055057 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371354e3-acd9-4806-9fe9-95ee6f49dca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:43.055766 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371354e3-acd9-4806-9fe9-95ee6f49dca1 admin admin] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:43.056266 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371354e3-acd9-4806-9fe9-95ee6f49dca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:43.056623 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371354e3-acd9-4806-9fe9-95ee6f49dca1 admin admin] PATH_INFO: `/v3/projects` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:43.057336 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371354e3-acd9-4806-9fe9-95ee6f49dca1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:43.059370 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371354e3-acd9-4806-9fe9-95ee6f49dca1 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:43.130145 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:01:43.161535 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca9ca7f-1278-40af-8dbe-8b4eebf00467 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:43.162484 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1033/2070] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 18 22:01:43 2022] POST /identity/v3/projects => generated 375 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 22:01:43.163833 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-3ca9ca7f-1278-40af-8dbe-8b4eebf00467 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:43.166617 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371354e3-acd9-4806-9fe9-95ee6f49dca1 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:43.193928 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca9ca7f-1278-40af-8dbe-8b4eebf00467 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:43.230154 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:01:43.262267 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371354e3-acd9-4806-9fe9-95ee6f49dca1 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:43.268036 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf39ccc-383e-40f0-b285-04762be03d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:43.268955 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf39ccc-383e-40f0-b285-04762be03d39 admin admin] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:43.269434 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf39ccc-383e-40f0-b285-04762be03d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:43.269785 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf39ccc-383e-40f0-b285-04762be03d39 admin admin] PATH_INFO: `/v3/users` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:43.270487 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf39ccc-383e-40f0-b285-04762be03d39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:43.272503 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf39ccc-383e-40f0-b285-04762be03d39 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:43.274968 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246bf1bf-9acb-410a-a4bc-990a3869c341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:43.275606 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246bf1bf-9acb-410a-a4bc-990a3869c341 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:43.275899 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246bf1bf-9acb-410a-a4bc-990a3869c341 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:43.276166 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246bf1bf-9acb-410a-a4bc-990a3869c341 admin admin] PATH_INFO: `/v3/projects/2c03ab9912a14887a0bb67c71a29ff6d` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:43.277388 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246bf1bf-9acb-410a-a4bc-990a3869c341 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c03ab9912a14887a0bb67c71a29ff6d)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:43.279345 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246bf1bf-9acb-410a-a4bc-990a3869c341 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:43.394057 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1034/2071] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 18 22:01:43 2022] POST /identity/v3/users => generated 288 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 22:01:43.395710 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf39ccc-383e-40f0-b285-04762be03d39 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:43.405866 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf39ccc-383e-40f0-b285-04762be03d39 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:43.411355 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a7c8ca-26c7-49f2-8cda-30341609784a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:43.411957 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a7c8ca-26c7-49f2-8cda-30341609784a admin admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:43.412237 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a7c8ca-26c7-49f2-8cda-30341609784a admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:43.412512 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a7c8ca-26c7-49f2-8cda-30341609784a admin admin] PATH_INFO: `/v3/roles` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:43.413197 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a7c8ca-26c7-49f2-8cda-30341609784a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:43.414777 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a7c8ca-26c7-49f2-8cda-30341609784a admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:43.427821 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1035/2072] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:01:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 22:01:43.429036 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a7c8ca-26c7-49f2-8cda-30341609784a admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:43.439517 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a7c8ca-26c7-49f2-8cda-30341609784a admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:43.452334 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-246bf1bf-9acb-410a-a4bc-990a3869c341 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c03ab9912a14887a0bb67c71a29ff6d', 'request_id': 'req-246bf1bf-9acb-410a-a4bc-990a3869c341'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:43.458413 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-246bf1bf-9acb-410a-a4bc-990a3869c341 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c03ab9912a14887a0bb67c71a29ff6d', 'request_id': 'req-246bf1bf-9acb-410a-a4bc-990a3869c341'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:43.498780 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82556b2-231f-45c1-a445-1e96de9610f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:43.499389 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82556b2-231f-45c1-a445-1e96de9610f7 admin admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:43.499716 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82556b2-231f-45c1-a445-1e96de9610f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:43.499985 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82556b2-231f-45c1-a445-1e96de9610f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:43.500650 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82556b2-231f-45c1-a445-1e96de9610f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:43.502422 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82556b2-231f-45c1-a445-1e96de9610f7 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:43.512394 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1036/2073] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:01:43 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:01:43.516461 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82556b2-231f-45c1-a445-1e96de9610f7 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:43.526964 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82556b2-231f-45c1-a445-1e96de9610f7 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:43.535093 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5b6d61-97ca-469c-95fb-20429088eca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:43.535778 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5b6d61-97ca-469c-95fb-20429088eca8 admin admin] REQUEST_METHOD: `PUT` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:43.536058 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5b6d61-97ca-469c-95fb-20429088eca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:43.536328 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5b6d61-97ca-469c-95fb-20429088eca8 admin admin] PATH_INFO: `/v3/projects/5ebc14f7586a439590222f2f2be59085/users/eb9846eb78d047289ca1a7a423da83bb/roles/de8f2438056f4af9879423f8a59e0e0b` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:43.550832 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-246bf1bf-9acb-410a-a4bc-990a3869c341 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c03ab9912a14887a0bb67c71a29ff6d', 'request_id': 'req-246bf1bf-9acb-410a-a4bc-990a3869c341'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:43.552227 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5b6d61-97ca-469c-95fb-20429088eca8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ebc14f7586a439590222f2f2be59085, user_id=eb9846eb78d047289ca1a7a423da83bb, role_id=de8f2438056f4af9879423f8a59e0e0b)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:43.554979 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5b6d61-97ca-469c-95fb-20429088eca8 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:43.562720 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-246bf1bf-9acb-410a-a4bc-990a3869c341 admin admin] The token cache is being invalidate because project 2c03ab9912a14887a0bb67c71a29ff6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88097) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 22:01:43.563020 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-246bf1bf-9acb-410a-a4bc-990a3869c341 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:43.563672 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-246bf1bf-9acb-410a-a4bc-990a3869c341 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:43.565271 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1038/2074] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 18 22:01:43 2022] DELETE /identity/v3/projects/2c03ab9912a14887a0bb67c71a29ff6d => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 22:01:43.571070 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476eb4d9-0fef-43bc-ab43-1727e4eeb9b8 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:43.571353 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476eb4d9-0fef-43bc-ab43-1727e4eeb9b8 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:43.571672 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476eb4d9-0fef-43bc-ab43-1727e4eeb9b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:43.590330 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-476eb4d9-0fef-43bc-ab43-1727e4eeb9b8 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:01:43.591539 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-476eb4d9-0fef-43bc-ab43-1727e4eeb9b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:43.600114 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1039/2075] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:01:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 22:01:43.609722 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca761b17-f9eb-4b32-ae26-5be3196da593 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:43.610007 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca761b17-f9eb-4b32-ae26-5be3196da593 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:43.610281 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca761b17-f9eb-4b32-ae26-5be3196da593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:43.631483 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-ca761b17-f9eb-4b32-ae26-5be3196da593 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:01:43.632746 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-ca761b17-f9eb-4b32-ae26-5be3196da593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:43.640736 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1040/2076] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:01:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 22:01:43.645454 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca761b17-f9eb-4b32-ae26-5be3196da593 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:43.654440 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca761b17-f9eb-4b32-ae26-5be3196da593 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:43.660424 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ce7d6c-6a11-463c-9da8-32be9618ddd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:43.661228 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ce7d6c-6a11-463c-9da8-32be9618ddd3 admin admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:43.661774 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ce7d6c-6a11-463c-9da8-32be9618ddd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:43.661983 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ce7d6c-6a11-463c-9da8-32be9618ddd3 admin admin] PATH_INFO: `/v3/domains` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:43.662658 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ce7d6c-6a11-463c-9da8-32be9618ddd3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 22:01:43.662956 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ce7d6c-6a11-463c-9da8-32be9618ddd3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:43.664622 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ce7d6c-6a11-463c-9da8-32be9618ddd3 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:43.676364 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1041/2077] 10.222.0.27 () {58 vars in 1153 bytes} [Thu Aug 18 22:01:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 22:01:43.680948 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ce7d6c-6a11-463c-9da8-32be9618ddd3 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:43.691006 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ce7d6c-6a11-463c-9da8-32be9618ddd3 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:43.694188 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1037/2078] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 18 22:01:43 2022] PUT /identity/v3/projects/5ebc14f7586a439590222f2f2be59085/users/eb9846eb78d047289ca1a7a423da83bb/roles/de8f2438056f4af9879423f8a59e0e0b => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 22:01:43.706797 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b53e60-051e-491e-903c-8a310948b0a4 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:43.707074 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b53e60-051e-491e-903c-8a310948b0a4 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:43.707381 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b53e60-051e-491e-903c-8a310948b0a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:43.735678 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-21b53e60-051e-491e-903c-8a310948b0a4 None None] MFA Rules not processed for user `eb9846eb78d047289ca1a7a423da83bb`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:01:43.737707 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-21b53e60-051e-491e-903c-8a310948b0a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:43.746759 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4838cb98-95b8-429e-80e8-f19760591dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:43.747357 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4838cb98-95b8-429e-80e8-f19760591dda admin admin] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:43.747632 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4838cb98-95b8-429e-80e8-f19760591dda admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:43.747902 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4838cb98-95b8-429e-80e8-f19760591dda admin admin] PATH_INFO: `/v3/projects` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:43.748538 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4838cb98-95b8-429e-80e8-f19760591dda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:43.750446 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4838cb98-95b8-429e-80e8-f19760591dda admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:43.810763 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1038/2079] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:01:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 22:01:43.821909 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b53e60-051e-491e-903c-8a310948b0a4 None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:43.823270 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-21b53e60-051e-491e-903c-8a310948b0a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:43.851194 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1042/2080] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 18 22:01:43 2022] POST /identity/v3/projects => generated 365 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 22:01:43.852298 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4838cb98-95b8-429e-80e8-f19760591dda admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:43.910309 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b53e60-051e-491e-903c-8a310948b0a4 None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:43.918033 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4838cb98-95b8-429e-80e8-f19760591dda admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:43.923897 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2616ec-6e03-44f4-aa1b-15df0bd1b0f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:43.924581 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2616ec-6e03-44f4-aa1b-15df0bd1b0f2 admin admin] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:43.924998 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2616ec-6e03-44f4-aa1b-15df0bd1b0f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:43.925276 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2616ec-6e03-44f4-aa1b-15df0bd1b0f2 admin admin] PATH_INFO: `/v3/users` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:43.925901 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2616ec-6e03-44f4-aa1b-15df0bd1b0f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:43.927930 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2616ec-6e03-44f4-aa1b-15df0bd1b0f2 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:43.966794 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e148757-e535-404b-b7a9-78331f2d8038 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85dfef6a910547da9706d294e7d40fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:43.967436 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e148757-e535-404b-b7a9-78331f2d8038 service glance] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:43.967791 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e148757-e535-404b-b7a9-78331f2d8038 service glance] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:43.968136 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e148757-e535-404b-b7a9-78331f2d8038 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:44.008924 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1043/2081] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 18 22:01:43 2022] POST /identity/v3/users => generated 283 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 22:01:44.009803 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2616ec-6e03-44f4-aa1b-15df0bd1b0f2 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:44.011597 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-ee2616ec-6e03-44f4-aa1b-15df0bd1b0f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:44.025383 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2616ec-6e03-44f4-aa1b-15df0bd1b0f2 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:44.040915 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e148757-e535-404b-b7a9-78331f2d8038 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:44.042985 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a005e341-34d9-45e9-a2ed-26b8492c757f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:44.042985 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a005e341-34d9-45e9-a2ed-26b8492c757f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:44.042985 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a005e341-34d9-45e9-a2ed-26b8492c757f admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:44.043439 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e148757-e535-404b-b7a9-78331f2d8038 service glance] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:44.043529 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a005e341-34d9-45e9-a2ed-26b8492c757f admin admin] PATH_INFO: `/v3/users/0d5feb6ed8b941ac8b93914ebc039844` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:44.044039 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a005e341-34d9-45e9-a2ed-26b8492c757f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d5feb6ed8b941ac8b93914ebc039844)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:44.046104 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a005e341-34d9-45e9-a2ed-26b8492c757f admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:44.053651 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1039/2082] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:01:43 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 22:01:44.054354 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e148757-e535-404b-b7a9-78331f2d8038 service glance] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:44.071004 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e148757-e535-404b-b7a9-78331f2d8038 service glance] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:44.088224 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74955c3b-0991-40c8-af11-981a59a52086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:44.090249 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74955c3b-0991-40c8-af11-981a59a52086 admin admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:44.090249 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74955c3b-0991-40c8-af11-981a59a52086 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:44.090249 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74955c3b-0991-40c8-af11-981a59a52086 admin admin] PATH_INFO: `/v3/roles` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:44.091023 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74955c3b-0991-40c8-af11-981a59a52086 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:44.093953 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74955c3b-0991-40c8-af11-981a59a52086 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:44.120996 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1040/2083] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:01:44 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:01:44.133075 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74955c3b-0991-40c8-af11-981a59a52086 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:44.149436 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74955c3b-0991-40c8-af11-981a59a52086 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:44.154751 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4491bb2-a78c-45a6-a9db-72c6dca3e673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:44.155568 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4491bb2-a78c-45a6-a9db-72c6dca3e673 admin admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:44.155855 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4491bb2-a78c-45a6-a9db-72c6dca3e673 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:44.156133 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4491bb2-a78c-45a6-a9db-72c6dca3e673 admin admin] PATH_INFO: `/v3/roles` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:44.156865 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4491bb2-a78c-45a6-a9db-72c6dca3e673 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:44.158805 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4491bb2-a78c-45a6-a9db-72c6dca3e673 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:44.172560 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1041/2084] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:01:44 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:01:44.176178 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4491bb2-a78c-45a6-a9db-72c6dca3e673 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:44.186056 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4491bb2-a78c-45a6-a9db-72c6dca3e673 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:44.191525 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3f4d0c-527d-4033-8a12-e84f0a6294e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:44.192178 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3f4d0c-527d-4033-8a12-e84f0a6294e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:44.192782 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3f4d0c-527d-4033-8a12-e84f0a6294e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:44.193068 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3f4d0c-527d-4033-8a12-e84f0a6294e3 admin admin] PATH_INFO: `/v3/projects/07a2f24b798d4151ab8a3dd3571ef596/users/9d5921746bf041558783e996dbc5a66c/roles/de8f2438056f4af9879423f8a59e0e0b` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:44.209749 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3f4d0c-527d-4033-8a12-e84f0a6294e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07a2f24b798d4151ab8a3dd3571ef596, user_id=9d5921746bf041558783e996dbc5a66c, role_id=de8f2438056f4af9879423f8a59e0e0b)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:44.212664 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3f4d0c-527d-4033-8a12-e84f0a6294e3 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:44.221682 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-a005e341-34d9-45e9-a2ed-26b8492c757f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d5feb6ed8b941ac8b93914ebc039844'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:44.231477 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-a005e341-34d9-45e9-a2ed-26b8492c757f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d5feb6ed8b941ac8b93914ebc039844'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:44.232642 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-a005e341-34d9-45e9-a2ed-26b8492c757f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d5feb6ed8b941ac8b93914ebc039844'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:44.253224 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-a005e341-34d9-45e9-a2ed-26b8492c757f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d5feb6ed8b941ac8b93914ebc039844'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:44.287396 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1042/2085] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 18 22:01:44 2022] PUT /identity/v3/projects/07a2f24b798d4151ab8a3dd3571ef596/users/9d5921746bf041558783e996dbc5a66c/roles/de8f2438056f4af9879423f8a59e0e0b => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:01:44.299262 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc18816c-ff62-47d7-a95d-ab4dc06d603d None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:44.299546 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc18816c-ff62-47d7-a95d-ab4dc06d603d None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:44.304810 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc18816c-ff62-47d7-a95d-ab4dc06d603d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:44.323875 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-a005e341-34d9-45e9-a2ed-26b8492c757f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d5feb6ed8b941ac8b93914ebc039844'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:44.329095 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-dc18816c-ff62-47d7-a95d-ab4dc06d603d None None] MFA Rules not processed for user `9d5921746bf041558783e996dbc5a66c`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:01:44.330878 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-dc18816c-ff62-47d7-a95d-ab4dc06d603d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:44.331008 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1044/2086] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 18 22:01:44 2022] DELETE /identity/v3/users/0d5feb6ed8b941ac8b93914ebc039844 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:01:44.337776 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb203216-4d65-40eb-a90d-43eeb6445142 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:44.338305 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb203216-4d65-40eb-a90d-43eeb6445142 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:44.338886 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb203216-4d65-40eb-a90d-43eeb6445142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:44.367137 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-bb203216-4d65-40eb-a90d-43eeb6445142 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:01:44.369806 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-bb203216-4d65-40eb-a90d-43eeb6445142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:44.420748 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1043/2087] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:01:44 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:01:44.426881 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc18816c-ff62-47d7-a95d-ab4dc06d603d None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:44.430393 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-dc18816c-ff62-47d7-a95d-ab4dc06d603d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:44.444710 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:01:44.446224 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1045/2088] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:01:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:01:44.447316 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb203216-4d65-40eb-a90d-43eeb6445142 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:44.448691 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-bb203216-4d65-40eb-a90d-43eeb6445142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:44.505010 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc18816c-ff62-47d7-a95d-ab4dc06d603d None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:44.507699 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb203216-4d65-40eb-a90d-43eeb6445142 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:44.509701 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9018f42f-a8ce-4133-aff0-eda6c545db97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:44.510454 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9018f42f-a8ce-4133-aff0-eda6c545db97 admin admin] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:44.510740 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9018f42f-a8ce-4133-aff0-eda6c545db97 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:44.511026 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9018f42f-a8ce-4133-aff0-eda6c545db97 admin admin] PATH_INFO: `/v3/projects` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:44.511640 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9018f42f-a8ce-4133-aff0-eda6c545db97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:44.511865 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ed8f75-9d41-4bea-9195-4c9989c48784 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22b6a7c36f8a4795a75271b8079821c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:44.512475 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ed8f75-9d41-4bea-9195-4c9989c48784 service cinder] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:44.512791 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ed8f75-9d41-4bea-9195-4c9989c48784 service cinder] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:44.513067 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ed8f75-9d41-4bea-9195-4c9989c48784 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:44.513569 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9018f42f-a8ce-4133-aff0-eda6c545db97 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:44.514809 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-90ed8f75-9d41-4bea-9195-4c9989c48784 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:44.589966 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ed8f75-9d41-4bea-9195-4c9989c48784 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:44.591728 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ed8f75-9d41-4bea-9195-4c9989c48784 service cinder] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:44.602985 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1046/2089] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:01:44 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:01:44.604101 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ed8f75-9d41-4bea-9195-4c9989c48784 service cinder] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:44.605692 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-90ed8f75-9d41-4bea-9195-4c9989c48784 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:44.668146 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1044/2090] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 18 22:01:44 2022] POST /identity/v3/projects => generated 367 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 22:01:44.672140 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9018f42f-a8ce-4133-aff0-eda6c545db97 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:44.678375 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ed8f75-9d41-4bea-9195-4c9989c48784 service cinder] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:44.731528 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72c7d25-e558-4f76-acb7-0c232dff241d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a937971ad1a4b0c8697c764f214d446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:44.732556 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72c7d25-e558-4f76-acb7-0c232dff241d service neutron] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:44.732556 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72c7d25-e558-4f76-acb7-0c232dff241d service neutron] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:44.732781 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72c7d25-e558-4f76-acb7-0c232dff241d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:44.741268 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9018f42f-a8ce-4133-aff0-eda6c545db97 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:44.742578 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72c7d25-e558-4f76-acb7-0c232dff241d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:44.744039 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72c7d25-e558-4f76-acb7-0c232dff241d service neutron] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:44.747016 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0af89ff-7537-4918-a556-b04e57d22b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:44.747713 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0af89ff-7537-4918-a556-b04e57d22b9f admin admin] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:44.748088 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0af89ff-7537-4918-a556-b04e57d22b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:44.752951 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0af89ff-7537-4918-a556-b04e57d22b9f admin admin] PATH_INFO: `/v3/users` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:44.752951 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0af89ff-7537-4918-a556-b04e57d22b9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:44.752951 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0af89ff-7537-4918-a556-b04e57d22b9f admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:44.754494 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1047/2091] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:01:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:01:44.907108 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1045/2092] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 18 22:01:44 2022] POST /identity/v3/users => generated 290 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 22:01:44.911958 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72c7d25-e558-4f76-acb7-0c232dff241d service neutron] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:44.922096 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72c7d25-e558-4f76-acb7-0c232dff241d service neutron] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:44.929531 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c297653-c14f-44d1-a3d0-0529f7a4e74f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:44.930302 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c297653-c14f-44d1-a3d0-0529f7a4e74f admin admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:44.930500 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c297653-c14f-44d1-a3d0-0529f7a4e74f admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:44.930777 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c297653-c14f-44d1-a3d0-0529f7a4e74f admin admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:44.931428 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c297653-c14f-44d1-a3d0-0529f7a4e74f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:44.933182 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c297653-c14f-44d1-a3d0-0529f7a4e74f admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:44.945941 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1048/2093] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:01:44 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:01:44.950160 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0af89ff-7537-4918-a556-b04e57d22b9f admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:44.960902 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0af89ff-7537-4918-a556-b04e57d22b9f admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:44.966002 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759765fd-ad77-4045-bbe2-eb0449e257e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:44.966665 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759765fd-ad77-4045-bbe2-eb0449e257e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:44.966959 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759765fd-ad77-4045-bbe2-eb0449e257e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:44.970131 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759765fd-ad77-4045-bbe2-eb0449e257e7 admin admin] PATH_INFO: `/v3/projects/16a741b2fdf74a0fb30043238155e979/users/e931851f05754604ade0b4b448af7ff0/roles/0833202e2a3d47d1b6b3af57006641b1` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:44.999014 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759765fd-ad77-4045-bbe2-eb0449e257e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16a741b2fdf74a0fb30043238155e979, user_id=e931851f05754604ade0b4b448af7ff0, role_id=0833202e2a3d47d1b6b3af57006641b1)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:45.002579 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759765fd-ad77-4045-bbe2-eb0449e257e7 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:45.107010 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1046/2094] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 18 22:01:44 2022] PUT /identity/v3/projects/16a741b2fdf74a0fb30043238155e979/users/e931851f05754604ade0b4b448af7ff0/roles/0833202e2a3d47d1b6b3af57006641b1 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 22:01:45.115467 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c297653-c14f-44d1-a3d0-0529f7a4e74f admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:45.125681 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c297653-c14f-44d1-a3d0-0529f7a4e74f admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:45.130074 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=81,keystone:INSERT=5,keystone:DELETE=14 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:01:45.179152 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759765fd-ad77-4045-bbe2-eb0449e257e7 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:45.181492 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-759765fd-ad77-4045-bbe2-eb0449e257e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:45.228658 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af867aad-c78f-4a09-a830-f3d60065940a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:45.229475 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af867aad-c78f-4a09-a830-f3d60065940a admin admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:45.229865 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af867aad-c78f-4a09-a830-f3d60065940a admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:45.230243 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af867aad-c78f-4a09-a830-f3d60065940a admin admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:45.231011 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af867aad-c78f-4a09-a830-f3d60065940a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:45.232833 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af867aad-c78f-4a09-a830-f3d60065940a admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:45.247845 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1049/2095] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:01:45 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:01:45.277204 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af867aad-c78f-4a09-a830-f3d60065940a admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:45.277204 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af867aad-c78f-4a09-a830-f3d60065940a admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:45.277454 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759765fd-ad77-4045-bbe2-eb0449e257e7 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:45.277580 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7ba59d-b0c1-4b02-8d99-6243c157d14a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:45.277580 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7ba59d-b0c1-4b02-8d99-6243c157d14a admin admin] REQUEST_METHOD: `PUT` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:45.277580 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7ba59d-b0c1-4b02-8d99-6243c157d14a admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:45.277580 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7ba59d-b0c1-4b02-8d99-6243c157d14a admin admin] PATH_INFO: `/v3/projects/16a741b2fdf74a0fb30043238155e979/users/e931851f05754604ade0b4b448af7ff0/roles/0833202e2a3d47d1b6b3af57006641b1` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:45.278826 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7ba59d-b0c1-4b02-8d99-6243c157d14a admin admin] RBAC: Authorizing `identity:create_grant(project_id=16a741b2fdf74a0fb30043238155e979, user_id=e931851f05754604ade0b4b448af7ff0, role_id=0833202e2a3d47d1b6b3af57006641b1)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:45.280117 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9878150a-1a2e-45af-8371-5f15d75c65c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:45.280877 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9878150a-1a2e-45af-8371-5f15d75c65c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:45.281489 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9878150a-1a2e-45af-8371-5f15d75c65c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:45.281909 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9878150a-1a2e-45af-8371-5f15d75c65c8 admin admin] PATH_INFO: `/v3/projects/35501ba83ee34e4da7966cb4726cd8b5` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:45.282295 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7ba59d-b0c1-4b02-8d99-6243c157d14a admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:45.284557 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9878150a-1a2e-45af-8371-5f15d75c65c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35501ba83ee34e4da7966cb4726cd8b5)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:45.287032 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9878150a-1a2e-45af-8371-5f15d75c65c8 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:45.307334 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1050/2096] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 18 22:01:45 2022] PUT /identity/v3/projects/16a741b2fdf74a0fb30043238155e979/users/e931851f05754604ade0b4b448af7ff0/roles/0833202e2a3d47d1b6b3af57006641b1 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 22:01:45.317185 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70c4a14-5db5-429d-a3f5-bec1559f1e97 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:45.317618 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70c4a14-5db5-429d-a3f5-bec1559f1e97 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:45.318000 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70c4a14-5db5-429d-a3f5-bec1559f1e97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:45.358975 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-d70c4a14-5db5-429d-a3f5-bec1559f1e97 None None] MFA Rules not processed for user `e931851f05754604ade0b4b448af7ff0`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:01:45.362733 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-d70c4a14-5db5-429d-a3f5-bec1559f1e97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:45.437839 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-9878150a-1a2e-45af-8371-5f15d75c65c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35501ba83ee34e4da7966cb4726cd8b5', 'request_id': 'req-9878150a-1a2e-45af-8371-5f15d75c65c8'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:45.445008 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-9878150a-1a2e-45af-8371-5f15d75c65c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35501ba83ee34e4da7966cb4726cd8b5', 'request_id': 'req-9878150a-1a2e-45af-8371-5f15d75c65c8'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:45.457694 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1051/2097] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:01:45 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 22:01:45.495445 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70c4a14-5db5-429d-a3f5-bec1559f1e97 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:45.545988 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-9878150a-1a2e-45af-8371-5f15d75c65c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35501ba83ee34e4da7966cb4726cd8b5', 'request_id': 'req-9878150a-1a2e-45af-8371-5f15d75c65c8'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:45.554480 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70c4a14-5db5-429d-a3f5-bec1559f1e97 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:45.559432 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-9878150a-1a2e-45af-8371-5f15d75c65c8 admin admin] The token cache is being invalidate because project 35501ba83ee34e4da7966cb4726cd8b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88096) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 22:01:45.559732 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-9878150a-1a2e-45af-8371-5f15d75c65c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:45.560769 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-9878150a-1a2e-45af-8371-5f15d75c65c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:45.562685 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1047/2098] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 18 22:01:45 2022] DELETE /identity/v3/projects/35501ba83ee34e4da7966cb4726cd8b5 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 22:01:45.567334 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9878150a-1a2e-45af-8371-5f15d75c65c8 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:45.572324 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-9878150a-1a2e-45af-8371-5f15d75c65c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:45.612234 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4f627e-92cf-44a0-ab08-be7598c5a28c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22b6a7c36f8a4795a75271b8079821c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:45.612982 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4f627e-92cf-44a0-ab08-be7598c5a28c service cinder] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:45.613325 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4f627e-92cf-44a0-ab08-be7598c5a28c service cinder] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:45.613673 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4f627e-92cf-44a0-ab08-be7598c5a28c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:45.615623 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-4d4f627e-92cf-44a0-ab08-be7598c5a28c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:45.645060 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9878150a-1a2e-45af-8371-5f15d75c65c8 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:45.651134 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5866d5-250a-4160-85b8-88f8c7c2e251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:45.651776 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5866d5-250a-4160-85b8-88f8c7c2e251 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:45.652054 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5866d5-250a-4160-85b8-88f8c7c2e251 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:45.652327 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5866d5-250a-4160-85b8-88f8c7c2e251 admin admin] PATH_INFO: `/v3/users/8a775fe43a294c47b834babbb2ab13fb` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:45.653498 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5866d5-250a-4160-85b8-88f8c7c2e251 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a775fe43a294c47b834babbb2ab13fb)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:45.655690 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5866d5-250a-4160-85b8-88f8c7c2e251 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:45.688821 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4f627e-92cf-44a0-ab08-be7598c5a28c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:45.690595 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4f627e-92cf-44a0-ab08-be7598c5a28c service cinder] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:45.700867 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1052/2099] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:01:45 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 22:01:45.883930 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-ad5866d5-250a-4160-85b8-88f8c7c2e251 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a775fe43a294c47b834babbb2ab13fb'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:45.891009 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-ad5866d5-250a-4160-85b8-88f8c7c2e251 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a775fe43a294c47b834babbb2ab13fb'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:45.891673 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-ad5866d5-250a-4160-85b8-88f8c7c2e251 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a775fe43a294c47b834babbb2ab13fb'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:45.892362 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-ad5866d5-250a-4160-85b8-88f8c7c2e251 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a775fe43a294c47b834babbb2ab13fb'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:45.905224 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-ad5866d5-250a-4160-85b8-88f8c7c2e251 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a775fe43a294c47b834babbb2ab13fb'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:45.967566 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4f627e-92cf-44a0-ab08-be7598c5a28c service cinder] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:45.969072 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-4d4f627e-92cf-44a0-ab08-be7598c5a28c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:45.975745 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1048/2100] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 18 22:01:45 2022] DELETE /identity/v3/users/8a775fe43a294c47b834babbb2ab13fb => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 22:01:45.980011 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4f627e-92cf-44a0-ab08-be7598c5a28c service cinder] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:46.037080 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:01:46.039079 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9968d90-8146-4060-94e5-9ee0a70b56ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22b6a7c36f8a4795a75271b8079821c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:46.039738 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9968d90-8146-4060-94e5-9ee0a70b56ad service cinder] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:46.040006 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9968d90-8146-4060-94e5-9ee0a70b56ad service cinder] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:46.040285 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9968d90-8146-4060-94e5-9ee0a70b56ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:46.042325 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-e9968d90-8146-4060-94e5-9ee0a70b56ad service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:46.106639 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9968d90-8146-4060-94e5-9ee0a70b56ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:46.108220 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9968d90-8146-4060-94e5-9ee0a70b56ad service cinder] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:46.117978 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1053/2101] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:01:45 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 22:01:46.447298 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5866d5-250a-4160-85b8-88f8c7c2e251 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:46.447298 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-ad5866d5-250a-4160-85b8-88f8c7c2e251 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:46.539301 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5866d5-250a-4160-85b8-88f8c7c2e251 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:46.544066 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d026587-00a1-4c52-b1f3-f71dae578a05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:46.544736 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d026587-00a1-4c52-b1f3-f71dae578a05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:46.545023 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d026587-00a1-4c52-b1f3-f71dae578a05 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:46.545293 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d026587-00a1-4c52-b1f3-f71dae578a05 admin admin] PATH_INFO: `/v3/projects/6cf25c6e8dd8408ba26dbdc76619fc4f` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:46.546455 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d026587-00a1-4c52-b1f3-f71dae578a05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6cf25c6e8dd8408ba26dbdc76619fc4f)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:46.549046 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d026587-00a1-4c52-b1f3-f71dae578a05 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:46.666998 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-1d026587-00a1-4c52-b1f3-f71dae578a05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6cf25c6e8dd8408ba26dbdc76619fc4f', 'request_id': 'req-1d026587-00a1-4c52-b1f3-f71dae578a05'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:46.672372 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-1d026587-00a1-4c52-b1f3-f71dae578a05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6cf25c6e8dd8408ba26dbdc76619fc4f', 'request_id': 'req-1d026587-00a1-4c52-b1f3-f71dae578a05'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:46.780764 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-1d026587-00a1-4c52-b1f3-f71dae578a05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6cf25c6e8dd8408ba26dbdc76619fc4f', 'request_id': 'req-1d026587-00a1-4c52-b1f3-f71dae578a05'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:46.797937 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-1d026587-00a1-4c52-b1f3-f71dae578a05 admin admin] The token cache is being invalidate because project 6cf25c6e8dd8408ba26dbdc76619fc4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88096) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 22:01:46.797937 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-1d026587-00a1-4c52-b1f3-f71dae578a05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:46.797937 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-1d026587-00a1-4c52-b1f3-f71dae578a05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:46.814964 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1049/2102] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 18 22:01:46 2022] DELETE /identity/v3/projects/6cf25c6e8dd8408ba26dbdc76619fc4f => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:01:46.816123 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf1cb4e-60ea-403d-acdb-48d11811eb1b None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:46.816123 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf1cb4e-60ea-403d-acdb-48d11811eb1b None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:46.816123 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf1cb4e-60ea-403d-acdb-48d11811eb1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:46.839407 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-aaf1cb4e-60ea-403d-acdb-48d11811eb1b None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:01:46.839407 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-aaf1cb4e-60ea-403d-acdb-48d11811eb1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:46.863410 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d026587-00a1-4c52-b1f3-f71dae578a05 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:46.863410 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-1d026587-00a1-4c52-b1f3-f71dae578a05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:46.912829 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1054/2103] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:01:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 22:01:46.921092 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f600bb-0f34-4f4b-83f4-6eb0202f6e10 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:46.921384 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f600bb-0f34-4f4b-83f4-6eb0202f6e10 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:46.921833 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f600bb-0f34-4f4b-83f4-6eb0202f6e10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:46.944731 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-a1f600bb-0f34-4f4b-83f4-6eb0202f6e10 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:01:46.946017 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-a1f600bb-0f34-4f4b-83f4-6eb0202f6e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:46.951902 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d026587-00a1-4c52-b1f3-f71dae578a05 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:46.955380 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1055/2104] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:01:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:01:46.958775 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b6f972-646a-4df2-b31c-907224786324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:46.958775 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b6f972-646a-4df2-b31c-907224786324 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:46.958775 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b6f972-646a-4df2-b31c-907224786324 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:46.959078 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b6f972-646a-4df2-b31c-907224786324 admin admin] PATH_INFO: `/v3/users/b4fb9ff29f09419cb6d67f3ae2788b6e` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:46.959725 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f600bb-0f34-4f4b-83f4-6eb0202f6e10 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:46.960230 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b6f972-646a-4df2-b31c-907224786324 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4fb9ff29f09419cb6d67f3ae2788b6e)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:46.962202 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b6f972-646a-4df2-b31c-907224786324 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:46.969122 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f600bb-0f34-4f4b-83f4-6eb0202f6e10 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:46.975297 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7609037-feb0-4448-94a9-5c919202931f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:46.975907 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7609037-feb0-4448-94a9-5c919202931f admin admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:46.976186 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7609037-feb0-4448-94a9-5c919202931f admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:46.977765 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7609037-feb0-4448-94a9-5c919202931f admin admin] PATH_INFO: `/v3/domains` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:46.977765 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7609037-feb0-4448-94a9-5c919202931f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 22:01:46.977765 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7609037-feb0-4448-94a9-5c919202931f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:46.979187 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7609037-feb0-4448-94a9-5c919202931f admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:46.996073 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1056/2105] 10.222.0.27 () {58 vars in 1153 bytes} [Thu Aug 18 22:01:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 22:01:46.997259 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7609037-feb0-4448-94a9-5c919202931f admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:47.007541 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7609037-feb0-4448-94a9-5c919202931f admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:47.012462 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30d43f9-6841-4182-85c8-94036ef085ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:47.013163 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30d43f9-6841-4182-85c8-94036ef085ca admin admin] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:47.013444 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30d43f9-6841-4182-85c8-94036ef085ca admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:47.013720 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30d43f9-6841-4182-85c8-94036ef085ca admin admin] PATH_INFO: `/v3/projects` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:47.014344 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30d43f9-6841-4182-85c8-94036ef085ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:47.016251 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30d43f9-6841-4182-85c8-94036ef085ca admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:47.114533 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1057/2106] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 18 22:01:46 2022] POST /identity/v3/projects => generated 385 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 22:01:47.118697 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30d43f9-6841-4182-85c8-94036ef085ca admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:47.186149 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30d43f9-6841-4182-85c8-94036ef085ca admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:47.188866 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:01:47.193910 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56d3666-ddf8-4a3f-997e-f8a5c470c15e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:47.196268 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56d3666-ddf8-4a3f-997e-f8a5c470c15e admin admin] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:47.196268 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56d3666-ddf8-4a3f-997e-f8a5c470c15e admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:47.196268 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56d3666-ddf8-4a3f-997e-f8a5c470c15e admin admin] PATH_INFO: `/v3/users` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:47.196268 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56d3666-ddf8-4a3f-997e-f8a5c470c15e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:47.197898 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56d3666-ddf8-4a3f-997e-f8a5c470c15e admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:47.203449 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-e2b6f972-646a-4df2-b31c-907224786324 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4fb9ff29f09419cb6d67f3ae2788b6e'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:47.211429 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-e2b6f972-646a-4df2-b31c-907224786324 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4fb9ff29f09419cb6d67f3ae2788b6e'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:47.212125 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-e2b6f972-646a-4df2-b31c-907224786324 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4fb9ff29f09419cb6d67f3ae2788b6e'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:47.212769 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-e2b6f972-646a-4df2-b31c-907224786324 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4fb9ff29f09419cb6d67f3ae2788b6e'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:47.225190 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-e2b6f972-646a-4df2-b31c-907224786324 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4fb9ff29f09419cb6d67f3ae2788b6e'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:47.250043 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:01:47.284157 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1058/2107] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 18 22:01:47 2022] POST /identity/v3/users => generated 293 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 22:01:47.288238 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56d3666-ddf8-4a3f-997e-f8a5c470c15e admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:47.289997 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-d56d3666-ddf8-4a3f-997e-f8a5c470c15e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:47.302338 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56d3666-ddf8-4a3f-997e-f8a5c470c15e admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:47.307157 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ae2ece-7e04-4c8c-9c56-8c0622bea3ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:47.311097 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae2ece-7e04-4c8c-9c56-8c0622bea3ee admin admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:47.311097 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae2ece-7e04-4c8c-9c56-8c0622bea3ee admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:47.311097 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae2ece-7e04-4c8c-9c56-8c0622bea3ee admin admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:47.311097 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ae2ece-7e04-4c8c-9c56-8c0622bea3ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:47.311097 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ae2ece-7e04-4c8c-9c56-8c0622bea3ee admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:47.312663 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1050/2108] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 18 22:01:46 2022] DELETE /identity/v3/users/b4fb9ff29f09419cb6d67f3ae2788b6e => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 22:01:47.317658 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e8b0fa-3e9b-4a49-a39a-c84b94f32376 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:47.317943 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e8b0fa-3e9b-4a49-a39a-c84b94f32376 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:47.318212 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e8b0fa-3e9b-4a49-a39a-c84b94f32376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:47.321911 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1059/2109] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:01:47 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:01:47.325752 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ae2ece-7e04-4c8c-9c56-8c0622bea3ee admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:47.336060 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ae2ece-7e04-4c8c-9c56-8c0622bea3ee admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:47.337918 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-f8e8b0fa-3e9b-4a49-a39a-c84b94f32376 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:01:47.339120 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-f8e8b0fa-3e9b-4a49-a39a-c84b94f32376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:47.394101 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd89663d-a5ea-4aef-b3a6-c69310998d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:47.394661 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd89663d-a5ea-4aef-b3a6-c69310998d8e admin admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:47.394938 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd89663d-a5ea-4aef-b3a6-c69310998d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:47.395215 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd89663d-a5ea-4aef-b3a6-c69310998d8e admin admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:47.395900 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd89663d-a5ea-4aef-b3a6-c69310998d8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:47.397546 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd89663d-a5ea-4aef-b3a6-c69310998d8e admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:47.399824 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1051/2110] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:01:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:01:47.408070 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1060/2111] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:01:47 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:01:47.409755 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e8b0fa-3e9b-4a49-a39a-c84b94f32376 None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:47.411338 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-f8e8b0fa-3e9b-4a49-a39a-c84b94f32376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:47.412288 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd89663d-a5ea-4aef-b3a6-c69310998d8e admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:47.422763 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd89663d-a5ea-4aef-b3a6-c69310998d8e admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:47.427702 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578b3538-af3f-40e3-a930-5a6f240858bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:47.428353 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578b3538-af3f-40e3-a930-5a6f240858bd admin admin] REQUEST_METHOD: `PUT` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:47.428654 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578b3538-af3f-40e3-a930-5a6f240858bd admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:47.428938 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578b3538-af3f-40e3-a930-5a6f240858bd admin admin] PATH_INFO: `/v3/projects/232560b72ac343cfbc9b41ccb48fa68f/users/92f2dbff1eac497f905790c0cf6a3242/roles/de8f2438056f4af9879423f8a59e0e0b` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:47.444102 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578b3538-af3f-40e3-a930-5a6f240858bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=232560b72ac343cfbc9b41ccb48fa68f, user_id=92f2dbff1eac497f905790c0cf6a3242, role_id=de8f2438056f4af9879423f8a59e0e0b)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:47.446777 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578b3538-af3f-40e3-a930-5a6f240858bd admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:47.469403 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e8b0fa-3e9b-4a49-a39a-c84b94f32376 None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:47.473759 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf0a477-99a2-49ae-b870-88c227875f63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a937971ad1a4b0c8697c764f214d446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:47.474376 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf0a477-99a2-49ae-b870-88c227875f63 service neutron] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:47.474651 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf0a477-99a2-49ae-b870-88c227875f63 service neutron] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:47.474918 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf0a477-99a2-49ae-b870-88c227875f63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:47.484140 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf0a477-99a2-49ae-b870-88c227875f63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:47.485583 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf0a477-99a2-49ae-b870-88c227875f63 service neutron] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:47.495623 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1052/2112] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:01:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:01:47.552965 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1061/2113] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 18 22:01:47 2022] PUT /identity/v3/projects/232560b72ac343cfbc9b41ccb48fa68f/users/92f2dbff1eac497f905790c0cf6a3242/roles/de8f2438056f4af9879423f8a59e0e0b => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 22:01:47.563758 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b0ac8f-e6cf-46dd-b64f-6e3df8a89dfa None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:47.564046 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b0ac8f-e6cf-46dd-b64f-6e3df8a89dfa None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:47.564471 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b0ac8f-e6cf-46dd-b64f-6e3df8a89dfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:47.598777 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-f7b0ac8f-e6cf-46dd-b64f-6e3df8a89dfa None None] MFA Rules not processed for user `92f2dbff1eac497f905790c0cf6a3242`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:01:47.600125 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-f7b0ac8f-e6cf-46dd-b64f-6e3df8a89dfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:47.672712 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1053/2114] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:01:47 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 22:01:47.687268 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578b3538-af3f-40e3-a930-5a6f240858bd admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:47.688543 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-578b3538-af3f-40e3-a930-5a6f240858bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:47.762502 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578b3538-af3f-40e3-a930-5a6f240858bd admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:47.766617 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ef020d-316b-4d77-835e-304cf1a296ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22b6a7c36f8a4795a75271b8079821c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:47.768042 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ef020d-316b-4d77-835e-304cf1a296ac service cinder] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:47.768903 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ef020d-316b-4d77-835e-304cf1a296ac service cinder] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:47.769209 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ef020d-316b-4d77-835e-304cf1a296ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:47.781694 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ef020d-316b-4d77-835e-304cf1a296ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:47.784585 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ef020d-316b-4d77-835e-304cf1a296ac service cinder] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:47.794705 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1062/2115] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:01:47 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 22:01:47.998420 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b0ac8f-e6cf-46dd-b64f-6e3df8a89dfa None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:47.999677 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-f7b0ac8f-e6cf-46dd-b64f-6e3df8a89dfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:48.077837 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b0ac8f-e6cf-46dd-b64f-6e3df8a89dfa None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:48.089981 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0362d702-296d-4b2e-9468-294a496763a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:48.090817 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0362d702-296d-4b2e-9468-294a496763a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:48.091095 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0362d702-296d-4b2e-9468-294a496763a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:48.091391 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0362d702-296d-4b2e-9468-294a496763a4 admin admin] PATH_INFO: `/v3/projects/3ebdd1b8003240aabe50804032eb7407` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:48.092518 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0362d702-296d-4b2e-9468-294a496763a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ebdd1b8003240aabe50804032eb7407)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:48.094665 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0362d702-296d-4b2e-9468-294a496763a4 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:48.287860 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-0362d702-296d-4b2e-9468-294a496763a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ebdd1b8003240aabe50804032eb7407', 'request_id': 'req-0362d702-296d-4b2e-9468-294a496763a4'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:48.294584 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-0362d702-296d-4b2e-9468-294a496763a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ebdd1b8003240aabe50804032eb7407', 'request_id': 'req-0362d702-296d-4b2e-9468-294a496763a4'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:48.378683 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-0362d702-296d-4b2e-9468-294a496763a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ebdd1b8003240aabe50804032eb7407', 'request_id': 'req-0362d702-296d-4b2e-9468-294a496763a4'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:48.390658 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-0362d702-296d-4b2e-9468-294a496763a4 admin admin] The token cache is being invalidate because project 3ebdd1b8003240aabe50804032eb7407 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88096) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 22:01:48.390960 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-0362d702-296d-4b2e-9468-294a496763a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:48.391623 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-0362d702-296d-4b2e-9468-294a496763a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:48.393666 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1054/2116] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 18 22:01:47 2022] DELETE /identity/v3/projects/3ebdd1b8003240aabe50804032eb7407 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:01:48.398742 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c144b9-a0c1-45ec-9517-827dd497dd50 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:48.399274 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c144b9-a0c1-45ec-9517-827dd497dd50 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:48.399274 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c144b9-a0c1-45ec-9517-827dd497dd50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:48.418985 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-08c144b9-a0c1-45ec-9517-827dd497dd50 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:01:48.420250 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-08c144b9-a0c1-45ec-9517-827dd497dd50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:48.480777 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1063/2117] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:01:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:01:48.489779 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade09787-cf5e-4e73-b991-6bc3fff2a824 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:48.490318 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade09787-cf5e-4e73-b991-6bc3fff2a824 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:48.490318 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade09787-cf5e-4e73-b991-6bc3fff2a824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:48.511642 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-ade09787-cf5e-4e73-b991-6bc3fff2a824 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:01:48.512875 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-ade09787-cf5e-4e73-b991-6bc3fff2a824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:48.521436 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1055/2118] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:01:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:01:48.525928 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c144b9-a0c1-45ec-9517-827dd497dd50 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:48.535927 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c144b9-a0c1-45ec-9517-827dd497dd50 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:48.540570 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223886c2-91e6-4c2c-a957-19faa3d052d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:48.541187 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223886c2-91e6-4c2c-a957-19faa3d052d5 admin admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:48.541463 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223886c2-91e6-4c2c-a957-19faa3d052d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:48.541734 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223886c2-91e6-4c2c-a957-19faa3d052d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:48.542365 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223886c2-91e6-4c2c-a957-19faa3d052d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 22:01:48.542666 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223886c2-91e6-4c2c-a957-19faa3d052d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:48.544373 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223886c2-91e6-4c2c-a957-19faa3d052d5 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:48.557271 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1064/2119] 10.222.0.27 () {58 vars in 1153 bytes} [Thu Aug 18 22:01:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 22:01:48.561691 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade09787-cf5e-4e73-b991-6bc3fff2a824 None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:48.572034 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade09787-cf5e-4e73-b991-6bc3fff2a824 None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:48.576803 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fccf211-dcc8-418c-813e-008cf0ca2243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:48.577404 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fccf211-dcc8-418c-813e-008cf0ca2243 admin admin] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:48.577685 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fccf211-dcc8-418c-813e-008cf0ca2243 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:48.577958 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fccf211-dcc8-418c-813e-008cf0ca2243 admin admin] PATH_INFO: `/v3/projects` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:48.578591 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fccf211-dcc8-418c-813e-008cf0ca2243 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:48.580893 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fccf211-dcc8-418c-813e-008cf0ca2243 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:48.682286 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:01:48.698562 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1056/2120] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 18 22:01:48 2022] POST /identity/v3/projects => generated 369 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 22:01:48.707431 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223886c2-91e6-4c2c-a957-19faa3d052d5 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:48.717678 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223886c2-91e6-4c2c-a957-19faa3d052d5 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:48.770151 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:01:48.785285 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f058de2-b6cd-4f1e-8045-e1f43e3dd548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:48.785950 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f058de2-b6cd-4f1e-8045-e1f43e3dd548 admin admin] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:48.786289 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f058de2-b6cd-4f1e-8045-e1f43e3dd548 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:48.786566 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f058de2-b6cd-4f1e-8045-e1f43e3dd548 admin admin] PATH_INFO: `/v3/users` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:48.787213 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f058de2-b6cd-4f1e-8045-e1f43e3dd548 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:48.789422 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f058de2-b6cd-4f1e-8045-e1f43e3dd548 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:48.925890 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1065/2121] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 18 22:01:48 2022] POST /identity/v3/users => generated 285 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 22:01:48.930197 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fccf211-dcc8-418c-813e-008cf0ca2243 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:48.940975 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fccf211-dcc8-418c-813e-008cf0ca2243 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:48.945875 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93779c02-7975-4d50-8bf9-2750bc463559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:48.946706 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93779c02-7975-4d50-8bf9-2750bc463559 admin admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:48.946706 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93779c02-7975-4d50-8bf9-2750bc463559 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:48.946871 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93779c02-7975-4d50-8bf9-2750bc463559 admin admin] PATH_INFO: `/v3/roles` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:48.947501 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93779c02-7975-4d50-8bf9-2750bc463559 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:48.949243 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93779c02-7975-4d50-8bf9-2750bc463559 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:48.961326 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1057/2122] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:01:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:01:48.965377 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f058de2-b6cd-4f1e-8045-e1f43e3dd548 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:48.976563 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f058de2-b6cd-4f1e-8045-e1f43e3dd548 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:48.982133 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39253151-3093-4ff6-ab04-904fa6f2d56c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:48.982750 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39253151-3093-4ff6-ab04-904fa6f2d56c admin admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:48.983029 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39253151-3093-4ff6-ab04-904fa6f2d56c admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:48.983421 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39253151-3093-4ff6-ab04-904fa6f2d56c admin admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:48.984103 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39253151-3093-4ff6-ab04-904fa6f2d56c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:48.985855 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39253151-3093-4ff6-ab04-904fa6f2d56c admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:49.001173 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1066/2123] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:01:48 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:01:49.006989 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93779c02-7975-4d50-8bf9-2750bc463559 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:49.018150 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93779c02-7975-4d50-8bf9-2750bc463559 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:49.022862 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6da055-466d-4855-9e7e-11848e4fade1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:49.024138 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6da055-466d-4855-9e7e-11848e4fade1 admin admin] REQUEST_METHOD: `PUT` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:49.024427 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6da055-466d-4855-9e7e-11848e4fade1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:49.024793 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6da055-466d-4855-9e7e-11848e4fade1 admin admin] PATH_INFO: `/v3/projects/b53c1c4e590f4e898bc52849c651b7ad/users/80c5fd702a034900a7603f248fc6c2ab/roles/de8f2438056f4af9879423f8a59e0e0b` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:49.039246 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6da055-466d-4855-9e7e-11848e4fade1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b53c1c4e590f4e898bc52849c651b7ad, user_id=80c5fd702a034900a7603f248fc6c2ab, role_id=de8f2438056f4af9879423f8a59e0e0b)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:49.041885 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6da055-466d-4855-9e7e-11848e4fade1 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:49.105419 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1058/2124] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 18 22:01:49 2022] PUT /identity/v3/projects/b53c1c4e590f4e898bc52849c651b7ad/users/80c5fd702a034900a7603f248fc6c2ab/roles/de8f2438056f4af9879423f8a59e0e0b => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 22:01:49.121672 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aac0ad-ba19-41e5-9a2b-7c977b1c3e2b None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:49.121672 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aac0ad-ba19-41e5-9a2b-7c977b1c3e2b None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:49.121672 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aac0ad-ba19-41e5-9a2b-7c977b1c3e2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:49.148223 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-16aac0ad-ba19-41e5-9a2b-7c977b1c3e2b None None] MFA Rules not processed for user `80c5fd702a034900a7603f248fc6c2ab`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:01:49.149828 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-16aac0ad-ba19-41e5-9a2b-7c977b1c3e2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:49.217040 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1067/2125] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:01:49 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:01:49.222467 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6da055-466d-4855-9e7e-11848e4fade1 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:49.286634 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6da055-466d-4855-9e7e-11848e4fade1 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:49.291446 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a588526d-7d2f-498b-8d8c-94d6d6515c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:49.292057 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a588526d-7d2f-498b-8d8c-94d6d6515c5f admin admin] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:49.292340 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a588526d-7d2f-498b-8d8c-94d6d6515c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:49.292781 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a588526d-7d2f-498b-8d8c-94d6d6515c5f admin admin] PATH_INFO: `/v3/projects` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:49.293278 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a588526d-7d2f-498b-8d8c-94d6d6515c5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:49.295571 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a588526d-7d2f-498b-8d8c-94d6d6515c5f admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:49.379041 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1059/2126] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 18 22:01:49 2022] POST /identity/v3/projects => generated 367 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 22:01:49.381483 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aac0ad-ba19-41e5-9a2b-7c977b1c3e2b None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:49.393420 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aac0ad-ba19-41e5-9a2b-7c977b1c3e2b None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:49.453599 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f39b30-d810-422b-9d18-6f17697b3eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:49.454232 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f39b30-d810-422b-9d18-6f17697b3eb7 admin admin] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:49.454538 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f39b30-d810-422b-9d18-6f17697b3eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:49.454902 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f39b30-d810-422b-9d18-6f17697b3eb7 admin admin] PATH_INFO: `/v3/users` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:49.455733 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f39b30-d810-422b-9d18-6f17697b3eb7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:49.457791 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f39b30-d810-422b-9d18-6f17697b3eb7 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:49.501772 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:01:49.542811 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1068/2127] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 18 22:01:49 2022] POST /identity/v3/users => generated 290 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 22:01:49.551687 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a588526d-7d2f-498b-8d8c-94d6d6515c5f admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:49.562941 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a588526d-7d2f-498b-8d8c-94d6d6515c5f admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:49.568025 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a56cd7-c5a4-423b-b1cd-428ca47ee341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:49.568669 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a56cd7-c5a4-423b-b1cd-428ca47ee341 admin admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:49.568951 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a56cd7-c5a4-423b-b1cd-428ca47ee341 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:49.569220 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a56cd7-c5a4-423b-b1cd-428ca47ee341 admin admin] PATH_INFO: `/v3/roles` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:49.569865 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a56cd7-c5a4-423b-b1cd-428ca47ee341 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:49.571445 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a56cd7-c5a4-423b-b1cd-428ca47ee341 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:49.582209 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1060/2128] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:01:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:01:49.586646 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f39b30-d810-422b-9d18-6f17697b3eb7 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:49.597893 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f39b30-d810-422b-9d18-6f17697b3eb7 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:49.602670 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79c5d14-61b7-404b-ba7a-2749f4deb966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:49.603318 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79c5d14-61b7-404b-ba7a-2749f4deb966 admin admin] REQUEST_METHOD: `PUT` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:49.603598 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79c5d14-61b7-404b-ba7a-2749f4deb966 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:49.603873 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79c5d14-61b7-404b-ba7a-2749f4deb966 admin admin] PATH_INFO: `/v3/projects/6957e0e8f0bd4c13a49393f5ec47c0b0/users/6c14c6473bcd4dbd88c56adaccf6aca2/roles/0833202e2a3d47d1b6b3af57006641b1` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:49.619067 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79c5d14-61b7-404b-ba7a-2749f4deb966 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6957e0e8f0bd4c13a49393f5ec47c0b0, user_id=6c14c6473bcd4dbd88c56adaccf6aca2, role_id=0833202e2a3d47d1b6b3af57006641b1)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:49.621907 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79c5d14-61b7-404b-ba7a-2749f4deb966 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:49.720442 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1069/2129] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 18 22:01:49 2022] PUT /identity/v3/projects/6957e0e8f0bd4c13a49393f5ec47c0b0/users/6c14c6473bcd4dbd88c56adaccf6aca2/roles/0833202e2a3d47d1b6b3af57006641b1 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 22:01:49.724485 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a56cd7-c5a4-423b-b1cd-428ca47ee341 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:49.735331 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a56cd7-c5a4-423b-b1cd-428ca47ee341 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:49.802764 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5112860a-36ea-4dfc-a664-cf80546da513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:49.803548 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5112860a-36ea-4dfc-a664-cf80546da513 admin admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:49.803995 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5112860a-36ea-4dfc-a664-cf80546da513 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:49.804282 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5112860a-36ea-4dfc-a664-cf80546da513 admin admin] PATH_INFO: `/v3/roles` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:49.804935 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:01:49.805078 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5112860a-36ea-4dfc-a664-cf80546da513 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:49.806913 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5112860a-36ea-4dfc-a664-cf80546da513 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:49.824211 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1061/2130] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:01:49 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 22:01:49.828150 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79c5d14-61b7-404b-ba7a-2749f4deb966 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:49.841696 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79c5d14-61b7-404b-ba7a-2749f4deb966 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:49.848211 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88efb60-ef05-4319-bd22-8e0255104af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:49.848923 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88efb60-ef05-4319-bd22-8e0255104af0 admin admin] REQUEST_METHOD: `PUT` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:49.849398 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88efb60-ef05-4319-bd22-8e0255104af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:49.849506 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88efb60-ef05-4319-bd22-8e0255104af0 admin admin] PATH_INFO: `/v3/projects/6957e0e8f0bd4c13a49393f5ec47c0b0/users/6c14c6473bcd4dbd88c56adaccf6aca2/roles/0833202e2a3d47d1b6b3af57006641b1` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:49.852752 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88efb60-ef05-4319-bd22-8e0255104af0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6957e0e8f0bd4c13a49393f5ec47c0b0, user_id=6c14c6473bcd4dbd88c56adaccf6aca2, role_id=0833202e2a3d47d1b6b3af57006641b1)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:49.855853 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88efb60-ef05-4319-bd22-8e0255104af0 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:49.879904 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1070/2131] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 18 22:01:49 2022] PUT /identity/v3/projects/6957e0e8f0bd4c13a49393f5ec47c0b0/users/6c14c6473bcd4dbd88c56adaccf6aca2/roles/0833202e2a3d47d1b6b3af57006641b1 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:01:49.890655 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fad81f6-1711-4e0d-acba-3a350d4740a5 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:49.891193 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fad81f6-1711-4e0d-acba-3a350d4740a5 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:49.891573 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fad81f6-1711-4e0d-acba-3a350d4740a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:49.937804 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-0fad81f6-1711-4e0d-acba-3a350d4740a5 None None] MFA Rules not processed for user `6c14c6473bcd4dbd88c56adaccf6aca2`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:01:49.939704 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-0fad81f6-1711-4e0d-acba-3a350d4740a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:50.010194 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1062/2132] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:01:49 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:01:50.023175 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88efb60-ef05-4319-bd22-8e0255104af0 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:50.025178 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-a88efb60-ef05-4319-bd22-8e0255104af0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:50.084673 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88efb60-ef05-4319-bd22-8e0255104af0 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:50.088477 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a100e48-d74c-4e46-ac5d-64d52399b84a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22b6a7c36f8a4795a75271b8079821c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:50.089021 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a100e48-d74c-4e46-ac5d-64d52399b84a service cinder] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:50.089300 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a100e48-d74c-4e46-ac5d-64d52399b84a service cinder] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:50.089572 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a100e48-d74c-4e46-ac5d-64d52399b84a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:50.099212 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a100e48-d74c-4e46-ac5d-64d52399b84a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:50.100689 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a100e48-d74c-4e46-ac5d-64d52399b84a service cinder] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:50.110679 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1071/2133] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:01:50 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:01:50.516860 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:01:50.570584 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:01:51.073636 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:01:51.159271 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:01:51.236634 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fad81f6-1711-4e0d-acba-3a350d4740a5 None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:51.246550 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fad81f6-1711-4e0d-acba-3a350d4740a5 None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:51.250325 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f3aa46-c19b-4b7b-b4ab-df9d819d9283 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22b6a7c36f8a4795a75271b8079821c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:51.250936 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f3aa46-c19b-4b7b-b4ab-df9d819d9283 service cinder] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:51.251222 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f3aa46-c19b-4b7b-b4ab-df9d819d9283 service cinder] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:51.252019 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f3aa46-c19b-4b7b-b4ab-df9d819d9283 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:51.254250 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-d6f3aa46-c19b-4b7b-b4ab-df9d819d9283 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:51.318321 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f3aa46-c19b-4b7b-b4ab-df9d819d9283 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:51.319702 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f3aa46-c19b-4b7b-b4ab-df9d819d9283 service cinder] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:51.332737 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1063/2134] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:01:51 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:01:51.384843 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:01:51.407597 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a100e48-d74c-4e46-ac5d-64d52399b84a service cinder] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:51.410307 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-3a100e48-d74c-4e46-ac5d-64d52399b84a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:51.488375 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a100e48-d74c-4e46-ac5d-64d52399b84a service cinder] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:51.492908 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983b2d56-b3dd-4be7-9d5b-4efda31ee73b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:51.493533 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983b2d56-b3dd-4be7-9d5b-4efda31ee73b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:51.493813 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983b2d56-b3dd-4be7-9d5b-4efda31ee73b admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:51.494086 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983b2d56-b3dd-4be7-9d5b-4efda31ee73b admin admin] PATH_INFO: `/v3/users/92f2dbff1eac497f905790c0cf6a3242` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:51.495204 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983b2d56-b3dd-4be7-9d5b-4efda31ee73b admin admin] RBAC: Authorizing `identity:delete_user(user_id=92f2dbff1eac497f905790c0cf6a3242)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:51.497216 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983b2d56-b3dd-4be7-9d5b-4efda31ee73b admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:51.682512 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-983b2d56-b3dd-4be7-9d5b-4efda31ee73b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92f2dbff1eac497f905790c0cf6a3242'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:51.689994 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-983b2d56-b3dd-4be7-9d5b-4efda31ee73b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92f2dbff1eac497f905790c0cf6a3242'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:51.690657 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-983b2d56-b3dd-4be7-9d5b-4efda31ee73b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92f2dbff1eac497f905790c0cf6a3242'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:51.702609 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-983b2d56-b3dd-4be7-9d5b-4efda31ee73b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92f2dbff1eac497f905790c0cf6a3242'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:51.799628 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-983b2d56-b3dd-4be7-9d5b-4efda31ee73b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92f2dbff1eac497f905790c0cf6a3242'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:51.807016 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1072/2135] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 18 22:01:51 2022] DELETE /identity/v3/users/92f2dbff1eac497f905790c0cf6a3242 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:01:51.811515 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e5b6a9-d1ec-478c-9e22-34a273f6f2de None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:51.812010 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e5b6a9-d1ec-478c-9e22-34a273f6f2de None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:51.812173 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e5b6a9-d1ec-478c-9e22-34a273f6f2de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:51.831227 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-d5e5b6a9-d1ec-478c-9e22-34a273f6f2de None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:01:51.833807 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:01:51.834691 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-d5e5b6a9-d1ec-478c-9e22-34a273f6f2de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:51.902157 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1064/2136] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:01:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:01:51.912654 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983b2d56-b3dd-4be7-9d5b-4efda31ee73b admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:51.914206 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-983b2d56-b3dd-4be7-9d5b-4efda31ee73b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:51.976341 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983b2d56-b3dd-4be7-9d5b-4efda31ee73b admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:51.980583 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323d00d5-2ed0-4cb5-a442-c508e52d9b97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a937971ad1a4b0c8697c764f214d446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:51.981231 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323d00d5-2ed0-4cb5-a442-c508e52d9b97 service neutron] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:51.981515 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323d00d5-2ed0-4cb5-a442-c508e52d9b97 service neutron] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:51.981794 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323d00d5-2ed0-4cb5-a442-c508e52d9b97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:51.992513 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323d00d5-2ed0-4cb5-a442-c508e52d9b97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:51.994041 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323d00d5-2ed0-4cb5-a442-c508e52d9b97 service neutron] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:52.004655 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1073/2137] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:01:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:01:52.010368 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:01:52.442550 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e5b6a9-d1ec-478c-9e22-34a273f6f2de None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:52.444229 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-d5e5b6a9-d1ec-478c-9e22-34a273f6f2de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:52.458381 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e5b6a9-d1ec-478c-9e22-34a273f6f2de None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:52.465566 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514e439e-8a40-4352-95fd-d124347158c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:52.466552 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514e439e-8a40-4352-95fd-d124347158c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:52.467061 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514e439e-8a40-4352-95fd-d124347158c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:52.467541 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514e439e-8a40-4352-95fd-d124347158c0 admin admin] PATH_INFO: `/v3/projects/232560b72ac343cfbc9b41ccb48fa68f` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:52.469118 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514e439e-8a40-4352-95fd-d124347158c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=232560b72ac343cfbc9b41ccb48fa68f)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:52.471975 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514e439e-8a40-4352-95fd-d124347158c0 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:52.509949 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:01:52.627683 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-514e439e-8a40-4352-95fd-d124347158c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '232560b72ac343cfbc9b41ccb48fa68f', 'request_id': 'req-514e439e-8a40-4352-95fd-d124347158c0'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:52.633773 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-514e439e-8a40-4352-95fd-d124347158c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '232560b72ac343cfbc9b41ccb48fa68f', 'request_id': 'req-514e439e-8a40-4352-95fd-d124347158c0'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:52.734052 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-514e439e-8a40-4352-95fd-d124347158c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '232560b72ac343cfbc9b41ccb48fa68f', 'request_id': 'req-514e439e-8a40-4352-95fd-d124347158c0'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:52.754124 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-514e439e-8a40-4352-95fd-d124347158c0 admin admin] The token cache is being invalidate because project 232560b72ac343cfbc9b41ccb48fa68f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88096) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 22:01:52.754419 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-514e439e-8a40-4352-95fd-d124347158c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:52.755095 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-514e439e-8a40-4352-95fd-d124347158c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:52.756613 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1065/2138] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 18 22:01:52 2022] DELETE /identity/v3/projects/232560b72ac343cfbc9b41ccb48fa68f => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:01:53.070797 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:01:53.517606 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:01:53.759405 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:01:53.997329 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:01:54.174983 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323d00d5-2ed0-4cb5-a442-c508e52d9b97 service neutron] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:54.179685 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-323d00d5-2ed0-4cb5-a442-c508e52d9b97 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:54.190813 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323d00d5-2ed0-4cb5-a442-c508e52d9b97 service neutron] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:54.248786 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cffe97d-c302-49cb-b92d-564281a11bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:54.249747 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cffe97d-c302-49cb-b92d-564281a11bab admin admin] REQUEST_METHOD: `DELETE` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:54.249933 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cffe97d-c302-49cb-b92d-564281a11bab admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:54.250117 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cffe97d-c302-49cb-b92d-564281a11bab admin admin] PATH_INFO: `/v3/users/9d5921746bf041558783e996dbc5a66c` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:54.251264 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cffe97d-c302-49cb-b92d-564281a11bab admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d5921746bf041558783e996dbc5a66c)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:54.253587 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cffe97d-c302-49cb-b92d-564281a11bab admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:54.425481 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:01:54.468352 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-8cffe97d-c302-49cb-b92d-564281a11bab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d5921746bf041558783e996dbc5a66c'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:54.477321 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-8cffe97d-c302-49cb-b92d-564281a11bab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d5921746bf041558783e996dbc5a66c'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:54.478068 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-8cffe97d-c302-49cb-b92d-564281a11bab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d5921746bf041558783e996dbc5a66c'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:54.493399 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-8cffe97d-c302-49cb-b92d-564281a11bab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d5921746bf041558783e996dbc5a66c'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:54.622308 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-8cffe97d-c302-49cb-b92d-564281a11bab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d5921746bf041558783e996dbc5a66c'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:54.631206 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1074/2139] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 18 22:01:54 2022] DELETE /identity/v3/users/9d5921746bf041558783e996dbc5a66c => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:01:54.635942 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc04c2db-19e2-491b-8830-9cf8007b1331 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:54.636417 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc04c2db-19e2-491b-8830-9cf8007b1331 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:54.636534 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc04c2db-19e2-491b-8830-9cf8007b1331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:54.656811 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-fc04c2db-19e2-491b-8830-9cf8007b1331 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:01:54.658033 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-fc04c2db-19e2-491b-8830-9cf8007b1331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:54.722047 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1066/2140] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:01:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:01:54.732295 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cffe97d-c302-49cb-b92d-564281a11bab admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:54.734078 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-8cffe97d-c302-49cb-b92d-564281a11bab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:54.795703 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cffe97d-c302-49cb-b92d-564281a11bab admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:54.800673 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8051ed84-1f6c-4c81-9e33-ab67e716f331 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a937971ad1a4b0c8697c764f214d446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:54.801290 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8051ed84-1f6c-4c81-9e33-ab67e716f331 service neutron] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:54.801581 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8051ed84-1f6c-4c81-9e33-ab67e716f331 service neutron] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:54.801859 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8051ed84-1f6c-4c81-9e33-ab67e716f331 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:54.811511 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8051ed84-1f6c-4c81-9e33-ab67e716f331 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:54.812989 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8051ed84-1f6c-4c81-9e33-ab67e716f331 service neutron] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:54.823912 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1075/2141] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:01:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:01:54.893210 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc04c2db-19e2-491b-8830-9cf8007b1331 None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:54.894921 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-fc04c2db-19e2-491b-8830-9cf8007b1331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:54.913731 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc04c2db-19e2-491b-8830-9cf8007b1331 None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:54.918725 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dbb2b5-f86d-43eb-93f3-21b9b8400d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:54.919513 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dbb2b5-f86d-43eb-93f3-21b9b8400d4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:54.919807 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dbb2b5-f86d-43eb-93f3-21b9b8400d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:54.920988 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dbb2b5-f86d-43eb-93f3-21b9b8400d4c admin admin] PATH_INFO: `/v3/users/80c5fd702a034900a7603f248fc6c2ab` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:54.921439 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dbb2b5-f86d-43eb-93f3-21b9b8400d4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=80c5fd702a034900a7603f248fc6c2ab)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:54.923596 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dbb2b5-f86d-43eb-93f3-21b9b8400d4c admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:54.939857 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:01:55.016372 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=92,keystone:DELETE=3,keystone:INSERT=5 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:01:55.166336 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-d9dbb2b5-f86d-43eb-93f3-21b9b8400d4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80c5fd702a034900a7603f248fc6c2ab'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:55.174200 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-d9dbb2b5-f86d-43eb-93f3-21b9b8400d4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80c5fd702a034900a7603f248fc6c2ab'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:55.175167 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-d9dbb2b5-f86d-43eb-93f3-21b9b8400d4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80c5fd702a034900a7603f248fc6c2ab'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:55.175864 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-d9dbb2b5-f86d-43eb-93f3-21b9b8400d4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80c5fd702a034900a7603f248fc6c2ab'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:55.196529 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-d9dbb2b5-f86d-43eb-93f3-21b9b8400d4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80c5fd702a034900a7603f248fc6c2ab'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:55.271200 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:01:55.278000 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8051ed84-1f6c-4c81-9e33-ab67e716f331 service neutron] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:55.281972 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1067/2142] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 18 22:01:54 2022] DELETE /identity/v3/users/80c5fd702a034900a7603f248fc6c2ab => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:01:55.282094 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-8051ed84-1f6c-4c81-9e33-ab67e716f331 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:55.283749 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bd7447-6d09-4115-97a5-f3e6f8f98aa0 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:55.290246 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bd7447-6d09-4115-97a5-f3e6f8f98aa0 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:55.290742 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bd7447-6d09-4115-97a5-f3e6f8f98aa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:55.301912 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8051ed84-1f6c-4c81-9e33-ab67e716f331 service neutron] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:55.322070 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-73bd7447-6d09-4115-97a5-f3e6f8f98aa0 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:01:55.323301 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-73bd7447-6d09-4115-97a5-f3e6f8f98aa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:55.359890 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69663e89-ef53-46ed-97e9-1be5630be1c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:55.360615 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69663e89-ef53-46ed-97e9-1be5630be1c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:55.360922 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69663e89-ef53-46ed-97e9-1be5630be1c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:55.361958 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69663e89-ef53-46ed-97e9-1be5630be1c9 admin admin] PATH_INFO: `/v3/projects/07a2f24b798d4151ab8a3dd3571ef596` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:55.363166 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69663e89-ef53-46ed-97e9-1be5630be1c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07a2f24b798d4151ab8a3dd3571ef596)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:55.365154 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69663e89-ef53-46ed-97e9-1be5630be1c9 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:55.386017 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1068/2143] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:01:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:01:55.396699 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bd7447-6d09-4115-97a5-f3e6f8f98aa0 None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:55.399861 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-73bd7447-6d09-4115-97a5-f3e6f8f98aa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:55.457059 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bd7447-6d09-4115-97a5-f3e6f8f98aa0 None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:55.460738 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aa02b9-c7a9-4b10-a182-12d6d1c136c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a937971ad1a4b0c8697c764f214d446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:55.462422 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aa02b9-c7a9-4b10-a182-12d6d1c136c2 service neutron] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:55.462422 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aa02b9-c7a9-4b10-a182-12d6d1c136c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:55.462422 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aa02b9-c7a9-4b10-a182-12d6d1c136c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:55.471972 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aa02b9-c7a9-4b10-a182-12d6d1c136c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:55.473444 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aa02b9-c7a9-4b10-a182-12d6d1c136c2 service neutron] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:55.483469 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1069/2144] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:01:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 22:01:55.500857 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-69663e89-ef53-46ed-97e9-1be5630be1c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07a2f24b798d4151ab8a3dd3571ef596', 'request_id': 'req-69663e89-ef53-46ed-97e9-1be5630be1c9'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:55.508134 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-69663e89-ef53-46ed-97e9-1be5630be1c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07a2f24b798d4151ab8a3dd3571ef596', 'request_id': 'req-69663e89-ef53-46ed-97e9-1be5630be1c9'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:55.613551 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-69663e89-ef53-46ed-97e9-1be5630be1c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07a2f24b798d4151ab8a3dd3571ef596', 'request_id': 'req-69663e89-ef53-46ed-97e9-1be5630be1c9'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:55.625849 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-69663e89-ef53-46ed-97e9-1be5630be1c9 admin admin] The token cache is being invalidate because project 07a2f24b798d4151ab8a3dd3571ef596 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88097) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 22:01:55.626151 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-69663e89-ef53-46ed-97e9-1be5630be1c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:55.627348 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-69663e89-ef53-46ed-97e9-1be5630be1c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:55.629028 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1076/2145] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 18 22:01:55 2022] DELETE /identity/v3/projects/07a2f24b798d4151ab8a3dd3571ef596 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 22:01:55.632984 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aa02b9-c7a9-4b10-a182-12d6d1c136c2 service neutron] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:55.634382 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-88aa02b9-c7a9-4b10-a182-12d6d1c136c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:55.649879 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aa02b9-c7a9-4b10-a182-12d6d1c136c2 service neutron] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:55.717244 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d999f408-b7d4-4b7c-8239-49db9ba1d05a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:55.719390 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d999f408-b7d4-4b7c-8239-49db9ba1d05a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:55.719390 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d999f408-b7d4-4b7c-8239-49db9ba1d05a admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:55.719390 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d999f408-b7d4-4b7c-8239-49db9ba1d05a admin admin] PATH_INFO: `/v3/users/e931851f05754604ade0b4b448af7ff0` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:55.719645 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d999f408-b7d4-4b7c-8239-49db9ba1d05a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e931851f05754604ade0b4b448af7ff0)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:55.721971 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d999f408-b7d4-4b7c-8239-49db9ba1d05a admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:55.907148 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69663e89-ef53-46ed-97e9-1be5630be1c9 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:55.907148 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-69663e89-ef53-46ed-97e9-1be5630be1c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:55.923570 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69663e89-ef53-46ed-97e9-1be5630be1c9 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:55.928894 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d4e90b-0111-49d0-ae80-ce7858b38b7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:55.929562 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d4e90b-0111-49d0-ae80-ce7858b38b7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:55.929841 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d4e90b-0111-49d0-ae80-ce7858b38b7f admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:55.930119 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d4e90b-0111-49d0-ae80-ce7858b38b7f admin admin] PATH_INFO: `/v3/projects/b53c1c4e590f4e898bc52849c651b7ad` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:55.931287 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d4e90b-0111-49d0-ae80-ce7858b38b7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b53c1c4e590f4e898bc52849c651b7ad)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:55.933468 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d4e90b-0111-49d0-ae80-ce7858b38b7f admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:55.938372 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-d999f408-b7d4-4b7c-8239-49db9ba1d05a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e931851f05754604ade0b4b448af7ff0'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:55.953178 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-d999f408-b7d4-4b7c-8239-49db9ba1d05a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e931851f05754604ade0b4b448af7ff0'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:55.953928 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-d999f408-b7d4-4b7c-8239-49db9ba1d05a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e931851f05754604ade0b4b448af7ff0'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:55.956761 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-d999f408-b7d4-4b7c-8239-49db9ba1d05a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e931851f05754604ade0b4b448af7ff0'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:55.968581 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-d999f408-b7d4-4b7c-8239-49db9ba1d05a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e931851f05754604ade0b4b448af7ff0'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:56.044308 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1070/2146] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 18 22:01:55 2022] DELETE /identity/v3/users/e931851f05754604ade0b4b448af7ff0 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:01:56.048277 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d999f408-b7d4-4b7c-8239-49db9ba1d05a admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:56.049779 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-d999f408-b7d4-4b7c-8239-49db9ba1d05a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:56.091120 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-65d4e90b-0111-49d0-ae80-ce7858b38b7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b53c1c4e590f4e898bc52849c651b7ad', 'request_id': 'req-65d4e90b-0111-49d0-ae80-ce7858b38b7f'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:56.098536 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-65d4e90b-0111-49d0-ae80-ce7858b38b7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b53c1c4e590f4e898bc52849c651b7ad', 'request_id': 'req-65d4e90b-0111-49d0-ae80-ce7858b38b7f'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:56.125657 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d999f408-b7d4-4b7c-8239-49db9ba1d05a admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:56.185510 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be73e51-5cec-451f-a08e-8b571dda1ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:56.186155 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be73e51-5cec-451f-a08e-8b571dda1ba0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:56.186436 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be73e51-5cec-451f-a08e-8b571dda1ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:56.186707 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be73e51-5cec-451f-a08e-8b571dda1ba0 admin admin] PATH_INFO: `/v3/users/03909a1620d84e0b9be6a754230057f9` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:56.187881 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be73e51-5cec-451f-a08e-8b571dda1ba0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=03909a1620d84e0b9be6a754230057f9)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:56.190432 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be73e51-5cec-451f-a08e-8b571dda1ba0 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:56.191918 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-65d4e90b-0111-49d0-ae80-ce7858b38b7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b53c1c4e590f4e898bc52849c651b7ad', 'request_id': 'req-65d4e90b-0111-49d0-ae80-ce7858b38b7f'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:56.205703 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-65d4e90b-0111-49d0-ae80-ce7858b38b7f admin admin] The token cache is being invalidate because project b53c1c4e590f4e898bc52849c651b7ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88097) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 22:01:56.206023 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-65d4e90b-0111-49d0-ae80-ce7858b38b7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:56.206665 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-65d4e90b-0111-49d0-ae80-ce7858b38b7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:56.208633 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1077/2147] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 18 22:01:55 2022] DELETE /identity/v3/projects/b53c1c4e590f4e898bc52849c651b7ad => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 22:01:56.212436 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d4e90b-0111-49d0-ae80-ce7858b38b7f admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:56.214006 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-65d4e90b-0111-49d0-ae80-ce7858b38b7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:56.227075 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d4e90b-0111-49d0-ae80-ce7858b38b7f admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:56.231627 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff65f19-5f7a-493c-9961-8e4f43329968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:56.232246 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff65f19-5f7a-493c-9961-8e4f43329968 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:56.232525 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff65f19-5f7a-493c-9961-8e4f43329968 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:56.232825 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff65f19-5f7a-493c-9961-8e4f43329968 admin admin] PATH_INFO: `/v3/users/6c14c6473bcd4dbd88c56adaccf6aca2` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:56.233939 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff65f19-5f7a-493c-9961-8e4f43329968 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c14c6473bcd4dbd88c56adaccf6aca2)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:56.235864 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff65f19-5f7a-493c-9961-8e4f43329968 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:56.351030 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:01:56.414119 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-6be73e51-5cec-451f-a08e-8b571dda1ba0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03909a1620d84e0b9be6a754230057f9'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:56.421164 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-6be73e51-5cec-451f-a08e-8b571dda1ba0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03909a1620d84e0b9be6a754230057f9'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:56.421887 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-6be73e51-5cec-451f-a08e-8b571dda1ba0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03909a1620d84e0b9be6a754230057f9'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:56.422515 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-6be73e51-5cec-451f-a08e-8b571dda1ba0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03909a1620d84e0b9be6a754230057f9'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:56.437685 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-6be73e51-5cec-451f-a08e-8b571dda1ba0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03909a1620d84e0b9be6a754230057f9'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:56.445778 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-5ff65f19-5f7a-493c-9961-8e4f43329968 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c14c6473bcd4dbd88c56adaccf6aca2'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:56.456203 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-5ff65f19-5f7a-493c-9961-8e4f43329968 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c14c6473bcd4dbd88c56adaccf6aca2'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:56.456402 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-5ff65f19-5f7a-493c-9961-8e4f43329968 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c14c6473bcd4dbd88c56adaccf6aca2'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:56.470129 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-5ff65f19-5f7a-493c-9961-8e4f43329968 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c14c6473bcd4dbd88c56adaccf6aca2'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:56.550519 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1071/2148] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 18 22:01:56 2022] DELETE /identity/v3/users/03909a1620d84e0b9be6a754230057f9 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:01:56.552497 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be73e51-5cec-451f-a08e-8b571dda1ba0 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:56.554734 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-6be73e51-5cec-451f-a08e-8b571dda1ba0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:56.613447 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-5ff65f19-5f7a-493c-9961-8e4f43329968 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c14c6473bcd4dbd88c56adaccf6aca2'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:56.621297 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1078/2149] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 18 22:01:56 2022] DELETE /identity/v3/users/6c14c6473bcd4dbd88c56adaccf6aca2 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 22:01:56.623087 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70d55a8-9aa2-460e-b948-66e86148bf91 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:56.623622 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70d55a8-9aa2-460e-b948-66e86148bf91 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:56.623957 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70d55a8-9aa2-460e-b948-66e86148bf91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:56.634091 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be73e51-5cec-451f-a08e-8b571dda1ba0 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:56.668461 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-b70d55a8-9aa2-460e-b948-66e86148bf91 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:01:56.669675 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-b70d55a8-9aa2-460e-b948-66e86148bf91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:56.716628 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6cc865-f6f8-4f7d-aed3-b1aae4a531f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:56.717240 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6cc865-f6f8-4f7d-aed3-b1aae4a531f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:56.717758 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6cc865-f6f8-4f7d-aed3-b1aae4a531f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:56.717876 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6cc865-f6f8-4f7d-aed3-b1aae4a531f1 admin admin] PATH_INFO: `/v3/projects/16a741b2fdf74a0fb30043238155e979` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:56.719308 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6cc865-f6f8-4f7d-aed3-b1aae4a531f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16a741b2fdf74a0fb30043238155e979)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:56.722743 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6cc865-f6f8-4f7d-aed3-b1aae4a531f1 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:56.737941 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1079/2150] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:01:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:01:56.757490 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70d55a8-9aa2-460e-b948-66e86148bf91 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:56.759494 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-b70d55a8-9aa2-460e-b948-66e86148bf91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:56.773989 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:01:56.822068 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70d55a8-9aa2-460e-b948-66e86148bf91 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:56.826804 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7363e21-0425-46ca-8336-1cb54dfdb0fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a937971ad1a4b0c8697c764f214d446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:56.827701 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7363e21-0425-46ca-8336-1cb54dfdb0fa service neutron] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:56.828088 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7363e21-0425-46ca-8336-1cb54dfdb0fa service neutron] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:56.828478 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7363e21-0425-46ca-8336-1cb54dfdb0fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:56.839433 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7363e21-0425-46ca-8336-1cb54dfdb0fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:56.841061 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7363e21-0425-46ca-8336-1cb54dfdb0fa service neutron] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:56.851754 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1080/2151] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:01:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:01:56.897034 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-cc6cc865-f6f8-4f7d-aed3-b1aae4a531f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16a741b2fdf74a0fb30043238155e979', 'request_id': 'req-cc6cc865-f6f8-4f7d-aed3-b1aae4a531f1'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:56.903777 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-cc6cc865-f6f8-4f7d-aed3-b1aae4a531f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16a741b2fdf74a0fb30043238155e979', 'request_id': 'req-cc6cc865-f6f8-4f7d-aed3-b1aae4a531f1'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:56.963923 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-cc6cc865-f6f8-4f7d-aed3-b1aae4a531f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16a741b2fdf74a0fb30043238155e979', 'request_id': 'req-cc6cc865-f6f8-4f7d-aed3-b1aae4a531f1'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:56.979061 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-cc6cc865-f6f8-4f7d-aed3-b1aae4a531f1 admin admin] The token cache is being invalidate because project 16a741b2fdf74a0fb30043238155e979 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88096) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 22:01:56.979533 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-cc6cc865-f6f8-4f7d-aed3-b1aae4a531f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:56.980525 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-cc6cc865-f6f8-4f7d-aed3-b1aae4a531f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:56.986190 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1072/2152] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 18 22:01:56 2022] DELETE /identity/v3/projects/16a741b2fdf74a0fb30043238155e979 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 22:01:56.992052 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9c401c-9d9f-4cda-87c2-551abdd7fff8 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:56.995633 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9c401c-9d9f-4cda-87c2-551abdd7fff8 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:56.995633 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9c401c-9d9f-4cda-87c2-551abdd7fff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:57.015938 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-4e9c401c-9d9f-4cda-87c2-551abdd7fff8 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:01:57.017313 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-4e9c401c-9d9f-4cda-87c2-551abdd7fff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:57.085063 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1081/2153] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:01:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:01:57.093012 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bff77f4-0d1b-4e47-96b9-a6b0ce716ce2 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:57.093370 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bff77f4-0d1b-4e47-96b9-a6b0ce716ce2 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:57.093674 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bff77f4-0d1b-4e47-96b9-a6b0ce716ce2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:57.115314 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-2bff77f4-0d1b-4e47-96b9-a6b0ce716ce2 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:01:57.116816 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-2bff77f4-0d1b-4e47-96b9-a6b0ce716ce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:57.118661 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9c401c-9d9f-4cda-87c2-551abdd7fff8 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:57.126412 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-4e9c401c-9d9f-4cda-87c2-551abdd7fff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:57.141325 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9c401c-9d9f-4cda-87c2-551abdd7fff8 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:57.147827 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1073/2154] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:01:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:01:57.154968 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96372b19-7c16-43f3-832e-0ac21dc6f4fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:57.155272 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bff77f4-0d1b-4e47-96b9-a6b0ce716ce2 None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:57.155370 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96372b19-7c16-43f3-832e-0ac21dc6f4fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:57.155370 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96372b19-7c16-43f3-832e-0ac21dc6f4fc admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:57.155370 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96372b19-7c16-43f3-832e-0ac21dc6f4fc admin admin] PATH_INFO: `/v3/projects/6957e0e8f0bd4c13a49393f5ec47c0b0` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:57.155370 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96372b19-7c16-43f3-832e-0ac21dc6f4fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=6957e0e8f0bd4c13a49393f5ec47c0b0)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:57.157630 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96372b19-7c16-43f3-832e-0ac21dc6f4fc admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:57.163917 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bff77f4-0d1b-4e47-96b9-a6b0ce716ce2 None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:57.170007 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40effa29-b242-4b9d-98b1-3c98f48d4f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:57.170702 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40effa29-b242-4b9d-98b1-3c98f48d4f46 admin admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:57.171173 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40effa29-b242-4b9d-98b1-3c98f48d4f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:57.171474 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40effa29-b242-4b9d-98b1-3c98f48d4f46 admin admin] PATH_INFO: `/v3/domains` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:57.172196 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40effa29-b242-4b9d-98b1-3c98f48d4f46 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 22:01:57.172544 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40effa29-b242-4b9d-98b1-3c98f48d4f46 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:57.174590 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40effa29-b242-4b9d-98b1-3c98f48d4f46 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:57.187694 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1074/2155] 10.222.0.27 () {58 vars in 1153 bytes} [Thu Aug 18 22:01:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 22:01:57.192724 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40effa29-b242-4b9d-98b1-3c98f48d4f46 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:57.202672 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40effa29-b242-4b9d-98b1-3c98f48d4f46 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:57.207782 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eed1b1-7edb-4cfb-9c7b-9bf384e3a26b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:57.208394 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eed1b1-7edb-4cfb-9c7b-9bf384e3a26b admin admin] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:57.208711 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eed1b1-7edb-4cfb-9c7b-9bf384e3a26b admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:57.211816 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eed1b1-7edb-4cfb-9c7b-9bf384e3a26b admin admin] PATH_INFO: `/v3/projects` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:57.211816 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0eed1b1-7edb-4cfb-9c7b-9bf384e3a26b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:57.211816 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0eed1b1-7edb-4cfb-9c7b-9bf384e3a26b admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:57.309853 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-96372b19-7c16-43f3-832e-0ac21dc6f4fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6957e0e8f0bd4c13a49393f5ec47c0b0', 'request_id': 'req-96372b19-7c16-43f3-832e-0ac21dc6f4fc'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:57.316320 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-96372b19-7c16-43f3-832e-0ac21dc6f4fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6957e0e8f0bd4c13a49393f5ec47c0b0', 'request_id': 'req-96372b19-7c16-43f3-832e-0ac21dc6f4fc'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:57.329456 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1075/2156] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 18 22:01:57 2022] POST /identity/v3/projects => generated 385 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 22:01:57.334270 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eed1b1-7edb-4cfb-9c7b-9bf384e3a26b admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:57.402121 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-96372b19-7c16-43f3-832e-0ac21dc6f4fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6957e0e8f0bd4c13a49393f5ec47c0b0', 'request_id': 'req-96372b19-7c16-43f3-832e-0ac21dc6f4fc'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:57.404399 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eed1b1-7edb-4cfb-9c7b-9bf384e3a26b admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:57.409820 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e04968-fb8f-49b0-a219-4f19cc354bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:57.410449 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e04968-fb8f-49b0-a219-4f19cc354bfd admin admin] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:57.411370 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e04968-fb8f-49b0-a219-4f19cc354bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:57.411370 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e04968-fb8f-49b0-a219-4f19cc354bfd admin admin] PATH_INFO: `/v3/users` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:57.411700 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e04968-fb8f-49b0-a219-4f19cc354bfd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:57.413710 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e04968-fb8f-49b0-a219-4f19cc354bfd admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:57.418249 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-96372b19-7c16-43f3-832e-0ac21dc6f4fc admin admin] The token cache is being invalidate because project 6957e0e8f0bd4c13a49393f5ec47c0b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88097) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 22:01:57.418540 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-96372b19-7c16-43f3-832e-0ac21dc6f4fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:57.419212 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-96372b19-7c16-43f3-832e-0ac21dc6f4fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:57.420731 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1082/2157] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 18 22:01:57 2022] DELETE /identity/v3/projects/6957e0e8f0bd4c13a49393f5ec47c0b0 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 22:01:57.426193 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379f94b4-c9cb-4efa-a7b4-9c58cf201141 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:57.426442 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379f94b4-c9cb-4efa-a7b4-9c58cf201141 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:57.426714 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379f94b4-c9cb-4efa-a7b4-9c58cf201141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:57.447840 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-379f94b4-c9cb-4efa-a7b4-9c58cf201141 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:01:57.449081 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-379f94b4-c9cb-4efa-a7b4-9c58cf201141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:57.457620 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1083/2158] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:01:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 22:01:57.466548 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315216d3-fc2f-487e-b10d-8896f5531974 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:57.466829 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315216d3-fc2f-487e-b10d-8896f5531974 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:57.467104 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315216d3-fc2f-487e-b10d-8896f5531974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:57.487897 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-315216d3-fc2f-487e-b10d-8896f5531974 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:01:57.489090 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-315216d3-fc2f-487e-b10d-8896f5531974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:57.497383 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1084/2159] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:01:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 22:01:57.498195 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315216d3-fc2f-487e-b10d-8896f5531974 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:57.499890 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-315216d3-fc2f-487e-b10d-8896f5531974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:57.515533 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315216d3-fc2f-487e-b10d-8896f5531974 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:57.521526 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4b4452-1281-4e61-bf91-f2f1a9fd6ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:57.522194 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4b4452-1281-4e61-bf91-f2f1a9fd6ab1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:57.522477 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4b4452-1281-4e61-bf91-f2f1a9fd6ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:57.522772 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4b4452-1281-4e61-bf91-f2f1a9fd6ab1 admin admin] PATH_INFO: `/v3/projects/26cab4cc68f34e8396cbb1846f12fe3a` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:57.524155 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4b4452-1281-4e61-bf91-f2f1a9fd6ab1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26cab4cc68f34e8396cbb1846f12fe3a)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:57.526110 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4b4452-1281-4e61-bf91-f2f1a9fd6ab1 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:57.531609 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1076/2160] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 18 22:01:57 2022] POST /identity/v3/users => generated 293 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 22:01:57.536168 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e04968-fb8f-49b0-a219-4f19cc354bfd admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:57.548029 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e04968-fb8f-49b0-a219-4f19cc354bfd admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:57.553302 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83769dec-3a81-4bed-ae65-f3018a592fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:57.553985 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83769dec-3a81-4bed-ae65-f3018a592fd8 admin admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:57.554330 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83769dec-3a81-4bed-ae65-f3018a592fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:57.554743 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83769dec-3a81-4bed-ae65-f3018a592fd8 admin admin] PATH_INFO: `/v3/domains` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:57.555610 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83769dec-3a81-4bed-ae65-f3018a592fd8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 22:01:57.556101 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83769dec-3a81-4bed-ae65-f3018a592fd8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:57.557859 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83769dec-3a81-4bed-ae65-f3018a592fd8 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:57.576216 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1077/2161] 10.222.0.27 () {58 vars in 1153 bytes} [Thu Aug 18 22:01:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 22:01:57.577228 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83769dec-3a81-4bed-ae65-f3018a592fd8 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:57.578904 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-83769dec-3a81-4bed-ae65-f3018a592fd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:57.592860 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83769dec-3a81-4bed-ae65-f3018a592fd8 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:57.598690 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065adc56-1ec7-4d2c-a946-3e9e2d34dd6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:57.599330 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065adc56-1ec7-4d2c-a946-3e9e2d34dd6e admin admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:57.599611 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065adc56-1ec7-4d2c-a946-3e9e2d34dd6e admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:57.599883 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065adc56-1ec7-4d2c-a946-3e9e2d34dd6e admin admin] PATH_INFO: `/v3/roles` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:57.600571 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065adc56-1ec7-4d2c-a946-3e9e2d34dd6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:57.602312 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065adc56-1ec7-4d2c-a946-3e9e2d34dd6e admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:57.616576 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1078/2162] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:01:57 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:01:57.616576 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065adc56-1ec7-4d2c-a946-3e9e2d34dd6e admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:57.624126 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065adc56-1ec7-4d2c-a946-3e9e2d34dd6e admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:57.628935 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbdc2e0-ffa4-4c10-9d5c-f54e88c58a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:57.629572 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbdc2e0-ffa4-4c10-9d5c-f54e88c58a41 admin admin] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:57.629851 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbdc2e0-ffa4-4c10-9d5c-f54e88c58a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:57.630120 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbdc2e0-ffa4-4c10-9d5c-f54e88c58a41 admin admin] PATH_INFO: `/v3/projects` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:57.630736 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbdc2e0-ffa4-4c10-9d5c-f54e88c58a41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:57.632695 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbdc2e0-ffa4-4c10-9d5c-f54e88c58a41 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:57.695403 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-8c4b4452-1281-4e61-bf91-f2f1a9fd6ab1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26cab4cc68f34e8396cbb1846f12fe3a', 'request_id': 'req-8c4b4452-1281-4e61-bf91-f2f1a9fd6ab1'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:57.701829 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-8c4b4452-1281-4e61-bf91-f2f1a9fd6ab1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26cab4cc68f34e8396cbb1846f12fe3a', 'request_id': 'req-8c4b4452-1281-4e61-bf91-f2f1a9fd6ab1'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:57.710317 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1079/2163] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 18 22:01:57 2022] POST /identity/v3/projects => generated 385 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 22:01:57.711978 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbdc2e0-ffa4-4c10-9d5c-f54e88c58a41 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:57.775376 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbdc2e0-ffa4-4c10-9d5c-f54e88c58a41 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:57.780455 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f98c75-5155-4d98-9742-f6cf11992c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:57.781128 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f98c75-5155-4d98-9742-f6cf11992c0d admin admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:57.781410 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f98c75-5155-4d98-9742-f6cf11992c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:57.781700 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f98c75-5155-4d98-9742-f6cf11992c0d admin admin] PATH_INFO: `/v3/roles` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:57.782350 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f98c75-5155-4d98-9742-f6cf11992c0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:57.784460 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f98c75-5155-4d98-9742-f6cf11992c0d admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:57.795392 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1080/2164] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:01:57 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:01:57.799571 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f98c75-5155-4d98-9742-f6cf11992c0d admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:57.800753 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-8c4b4452-1281-4e61-bf91-f2f1a9fd6ab1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26cab4cc68f34e8396cbb1846f12fe3a', 'request_id': 'req-8c4b4452-1281-4e61-bf91-f2f1a9fd6ab1'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:57.807061 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f98c75-5155-4d98-9742-f6cf11992c0d admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:57.812066 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feab6afc-a1cb-4cd9-b5ea-36b0e9bca0df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:57.812738 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feab6afc-a1cb-4cd9-b5ea-36b0e9bca0df admin admin] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:57.812987 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feab6afc-a1cb-4cd9-b5ea-36b0e9bca0df admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:57.813100 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-8c4b4452-1281-4e61-bf91-f2f1a9fd6ab1 admin admin] The token cache is being invalidate because project 26cab4cc68f34e8396cbb1846f12fe3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88097) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 22:01:57.813249 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feab6afc-a1cb-4cd9-b5ea-36b0e9bca0df admin admin] PATH_INFO: `/v3/users` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:57.813370 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-8c4b4452-1281-4e61-bf91-f2f1a9fd6ab1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:57.813876 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feab6afc-a1cb-4cd9-b5ea-36b0e9bca0df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:57.814022 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-8c4b4452-1281-4e61-bf91-f2f1a9fd6ab1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:57.815752 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1085/2165] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 18 22:01:57 2022] DELETE /identity/v3/projects/26cab4cc68f34e8396cbb1846f12fe3a => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:01:57.815882 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feab6afc-a1cb-4cd9-b5ea-36b0e9bca0df admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:57.819414 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4b4452-1281-4e61-bf91-f2f1a9fd6ab1 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:57.820753 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-8c4b4452-1281-4e61-bf91-f2f1a9fd6ab1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:57.887039 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4b4452-1281-4e61-bf91-f2f1a9fd6ab1 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:57.892617 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa85b4df-4bdc-4d31-ba5b-d29f7b7d4bf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:57.893576 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa85b4df-4bdc-4d31-ba5b-d29f7b7d4bf3 admin admin] REQUEST_METHOD: `PUT` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:57.893699 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1081/2166] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 18 22:01:57 2022] POST /identity/v3/users => generated 293 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 22:01:57.893875 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa85b4df-4bdc-4d31-ba5b-d29f7b7d4bf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:57.894140 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa85b4df-4bdc-4d31-ba5b-d29f7b7d4bf3 admin admin] PATH_INFO: `/v3/projects/50fda2fed6ac4c69ac8dc997202e2e51/users/9e6bf7ef105c43b1a224f42a2037f125/roles/de8f2438056f4af9879423f8a59e0e0b` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:57.894581 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feab6afc-a1cb-4cd9-b5ea-36b0e9bca0df admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:57.896425 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-feab6afc-a1cb-4cd9-b5ea-36b0e9bca0df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:57.911556 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feab6afc-a1cb-4cd9-b5ea-36b0e9bca0df admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:57.916961 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8894710b-6e97-48f9-8833-24d354fb2ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:57.917599 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8894710b-6e97-48f9-8833-24d354fb2ad0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:57.926242 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8894710b-6e97-48f9-8833-24d354fb2ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:57.926381 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa85b4df-4bdc-4d31-ba5b-d29f7b7d4bf3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50fda2fed6ac4c69ac8dc997202e2e51, user_id=9e6bf7ef105c43b1a224f42a2037f125, role_id=de8f2438056f4af9879423f8a59e0e0b)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:57.926495 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8894710b-6e97-48f9-8833-24d354fb2ad0 admin admin] PATH_INFO: `/v3/users/42b1645b50bc43ed8a52145fad275f2d` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:57.926495 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8894710b-6e97-48f9-8833-24d354fb2ad0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=42b1645b50bc43ed8a52145fad275f2d)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:57.926676 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa85b4df-4bdc-4d31-ba5b-d29f7b7d4bf3 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:57.926764 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8894710b-6e97-48f9-8833-24d354fb2ad0 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:57.945227 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:01:58.005871 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1086/2167] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 18 22:01:57 2022] PUT /identity/v3/projects/50fda2fed6ac4c69ac8dc997202e2e51/users/9e6bf7ef105c43b1a224f42a2037f125/roles/de8f2438056f4af9879423f8a59e0e0b => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:01:58.006981 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa85b4df-4bdc-4d31-ba5b-d29f7b7d4bf3 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:58.008887 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-fa85b4df-4bdc-4d31-ba5b-d29f7b7d4bf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:58.083230 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa85b4df-4bdc-4d31-ba5b-d29f7b7d4bf3 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:58.087961 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd8c92c-d1b9-4afc-a6a7-2000f420ad70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:58.088562 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd8c92c-d1b9-4afc-a6a7-2000f420ad70 admin admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:58.088877 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd8c92c-d1b9-4afc-a6a7-2000f420ad70 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:58.089153 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd8c92c-d1b9-4afc-a6a7-2000f420ad70 admin admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:58.089801 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd8c92c-d1b9-4afc-a6a7-2000f420ad70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:58.091632 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd8c92c-d1b9-4afc-a6a7-2000f420ad70 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:58.102830 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1087/2168] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:01:58 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:01:58.104217 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dc82ca-cf23-4158-bb6d-5b96fa24c87c None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:58.104496 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dc82ca-cf23-4158-bb6d-5b96fa24c87c None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:58.104796 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dc82ca-cf23-4158-bb6d-5b96fa24c87c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:58.131580 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-8894710b-6e97-48f9-8833-24d354fb2ad0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42b1645b50bc43ed8a52145fad275f2d'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:58.135438 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-e3dc82ca-cf23-4158-bb6d-5b96fa24c87c None None] MFA Rules not processed for user `9e6bf7ef105c43b1a224f42a2037f125`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:01:58.136705 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-e3dc82ca-cf23-4158-bb6d-5b96fa24c87c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:58.138647 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-8894710b-6e97-48f9-8833-24d354fb2ad0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42b1645b50bc43ed8a52145fad275f2d'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:58.139309 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-8894710b-6e97-48f9-8833-24d354fb2ad0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42b1645b50bc43ed8a52145fad275f2d'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:58.140333 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-8894710b-6e97-48f9-8833-24d354fb2ad0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42b1645b50bc43ed8a52145fad275f2d'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:58.144060 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:01:58.153598 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-8894710b-6e97-48f9-8833-24d354fb2ad0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42b1645b50bc43ed8a52145fad275f2d'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:58.206826 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1088/2169] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:01:58 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:01:58.207689 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dc82ca-cf23-4158-bb6d-5b96fa24c87c None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:58.209081 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-e3dc82ca-cf23-4158-bb6d-5b96fa24c87c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:58.222745 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dc82ca-cf23-4158-bb6d-5b96fa24c87c None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:58.227709 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5704fa30-18ec-4586-a493-f24953991278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:58.228315 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5704fa30-18ec-4586-a493-f24953991278 admin admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:58.228609 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5704fa30-18ec-4586-a493-f24953991278 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:58.228926 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5704fa30-18ec-4586-a493-f24953991278 admin admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:58.229568 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5704fa30-18ec-4586-a493-f24953991278 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:58.231172 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5704fa30-18ec-4586-a493-f24953991278 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:58.239522 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1082/2170] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 18 22:01:57 2022] DELETE /identity/v3/users/42b1645b50bc43ed8a52145fad275f2d => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:01:58.240709 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8894710b-6e97-48f9-8833-24d354fb2ad0 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:58.242069 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-8894710b-6e97-48f9-8833-24d354fb2ad0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:58.243685 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1089/2171] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:01:58 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:01:58.247263 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5704fa30-18ec-4586-a493-f24953991278 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:58.258989 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5704fa30-18ec-4586-a493-f24953991278 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:58.336696 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffd03b2-ca80-412f-b119-50f16271e99a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:58.337633 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffd03b2-ca80-412f-b119-50f16271e99a admin admin] REQUEST_METHOD: `PUT` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:58.338019 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffd03b2-ca80-412f-b119-50f16271e99a admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:58.338441 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffd03b2-ca80-412f-b119-50f16271e99a admin admin] PATH_INFO: `/v3/projects/ed7237a1689f412e85c9f88d77e7eb6a/users/3381d3ae8d8c4e74b44fb7e3cde26845/roles/de8f2438056f4af9879423f8a59e0e0b` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:58.339572 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8894710b-6e97-48f9-8833-24d354fb2ad0 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:58.345157 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5b0329-f23e-42f9-960a-10eddba4c9f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:58.346138 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5b0329-f23e-42f9-960a-10eddba4c9f4 admin admin] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:58.346420 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5b0329-f23e-42f9-960a-10eddba4c9f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:58.346696 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5b0329-f23e-42f9-960a-10eddba4c9f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:58.347363 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5b0329-f23e-42f9-960a-10eddba4c9f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:58.349405 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5b0329-f23e-42f9-960a-10eddba4c9f4 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:58.363324 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffd03b2-ca80-412f-b119-50f16271e99a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed7237a1689f412e85c9f88d77e7eb6a, user_id=3381d3ae8d8c4e74b44fb7e3cde26845, role_id=de8f2438056f4af9879423f8a59e0e0b)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:58.363324 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffd03b2-ca80-412f-b119-50f16271e99a admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:58.448238 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1090/2172] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 18 22:01:58 2022] PUT /identity/v3/projects/ed7237a1689f412e85c9f88d77e7eb6a/users/3381d3ae8d8c4e74b44fb7e3cde26845/roles/de8f2438056f4af9879423f8a59e0e0b => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 22:01:58.455412 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1083/2173] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 18 22:01:58 2022] POST /identity/v3/projects => generated 385 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 22:01:58.456770 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffd03b2-ca80-412f-b119-50f16271e99a admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:58.466183 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105fad84-0df2-4dc2-aa8f-a861f4685bf2 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:58.466585 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105fad84-0df2-4dc2-aa8f-a861f4685bf2 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:58.467072 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105fad84-0df2-4dc2-aa8f-a861f4685bf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:58.497258 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:01:58.521058 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-105fad84-0df2-4dc2-aa8f-a861f4685bf2 None None] MFA Rules not processed for user `3381d3ae8d8c4e74b44fb7e3cde26845`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:01:58.521252 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-105fad84-0df2-4dc2-aa8f-a861f4685bf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:58.556703 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffd03b2-ca80-412f-b119-50f16271e99a admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:58.616396 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1084/2174] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:01:58 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:01:58.621523 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105fad84-0df2-4dc2-aa8f-a861f4685bf2 None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:58.634690 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741b2cef-779f-4b79-aaa1-974d2bf647c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:58.635337 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741b2cef-779f-4b79-aaa1-974d2bf647c0 admin admin] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:58.635606 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741b2cef-779f-4b79-aaa1-974d2bf647c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:58.635885 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741b2cef-779f-4b79-aaa1-974d2bf647c0 admin admin] PATH_INFO: `/v3/users` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:58.636533 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741b2cef-779f-4b79-aaa1-974d2bf647c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:58.638513 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741b2cef-779f-4b79-aaa1-974d2bf647c0 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:58.654107 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:01:58.688901 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105fad84-0df2-4dc2-aa8f-a861f4685bf2 None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:58.694202 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84c1688-e1e3-423e-b7f9-ca4d25cf5402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:58.694802 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84c1688-e1e3-423e-b7f9-ca4d25cf5402 admin admin] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:58.695086 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84c1688-e1e3-423e-b7f9-ca4d25cf5402 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:58.695360 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84c1688-e1e3-423e-b7f9-ca4d25cf5402 admin admin] PATH_INFO: `/v3/projects` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:58.695989 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84c1688-e1e3-423e-b7f9-ca4d25cf5402 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:58.697951 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84c1688-e1e3-423e-b7f9-ca4d25cf5402 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:58.756227 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1091/2175] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 18 22:01:58 2022] POST /identity/v3/users => generated 299 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 22:01:58.756880 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741b2cef-779f-4b79-aaa1-974d2bf647c0 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:58.758554 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-741b2cef-779f-4b79-aaa1-974d2bf647c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:58.775117 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741b2cef-779f-4b79-aaa1-974d2bf647c0 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:58.780214 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec25a9c-eb16-4b82-b8c2-eb0328098c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:58.781040 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec25a9c-eb16-4b82-b8c2-eb0328098c4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:58.781319 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec25a9c-eb16-4b82-b8c2-eb0328098c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:58.781589 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec25a9c-eb16-4b82-b8c2-eb0328098c4d admin admin] PATH_INFO: `/v3/projects/3f41e78e994f46a3aa626c70eecaafeb` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:58.782711 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec25a9c-eb16-4b82-b8c2-eb0328098c4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f41e78e994f46a3aa626c70eecaafeb)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:58.785301 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec25a9c-eb16-4b82-b8c2-eb0328098c4d admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:58.827207 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1085/2176] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 18 22:01:58 2022] POST /identity/v3/projects => generated 387 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 22:01:58.828180 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84c1688-e1e3-423e-b7f9-ca4d25cf5402 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:58.907398 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84c1688-e1e3-423e-b7f9-ca4d25cf5402 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:58.914745 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:01:58.924808 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-dec25a9c-eb16-4b82-b8c2-eb0328098c4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f41e78e994f46a3aa626c70eecaafeb', 'request_id': 'req-dec25a9c-eb16-4b82-b8c2-eb0328098c4d'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:58.930846 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-dec25a9c-eb16-4b82-b8c2-eb0328098c4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f41e78e994f46a3aa626c70eecaafeb', 'request_id': 'req-dec25a9c-eb16-4b82-b8c2-eb0328098c4d'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:58.977255 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f152df5e-42ce-45d6-8504-7bdaca4cdc21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:58.977909 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f152df5e-42ce-45d6-8504-7bdaca4cdc21 admin admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:58.978194 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f152df5e-42ce-45d6-8504-7bdaca4cdc21 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:58.978499 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f152df5e-42ce-45d6-8504-7bdaca4cdc21 admin admin] PATH_INFO: `/v3/roles` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:58.979201 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f152df5e-42ce-45d6-8504-7bdaca4cdc21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:58.980890 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f152df5e-42ce-45d6-8504-7bdaca4cdc21 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:58.991801 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1086/2177] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:01:58 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:01:58.992585 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f152df5e-42ce-45d6-8504-7bdaca4cdc21 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:58.998521 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-dec25a9c-eb16-4b82-b8c2-eb0328098c4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f41e78e994f46a3aa626c70eecaafeb', 'request_id': 'req-dec25a9c-eb16-4b82-b8c2-eb0328098c4d'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:59.003178 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f152df5e-42ce-45d6-8504-7bdaca4cdc21 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:59.011247 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febf8849-fc91-4ff2-b4ec-43ea0706185c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:59.011992 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febf8849-fc91-4ff2-b4ec-43ea0706185c admin admin] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:59.012274 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febf8849-fc91-4ff2-b4ec-43ea0706185c admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:59.012547 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febf8849-fc91-4ff2-b4ec-43ea0706185c admin admin] PATH_INFO: `/v3/users` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:59.013202 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febf8849-fc91-4ff2-b4ec-43ea0706185c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:59.013711 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-dec25a9c-eb16-4b82-b8c2-eb0328098c4d admin admin] The token cache is being invalidate because project 3f41e78e994f46a3aa626c70eecaafeb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88097) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 22:01:59.014011 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-dec25a9c-eb16-4b82-b8c2-eb0328098c4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:59.014689 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-dec25a9c-eb16-4b82-b8c2-eb0328098c4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:59.015115 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febf8849-fc91-4ff2-b4ec-43ea0706185c admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:59.016199 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1092/2178] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 18 22:01:58 2022] DELETE /identity/v3/projects/3f41e78e994f46a3aa626c70eecaafeb => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:01:59.016976 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec25a9c-eb16-4b82-b8c2-eb0328098c4d admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:59.018587 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-dec25a9c-eb16-4b82-b8c2-eb0328098c4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:59.031776 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec25a9c-eb16-4b82-b8c2-eb0328098c4d admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:59.037793 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd7e208-8f40-4df1-a685-cd577717b9a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:59.038517 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd7e208-8f40-4df1-a685-cd577717b9a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:59.038810 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd7e208-8f40-4df1-a685-cd577717b9a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:59.039090 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd7e208-8f40-4df1-a685-cd577717b9a5 admin admin] PATH_INFO: `/v3/projects/7a8bfeddd61549a38156c63231aaf02b/users/de90a7952269493988b05777fb04b3af/roles/0833202e2a3d47d1b6b3af57006641b1` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:59.054359 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd7e208-8f40-4df1-a685-cd577717b9a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a8bfeddd61549a38156c63231aaf02b, user_id=de90a7952269493988b05777fb04b3af, role_id=0833202e2a3d47d1b6b3af57006641b1)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:59.058619 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd7e208-8f40-4df1-a685-cd577717b9a5 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:59.113894 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1087/2179] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 18 22:01:58 2022] POST /identity/v3/users => generated 300 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 22:01:59.115430 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febf8849-fc91-4ff2-b4ec-43ea0706185c admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:59.117618 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-febf8849-fc91-4ff2-b4ec-43ea0706185c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:59.131507 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febf8849-fc91-4ff2-b4ec-43ea0706185c admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:59.136730 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049fcb29-581a-440f-a3d9-b8d6396ac392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:59.137498 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049fcb29-581a-440f-a3d9-b8d6396ac392 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:59.137879 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049fcb29-581a-440f-a3d9-b8d6396ac392 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:59.138247 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049fcb29-581a-440f-a3d9-b8d6396ac392 admin admin] PATH_INFO: `/v3/users/3a08caa2fe6540f481f93a8b8e900170` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:59.139775 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049fcb29-581a-440f-a3d9-b8d6396ac392 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a08caa2fe6540f481f93a8b8e900170)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:59.141772 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1093/2180] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 18 22:01:59 2022] PUT /identity/v3/projects/7a8bfeddd61549a38156c63231aaf02b/users/de90a7952269493988b05777fb04b3af/roles/0833202e2a3d47d1b6b3af57006641b1 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:01:59.142239 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049fcb29-581a-440f-a3d9-b8d6396ac392 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:59.142807 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd7e208-8f40-4df1-a685-cd577717b9a5 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:59.144691 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-3cd7e208-8f40-4df1-a685-cd577717b9a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:59.218568 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd7e208-8f40-4df1-a685-cd577717b9a5 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:59.227696 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa28fd1-9bf4-45cf-9db5-c2d6556cc373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:59.228777 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa28fd1-9bf4-45cf-9db5-c2d6556cc373 admin admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:59.229288 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa28fd1-9bf4-45cf-9db5-c2d6556cc373 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:59.229781 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa28fd1-9bf4-45cf-9db5-c2d6556cc373 admin admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:59.231019 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa28fd1-9bf4-45cf-9db5-c2d6556cc373 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:59.234479 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa28fd1-9bf4-45cf-9db5-c2d6556cc373 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:59.246395 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1094/2181] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:01:59 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:01:59.247217 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa28fd1-9bf4-45cf-9db5-c2d6556cc373 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:59.257594 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa28fd1-9bf4-45cf-9db5-c2d6556cc373 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:59.262360 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a951f3f-8657-4c38-bbce-8d0bf903683a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:59.262958 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a951f3f-8657-4c38-bbce-8d0bf903683a admin admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:59.263338 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a951f3f-8657-4c38-bbce-8d0bf903683a admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:59.263611 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a951f3f-8657-4c38-bbce-8d0bf903683a admin admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:59.264252 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a951f3f-8657-4c38-bbce-8d0bf903683a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:59.265882 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a951f3f-8657-4c38-bbce-8d0bf903683a admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:59.276909 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1095/2182] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:01:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:01:59.282619 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a951f3f-8657-4c38-bbce-8d0bf903683a admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:59.289315 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a951f3f-8657-4c38-bbce-8d0bf903683a admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:59.294101 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2bfa58-8546-4cf0-9e23-edcb15fdb173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:59.294872 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2bfa58-8546-4cf0-9e23-edcb15fdb173 admin admin] REQUEST_METHOD: `PUT` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:59.295151 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2bfa58-8546-4cf0-9e23-edcb15fdb173 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:59.295431 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2bfa58-8546-4cf0-9e23-edcb15fdb173 admin admin] PATH_INFO: `/v3/projects/ac543f54100b49e1be0013ea2a313e66/users/019133354642416981883b3069c9d4b2/roles/0833202e2a3d47d1b6b3af57006641b1` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:59.311643 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2bfa58-8546-4cf0-9e23-edcb15fdb173 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac543f54100b49e1be0013ea2a313e66, user_id=019133354642416981883b3069c9d4b2, role_id=0833202e2a3d47d1b6b3af57006641b1)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:59.317444 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2bfa58-8546-4cf0-9e23-edcb15fdb173 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:59.378453 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-049fcb29-581a-440f-a3d9-b8d6396ac392 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a08caa2fe6540f481f93a8b8e900170'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:59.385549 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-049fcb29-581a-440f-a3d9-b8d6396ac392 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a08caa2fe6540f481f93a8b8e900170'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:59.386235 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-049fcb29-581a-440f-a3d9-b8d6396ac392 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a08caa2fe6540f481f93a8b8e900170'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:59.386859 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-049fcb29-581a-440f-a3d9-b8d6396ac392 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a08caa2fe6540f481f93a8b8e900170'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:59.399426 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-049fcb29-581a-440f-a3d9-b8d6396ac392 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a08caa2fe6540f481f93a8b8e900170'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:01:59.401162 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1096/2183] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 18 22:01:59 2022] PUT /identity/v3/projects/ac543f54100b49e1be0013ea2a313e66/users/019133354642416981883b3069c9d4b2/roles/0833202e2a3d47d1b6b3af57006641b1 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:01:59.402269 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2bfa58-8546-4cf0-9e23-edcb15fdb173 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:59.404423 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-ea2bfa58-8546-4cf0-9e23-edcb15fdb173 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:59.487769 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2bfa58-8546-4cf0-9e23-edcb15fdb173 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:59.492756 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c903a11b-4d15-4195-94e3-7fff475704bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:59.493416 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c903a11b-4d15-4195-94e3-7fff475704bc admin admin] REQUEST_METHOD: `PUT` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:59.493692 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c903a11b-4d15-4195-94e3-7fff475704bc admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:59.493984 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c903a11b-4d15-4195-94e3-7fff475704bc admin admin] PATH_INFO: `/v3/projects/7a8bfeddd61549a38156c63231aaf02b/users/de90a7952269493988b05777fb04b3af/roles/0833202e2a3d47d1b6b3af57006641b1` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:59.495595 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1088/2184] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 18 22:01:59 2022] DELETE /identity/v3/users/3a08caa2fe6540f481f93a8b8e900170 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:01:59.495902 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c903a11b-4d15-4195-94e3-7fff475704bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a8bfeddd61549a38156c63231aaf02b, user_id=de90a7952269493988b05777fb04b3af, role_id=0833202e2a3d47d1b6b3af57006641b1)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:59.496429 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049fcb29-581a-440f-a3d9-b8d6396ac392 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:59.497845 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-049fcb29-581a-440f-a3d9-b8d6396ac392 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:59.498928 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c903a11b-4d15-4195-94e3-7fff475704bc admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:59.512537 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1097/2185] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 18 22:01:59 2022] PUT /identity/v3/projects/7a8bfeddd61549a38156c63231aaf02b/users/de90a7952269493988b05777fb04b3af/roles/0833202e2a3d47d1b6b3af57006641b1 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:01:59.525453 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd153052-9c9c-4563-b4eb-3b97c46e60b6 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:59.525453 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd153052-9c9c-4563-b4eb-3b97c46e60b6 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:59.525453 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd153052-9c9c-4563-b4eb-3b97c46e60b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:59.555207 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-bd153052-9c9c-4563-b4eb-3b97c46e60b6 None None] MFA Rules not processed for user `de90a7952269493988b05777fb04b3af`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:01:59.556678 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-bd153052-9c9c-4563-b4eb-3b97c46e60b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:59.586189 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049fcb29-581a-440f-a3d9-b8d6396ac392 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:59.634507 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1098/2186] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:01:59 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:01:59.646772 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd153052-9c9c-4563-b4eb-3b97c46e60b6 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:59.648217 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-bd153052-9c9c-4563-b4eb-3b97c46e60b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:59.650950 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e8105a-f644-4055-8183-3f6f35b34156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:59.651571 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e8105a-f644-4055-8183-3f6f35b34156 admin admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:59.651853 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e8105a-f644-4055-8183-3f6f35b34156 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:59.652129 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e8105a-f644-4055-8183-3f6f35b34156 admin admin] PATH_INFO: `/v3/roles` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:59.652522 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:01:59.652826 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e8105a-f644-4055-8183-3f6f35b34156 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:59.654474 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e8105a-f644-4055-8183-3f6f35b34156 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:59.667131 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1089/2187] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:01:59 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:01:59.670998 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e8105a-f644-4055-8183-3f6f35b34156 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:59.682530 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e8105a-f644-4055-8183-3f6f35b34156 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:59.687892 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f7c2b2-1919-4d22-847d-8eceff1714a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:59.688571 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f7c2b2-1919-4d22-847d-8eceff1714a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:59.688904 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f7c2b2-1919-4d22-847d-8eceff1714a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:59.689213 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f7c2b2-1919-4d22-847d-8eceff1714a5 admin admin] PATH_INFO: `/v3/projects/ac543f54100b49e1be0013ea2a313e66/users/019133354642416981883b3069c9d4b2/roles/0833202e2a3d47d1b6b3af57006641b1` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:59.691943 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f7c2b2-1919-4d22-847d-8eceff1714a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac543f54100b49e1be0013ea2a313e66, user_id=019133354642416981883b3069c9d4b2, role_id=0833202e2a3d47d1b6b3af57006641b1)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:59.694785 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f7c2b2-1919-4d22-847d-8eceff1714a5 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:59.715956 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1090/2188] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 18 22:01:59 2022] PUT /identity/v3/projects/ac543f54100b49e1be0013ea2a313e66/users/019133354642416981883b3069c9d4b2/roles/0833202e2a3d47d1b6b3af57006641b1 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 22:01:59.717814 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162d9b64-3055-4b2c-aa34-cba5bf622b79 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:59.718207 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162d9b64-3055-4b2c-aa34-cba5bf622b79 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:59.718586 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162d9b64-3055-4b2c-aa34-cba5bf622b79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:59.726053 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd153052-9c9c-4563-b4eb-3b97c46e60b6 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:59.759735 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-162d9b64-3055-4b2c-aa34-cba5bf622b79 None None] MFA Rules not processed for user `019133354642416981883b3069c9d4b2`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:01:59.762194 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:01:59.763035 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-162d9b64-3055-4b2c-aa34-cba5bf622b79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:59.794921 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f7cea3-d662-40c0-b29b-c046a97cc126 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22b6a7c36f8a4795a75271b8079821c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:59.795697 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f7cea3-d662-40c0-b29b-c046a97cc126 service cinder] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:59.796048 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f7cea3-d662-40c0-b29b-c046a97cc126 service cinder] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:59.796397 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f7cea3-d662-40c0-b29b-c046a97cc126 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:59.859305 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1091/2189] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:01:59 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:01:59.872252 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162d9b64-3055-4b2c-aa34-cba5bf622b79 None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:59.873893 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-162d9b64-3055-4b2c-aa34-cba5bf622b79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:59.880257 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f7cea3-d662-40c0-b29b-c046a97cc126 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:59.882444 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f7cea3-d662-40c0-b29b-c046a97cc126 service cinder] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:59.887083 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162d9b64-3055-4b2c-aa34-cba5bf622b79 None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:01:59.891158 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be66f1ea-1775-43da-935d-e17c58e62a4e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22b6a7c36f8a4795a75271b8079821c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:01:59.891774 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be66f1ea-1775-43da-935d-e17c58e62a4e service cinder] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:01:59.892056 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be66f1ea-1775-43da-935d-e17c58e62a4e service cinder] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:01:59.892378 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be66f1ea-1775-43da-935d-e17c58e62a4e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:01:59.893911 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1099/2190] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:01:59 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 22:01:59.907713 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be66f1ea-1775-43da-935d-e17c58e62a4e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:01:59.909406 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be66f1ea-1775-43da-935d-e17c58e62a4e service cinder] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:01:59.919952 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1092/2191] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:01:59 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:01:59.968206 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f7cea3-d662-40c0-b29b-c046a97cc126 service cinder] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:01:59.969798 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-04f7cea3-d662-40c0-b29b-c046a97cc126 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:01:59.988322 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:02:00.022719 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be66f1ea-1775-43da-935d-e17c58e62a4e service cinder] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:02:00.084675 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f7cea3-d662-40c0-b29b-c046a97cc126 service cinder] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:02:00.091916 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ede7f5-8857-46a9-ae73-2832c546b366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:02:00.092754 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ede7f5-8857-46a9-ae73-2832c546b366 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:00.093039 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ede7f5-8857-46a9-ae73-2832c546b366 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:00.093314 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ede7f5-8857-46a9-ae73-2832c546b366 admin admin] PATH_INFO: `/v3/projects/a266e6916fb8421c89c2cf1960442290` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:00.095302 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ede7f5-8857-46a9-ae73-2832c546b366 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a266e6916fb8421c89c2cf1960442290)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:02:00.099490 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ede7f5-8857-46a9-ae73-2832c546b366 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:02:00.122034 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be66f1ea-1775-43da-935d-e17c58e62a4e service cinder] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:02:00.129477 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4898a3d-a08d-41e0-a4e7-d1c50cb962fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:02:00.130171 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4898a3d-a08d-41e0-a4e7-d1c50cb962fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:00.130460 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4898a3d-a08d-41e0-a4e7-d1c50cb962fc admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:00.131880 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4898a3d-a08d-41e0-a4e7-d1c50cb962fc admin admin] PATH_INFO: `/v3/users/3381d3ae8d8c4e74b44fb7e3cde26845` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:00.131880 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4898a3d-a08d-41e0-a4e7-d1c50cb962fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=3381d3ae8d8c4e74b44fb7e3cde26845)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:02:00.135202 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4898a3d-a08d-41e0-a4e7-d1c50cb962fc admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:02:00.240252 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-03ede7f5-8857-46a9-ae73-2832c546b366 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a266e6916fb8421c89c2cf1960442290', 'request_id': 'req-03ede7f5-8857-46a9-ae73-2832c546b366'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:02:00.246407 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-03ede7f5-8857-46a9-ae73-2832c546b366 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a266e6916fb8421c89c2cf1960442290', 'request_id': 'req-03ede7f5-8857-46a9-ae73-2832c546b366'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:02:00.330466 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-03ede7f5-8857-46a9-ae73-2832c546b366 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a266e6916fb8421c89c2cf1960442290', 'request_id': 'req-03ede7f5-8857-46a9-ae73-2832c546b366'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:02:00.347377 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-03ede7f5-8857-46a9-ae73-2832c546b366 admin admin] The token cache is being invalidate because project a266e6916fb8421c89c2cf1960442290 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88097) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 22:02:00.347888 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-03ede7f5-8857-46a9-ae73-2832c546b366 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:02:00.348564 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-03ede7f5-8857-46a9-ae73-2832c546b366 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:02:00.350399 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1100/2192] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 18 22:01:59 2022] DELETE /identity/v3/projects/a266e6916fb8421c89c2cf1960442290 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:02:00.352087 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-b4898a3d-a08d-41e0-a4e7-d1c50cb962fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3381d3ae8d8c4e74b44fb7e3cde26845'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:02:00.356334 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeca856-5441-453b-a237-541b2dfa1bcb None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:00.356666 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeca856-5441-453b-a237-541b2dfa1bcb None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:00.356953 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeca856-5441-453b-a237-541b2dfa1bcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:00.362202 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-b4898a3d-a08d-41e0-a4e7-d1c50cb962fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3381d3ae8d8c4e74b44fb7e3cde26845'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:02:00.363007 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-b4898a3d-a08d-41e0-a4e7-d1c50cb962fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3381d3ae8d8c4e74b44fb7e3cde26845'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:02:00.363685 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-b4898a3d-a08d-41e0-a4e7-d1c50cb962fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3381d3ae8d8c4e74b44fb7e3cde26845'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:02:00.377776 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-caeca856-5441-453b-a237-541b2dfa1bcb None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:02:00.379055 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-caeca856-5441-453b-a237-541b2dfa1bcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:02:00.379987 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-b4898a3d-a08d-41e0-a4e7-d1c50cb962fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3381d3ae8d8c4e74b44fb7e3cde26845'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:02:00.438014 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1101/2193] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:02:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 22:02:00.447998 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c146c492-fbf4-48e9-95e6-b8c42e248d35 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:00.448286 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c146c492-fbf4-48e9-95e6-b8c42e248d35 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:00.448563 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c146c492-fbf4-48e9-95e6-b8c42e248d35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:00.459632 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1093/2194] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 18 22:02:00 2022] DELETE /identity/v3/users/3381d3ae8d8c4e74b44fb7e3cde26845 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:02:00.465857 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dd78c8-ea2a-4469-a68f-b80eb2814935 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:00.466178 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dd78c8-ea2a-4469-a68f-b80eb2814935 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:00.466457 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dd78c8-ea2a-4469-a68f-b80eb2814935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:00.467504 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-c146c492-fbf4-48e9-95e6-b8c42e248d35 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:02:00.468860 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-c146c492-fbf4-48e9-95e6-b8c42e248d35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:02:00.485277 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:02:00.488113 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-b1dd78c8-ea2a-4469-a68f-b80eb2814935 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:02:00.489371 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-b1dd78c8-ea2a-4469-a68f-b80eb2814935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:02:00.543577 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1102/2195] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:02:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 22:02:00.545290 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c146c492-fbf4-48e9-95e6-b8c42e248d35 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:02:00.555911 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c146c492-fbf4-48e9-95e6-b8c42e248d35 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:02:00.561393 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5daf04-7b6b-4a16-98bc-6d7dcd38fa73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:02:00.562000 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5daf04-7b6b-4a16-98bc-6d7dcd38fa73 admin admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:00.562340 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5daf04-7b6b-4a16-98bc-6d7dcd38fa73 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:00.562564 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5daf04-7b6b-4a16-98bc-6d7dcd38fa73 admin admin] PATH_INFO: `/v3/domains` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:00.563214 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5daf04-7b6b-4a16-98bc-6d7dcd38fa73 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 22:02:00.563527 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5daf04-7b6b-4a16-98bc-6d7dcd38fa73 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:02:00.565902 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5daf04-7b6b-4a16-98bc-6d7dcd38fa73 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:02:00.573066 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1094/2196] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:02:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 22:02:00.579685 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1103/2197] 10.222.0.27 () {58 vars in 1153 bytes} [Thu Aug 18 22:02:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 22:02:00.584669 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5daf04-7b6b-4a16-98bc-6d7dcd38fa73 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:02:00.590615 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dd78c8-ea2a-4469-a68f-b80eb2814935 None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:02:00.590615 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-b1dd78c8-ea2a-4469-a68f-b80eb2814935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:02:00.594702 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5daf04-7b6b-4a16-98bc-6d7dcd38fa73 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:02:00.599588 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508c9ebe-9e58-4228-bcce-a3c8bbdd2f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:02:00.600187 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508c9ebe-9e58-4228-bcce-a3c8bbdd2f06 admin admin] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:00.600471 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508c9ebe-9e58-4228-bcce-a3c8bbdd2f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:00.600780 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508c9ebe-9e58-4228-bcce-a3c8bbdd2f06 admin admin] PATH_INFO: `/v3/projects` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:00.601416 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508c9ebe-9e58-4228-bcce-a3c8bbdd2f06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:02:00.603312 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508c9ebe-9e58-4228-bcce-a3c8bbdd2f06 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:02:00.645245 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dd78c8-ea2a-4469-a68f-b80eb2814935 None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:02:00.650390 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25dc1e0-74dd-4c89-a3aa-2c29a9713fbc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a937971ad1a4b0c8697c764f214d446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:02:00.650390 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25dc1e0-74dd-4c89-a3aa-2c29a9713fbc service neutron] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:00.650679 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25dc1e0-74dd-4c89-a3aa-2c29a9713fbc service neutron] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:00.650952 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25dc1e0-74dd-4c89-a3aa-2c29a9713fbc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:00.661292 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25dc1e0-74dd-4c89-a3aa-2c29a9713fbc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:02:00.662863 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25dc1e0-74dd-4c89-a3aa-2c29a9713fbc service neutron] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:02:00.679473 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1095/2198] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:02:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:02:00.703538 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1104/2199] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 18 22:02:00 2022] POST /identity/v3/projects => generated 383 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 22:02:00.708171 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25dc1e0-74dd-4c89-a3aa-2c29a9713fbc service neutron] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:02:00.728049 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25dc1e0-74dd-4c89-a3aa-2c29a9713fbc service neutron] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:02:00.781400 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9c550f-bc65-4cb3-aa20-5350f67a7e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:02:00.782001 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9c550f-bc65-4cb3-aa20-5350f67a7e1c admin admin] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:00.782278 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9c550f-bc65-4cb3-aa20-5350f67a7e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:00.782546 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9c550f-bc65-4cb3-aa20-5350f67a7e1c admin admin] PATH_INFO: `/v3/users` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:00.783941 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9c550f-bc65-4cb3-aa20-5350f67a7e1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:02:00.786148 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9c550f-bc65-4cb3-aa20-5350f67a7e1c admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:02:00.897976 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1096/2200] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 18 22:02:00 2022] POST /identity/v3/users => generated 292 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 22:02:00.899524 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508c9ebe-9e58-4228-bcce-a3c8bbdd2f06 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:02:00.913002 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508c9ebe-9e58-4228-bcce-a3c8bbdd2f06 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:02:00.917818 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f216c475-2b5a-4dcb-8872-c82fc61bb402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:02:00.918422 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f216c475-2b5a-4dcb-8872-c82fc61bb402 admin admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:00.918703 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f216c475-2b5a-4dcb-8872-c82fc61bb402 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:00.918978 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f216c475-2b5a-4dcb-8872-c82fc61bb402 admin admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:00.919624 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f216c475-2b5a-4dcb-8872-c82fc61bb402 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:02:00.921815 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f216c475-2b5a-4dcb-8872-c82fc61bb402 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:02:00.932324 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1105/2201] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:02:00 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:02:00.937000 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9c550f-bc65-4cb3-aa20-5350f67a7e1c admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:02:00.947313 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9c550f-bc65-4cb3-aa20-5350f67a7e1c admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:02:00.952216 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c672f8c-34f5-4ab9-9929-9a52ab1dbce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:02:00.952719 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c672f8c-34f5-4ab9-9929-9a52ab1dbce2 admin admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:00.953002 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c672f8c-34f5-4ab9-9929-9a52ab1dbce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:00.953280 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c672f8c-34f5-4ab9-9929-9a52ab1dbce2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:00.953922 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c672f8c-34f5-4ab9-9929-9a52ab1dbce2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:02:00.955559 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c672f8c-34f5-4ab9-9929-9a52ab1dbce2 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:02:00.968485 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1097/2202] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:02:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:02:00.969924 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f216c475-2b5a-4dcb-8872-c82fc61bb402 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:02:00.981732 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f216c475-2b5a-4dcb-8872-c82fc61bb402 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:02:00.984400 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:02:00.993392 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd0ebba-e97e-4209-8a90-df5805d51e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:02:00.994055 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd0ebba-e97e-4209-8a90-df5805d51e64 admin admin] REQUEST_METHOD: `PUT` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:00.994345 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd0ebba-e97e-4209-8a90-df5805d51e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:00.994632 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd0ebba-e97e-4209-8a90-df5805d51e64 admin admin] PATH_INFO: `/v3/projects/73756301b48846089d210ad68d4d79ae/users/f49f57a8ef05424491dbdf989522f76b/roles/de8f2438056f4af9879423f8a59e0e0b` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:01.012245 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd0ebba-e97e-4209-8a90-df5805d51e64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73756301b48846089d210ad68d4d79ae, user_id=f49f57a8ef05424491dbdf989522f76b, role_id=de8f2438056f4af9879423f8a59e0e0b)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:02:01.015129 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd0ebba-e97e-4209-8a90-df5805d51e64 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:02:01.096566 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1106/2203] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 18 22:02:00 2022] PUT /identity/v3/projects/73756301b48846089d210ad68d4d79ae/users/f49f57a8ef05424491dbdf989522f76b/roles/de8f2438056f4af9879423f8a59e0e0b => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:02:01.107834 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4539a2b-5324-4c77-8a1c-7f70eb08a706 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:01.108124 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4539a2b-5324-4c77-8a1c-7f70eb08a706 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:01.108415 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4539a2b-5324-4c77-8a1c-7f70eb08a706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:01.128287 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd0ebba-e97e-4209-8a90-df5805d51e64 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:02:01.130899 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-5bd0ebba-e97e-4209-8a90-df5805d51e64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:02:01.141280 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-c4539a2b-5324-4c77-8a1c-7f70eb08a706 None None] MFA Rules not processed for user `f49f57a8ef05424491dbdf989522f76b`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:02:01.143005 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-c4539a2b-5324-4c77-8a1c-7f70eb08a706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:02:01.215484 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd0ebba-e97e-4209-8a90-df5805d51e64 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:02:01.221374 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f03743-e2dd-4433-956d-be21c60ba2a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:02:01.222146 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f03743-e2dd-4433-956d-be21c60ba2a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:01.222495 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f03743-e2dd-4433-956d-be21c60ba2a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:01.222848 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f03743-e2dd-4433-956d-be21c60ba2a5 admin admin] PATH_INFO: `/v3/projects/ed7237a1689f412e85c9f88d77e7eb6a` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:01.224119 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f03743-e2dd-4433-956d-be21c60ba2a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed7237a1689f412e85c9f88d77e7eb6a)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:02:01.226282 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f03743-e2dd-4433-956d-be21c60ba2a5 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:02:01.244726 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1098/2204] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:02:01 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:02:01.244726 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4539a2b-5324-4c77-8a1c-7f70eb08a706 None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:02:01.246057 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-c4539a2b-5324-4c77-8a1c-7f70eb08a706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:02:01.260326 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4539a2b-5324-4c77-8a1c-7f70eb08a706 None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:02:01.265436 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08655f98-5c97-4bac-91a2-d8420bdb5c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:02:01.266070 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08655f98-5c97-4bac-91a2-d8420bdb5c36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:01.266351 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08655f98-5c97-4bac-91a2-d8420bdb5c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:01.266640 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08655f98-5c97-4bac-91a2-d8420bdb5c36 admin admin] PATH_INFO: `/v3/users/9e6bf7ef105c43b1a224f42a2037f125` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:01.267805 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08655f98-5c97-4bac-91a2-d8420bdb5c36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e6bf7ef105c43b1a224f42a2037f125)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:02:01.269997 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08655f98-5c97-4bac-91a2-d8420bdb5c36 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:02:01.284904 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:02:01.350341 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-69f03743-e2dd-4433-956d-be21c60ba2a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed7237a1689f412e85c9f88d77e7eb6a', 'request_id': 'req-69f03743-e2dd-4433-956d-be21c60ba2a5'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:02:01.356274 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-69f03743-e2dd-4433-956d-be21c60ba2a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed7237a1689f412e85c9f88d77e7eb6a', 'request_id': 'req-69f03743-e2dd-4433-956d-be21c60ba2a5'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:02:01.447597 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-69f03743-e2dd-4433-956d-be21c60ba2a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed7237a1689f412e85c9f88d77e7eb6a', 'request_id': 'req-69f03743-e2dd-4433-956d-be21c60ba2a5'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:02:01.460041 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-69f03743-e2dd-4433-956d-be21c60ba2a5 admin admin] The token cache is being invalidate because project ed7237a1689f412e85c9f88d77e7eb6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88097) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 22:02:01.460332 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-69f03743-e2dd-4433-956d-be21c60ba2a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:02:01.461022 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-69f03743-e2dd-4433-956d-be21c60ba2a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:02:01.462497 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1107/2205] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 18 22:02:01 2022] DELETE /identity/v3/projects/ed7237a1689f412e85c9f88d77e7eb6a => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:02:01.463240 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f03743-e2dd-4433-956d-be21c60ba2a5 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:02:01.464515 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-69f03743-e2dd-4433-956d-be21c60ba2a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:02:01.527121 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f03743-e2dd-4433-956d-be21c60ba2a5 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:02:01.530872 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:02:01.534399 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e6ae1a-c706-46e5-9472-b0f9461d08aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:02:01.535054 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e6ae1a-c706-46e5-9472-b0f9461d08aa admin admin] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:01.535400 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e6ae1a-c706-46e5-9472-b0f9461d08aa admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:01.535680 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e6ae1a-c706-46e5-9472-b0f9461d08aa admin admin] PATH_INFO: `/v3/projects` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:01.536376 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e6ae1a-c706-46e5-9472-b0f9461d08aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:02:01.538350 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e6ae1a-c706-46e5-9472-b0f9461d08aa admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:02:01.543678 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-08655f98-5c97-4bac-91a2-d8420bdb5c36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e6bf7ef105c43b1a224f42a2037f125'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:02:01.551398 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-08655f98-5c97-4bac-91a2-d8420bdb5c36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e6bf7ef105c43b1a224f42a2037f125'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:02:01.552115 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-08655f98-5c97-4bac-91a2-d8420bdb5c36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e6bf7ef105c43b1a224f42a2037f125'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:02:01.552783 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-08655f98-5c97-4bac-91a2-d8420bdb5c36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e6bf7ef105c43b1a224f42a2037f125'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:02:01.565441 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-08655f98-5c97-4bac-91a2-d8420bdb5c36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e6bf7ef105c43b1a224f42a2037f125'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:02:01.642676 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1099/2206] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 18 22:02:01 2022] DELETE /identity/v3/users/9e6bf7ef105c43b1a224f42a2037f125 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:02:01.643965 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08655f98-5c97-4bac-91a2-d8420bdb5c36 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:02:01.645129 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1108/2207] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 18 22:02:01 2022] POST /identity/v3/projects => generated 383 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 22:02:01.646318 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-08655f98-5c97-4bac-91a2-d8420bdb5c36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:02:01.647639 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07edb33a-ee76-4b6e-95b5-32a61c63c934 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:01.648139 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07edb33a-ee76-4b6e-95b5-32a61c63c934 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:01.649045 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07edb33a-ee76-4b6e-95b5-32a61c63c934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:01.669787 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-07edb33a-ee76-4b6e-95b5-32a61c63c934 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:02:01.671026 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-07edb33a-ee76-4b6e-95b5-32a61c63c934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:02:01.715533 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08655f98-5c97-4bac-91a2-d8420bdb5c36 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:02:01.731556 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1109/2208] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:02:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 22:02:01.733206 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07edb33a-ee76-4b6e-95b5-32a61c63c934 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:02:01.734569 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-07edb33a-ee76-4b6e-95b5-32a61c63c934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:02:01.753079 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07edb33a-ee76-4b6e-95b5-32a61c63c934 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:02:01.753732 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:02:01.757788 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619d54f0-e494-496e-97a3-5ac597c9c069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:02:01.758392 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619d54f0-e494-496e-97a3-5ac597c9c069 admin admin] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:01.758677 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619d54f0-e494-496e-97a3-5ac597c9c069 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:01.758955 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619d54f0-e494-496e-97a3-5ac597c9c069 admin admin] PATH_INFO: `/v3/users` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:01.759587 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619d54f0-e494-496e-97a3-5ac597c9c069 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:02:01.761569 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619d54f0-e494-496e-97a3-5ac597c9c069 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:02:01.775980 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:02:01.778437 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20db5910-52e6-4a9a-a486-ab978ed29689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:02:01.779212 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20db5910-52e6-4a9a-a486-ab978ed29689 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:01.779532 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20db5910-52e6-4a9a-a486-ab978ed29689 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:01.779864 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20db5910-52e6-4a9a-a486-ab978ed29689 admin admin] PATH_INFO: `/v3/users/019133354642416981883b3069c9d4b2` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:01.786202 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20db5910-52e6-4a9a-a486-ab978ed29689 admin admin] RBAC: Authorizing `identity:delete_user(user_id=019133354642416981883b3069c9d4b2)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:02:01.786202 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20db5910-52e6-4a9a-a486-ab978ed29689 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:02:01.862489 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1110/2209] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 18 22:02:01 2022] POST /identity/v3/users => generated 298 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 22:02:01.863320 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619d54f0-e494-496e-97a3-5ac597c9c069 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:02:01.864884 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-619d54f0-e494-496e-97a3-5ac597c9c069 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:02:01.920652 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619d54f0-e494-496e-97a3-5ac597c9c069 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:02:01.924996 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1a235b-e928-4d21-94d7-be8eb6f9356a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a937971ad1a4b0c8697c764f214d446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:02:01.925592 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1a235b-e928-4d21-94d7-be8eb6f9356a service neutron] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:01.925869 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1a235b-e928-4d21-94d7-be8eb6f9356a service neutron] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:01.926141 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1a235b-e928-4d21-94d7-be8eb6f9356a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:01.935027 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1a235b-e928-4d21-94d7-be8eb6f9356a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:02:01.936454 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1a235b-e928-4d21-94d7-be8eb6f9356a service neutron] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:02:01.948057 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1111/2210] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:02:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:02:01.948921 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1a235b-e928-4d21-94d7-be8eb6f9356a service neutron] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:02:01.958470 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1a235b-e928-4d21-94d7-be8eb6f9356a service neutron] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:02:01.963902 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90231eec-9ecb-4336-9646-5f99e53e00c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:02:01.964697 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90231eec-9ecb-4336-9646-5f99e53e00c8 admin admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:01.965140 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90231eec-9ecb-4336-9646-5f99e53e00c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:01.965140 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90231eec-9ecb-4336-9646-5f99e53e00c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:01.965809 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90231eec-9ecb-4336-9646-5f99e53e00c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:02:01.967735 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90231eec-9ecb-4336-9646-5f99e53e00c8 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:02:01.980502 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1112/2211] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:02:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:02:01.985054 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90231eec-9ecb-4336-9646-5f99e53e00c8 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:02:01.998063 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90231eec-9ecb-4336-9646-5f99e53e00c8 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:02:02.003992 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbe1998-9f58-46a9-9e39-30bca30e724e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:02:02.004689 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbe1998-9f58-46a9-9e39-30bca30e724e admin admin] REQUEST_METHOD: `PUT` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:02.004971 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbe1998-9f58-46a9-9e39-30bca30e724e admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:02.005247 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbe1998-9f58-46a9-9e39-30bca30e724e admin admin] PATH_INFO: `/v3/projects/405cbf0079ed4d45a52cf5bc94f072fe/users/98d6b4669de84a0b9d17b726d56514f1/roles/0833202e2a3d47d1b6b3af57006641b1` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:02.026704 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbe1998-9f58-46a9-9e39-30bca30e724e admin admin] RBAC: Authorizing `identity:create_grant(project_id=405cbf0079ed4d45a52cf5bc94f072fe, user_id=98d6b4669de84a0b9d17b726d56514f1, role_id=0833202e2a3d47d1b6b3af57006641b1)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:02:02.109434 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-20db5910-52e6-4a9a-a486-ab978ed29689 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '019133354642416981883b3069c9d4b2'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:02:02.110104 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbe1998-9f58-46a9-9e39-30bca30e724e admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:02:02.110206 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-20db5910-52e6-4a9a-a486-ab978ed29689 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '019133354642416981883b3069c9d4b2'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:02:02.110206 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-20db5910-52e6-4a9a-a486-ab978ed29689 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '019133354642416981883b3069c9d4b2'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:02:02.110206 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-20db5910-52e6-4a9a-a486-ab978ed29689 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '019133354642416981883b3069c9d4b2'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:02:02.110206 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-20db5910-52e6-4a9a-a486-ab978ed29689 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '019133354642416981883b3069c9d4b2'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:02:02.122406 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:02:02.271339 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1113/2212] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 18 22:02:01 2022] PUT /identity/v3/projects/405cbf0079ed4d45a52cf5bc94f072fe/users/98d6b4669de84a0b9d17b726d56514f1/roles/0833202e2a3d47d1b6b3af57006641b1 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:02:02.275426 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbe1998-9f58-46a9-9e39-30bca30e724e admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:02:02.277491 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-9bbe1998-9f58-46a9-9e39-30bca30e724e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:02:02.299505 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1100/2213] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 18 22:02:01 2022] DELETE /identity/v3/users/019133354642416981883b3069c9d4b2 => generated 0 bytes in 656 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:02:02.360000 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbe1998-9f58-46a9-9e39-30bca30e724e admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:02:02.442964 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d7f48e-83ef-4e6e-be2d-6fa49b3ef179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:02:02.443511 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d7f48e-83ef-4e6e-be2d-6fa49b3ef179 admin admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:02.443795 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d7f48e-83ef-4e6e-be2d-6fa49b3ef179 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:02.444091 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d7f48e-83ef-4e6e-be2d-6fa49b3ef179 admin admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:02.444779 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d7f48e-83ef-4e6e-be2d-6fa49b3ef179 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:02:02.446710 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d7f48e-83ef-4e6e-be2d-6fa49b3ef179 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:02:02.461028 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1114/2214] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:02:02 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 22:02:02.462273 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20db5910-52e6-4a9a-a486-ab978ed29689 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:02:02.472886 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20db5910-52e6-4a9a-a486-ab978ed29689 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:02:02.477569 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fce091-dd44-45e6-90fd-07a4741d9eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:02:02.478235 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fce091-dd44-45e6-90fd-07a4741d9eca admin admin] REQUEST_METHOD: `PUT` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:02.478515 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fce091-dd44-45e6-90fd-07a4741d9eca admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:02.478789 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fce091-dd44-45e6-90fd-07a4741d9eca admin admin] PATH_INFO: `/v3/projects/405cbf0079ed4d45a52cf5bc94f072fe/users/98d6b4669de84a0b9d17b726d56514f1/roles/0833202e2a3d47d1b6b3af57006641b1` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:02.480755 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fce091-dd44-45e6-90fd-07a4741d9eca admin admin] RBAC: Authorizing `identity:create_grant(project_id=405cbf0079ed4d45a52cf5bc94f072fe, user_id=98d6b4669de84a0b9d17b726d56514f1, role_id=0833202e2a3d47d1b6b3af57006641b1)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:02:02.483397 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fce091-dd44-45e6-90fd-07a4741d9eca admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:02:02.508511 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1101/2215] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 18 22:02:02 2022] PUT /identity/v3/projects/405cbf0079ed4d45a52cf5bc94f072fe/users/98d6b4669de84a0b9d17b726d56514f1/roles/0833202e2a3d47d1b6b3af57006641b1 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:02:02.510449 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e744a758-5777-4f84-bb45-646f37b16483 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:02.510928 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e744a758-5777-4f84-bb45-646f37b16483 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:02.511213 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e744a758-5777-4f84-bb45-646f37b16483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:02.519327 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:DELETE=2,keystone:SELECT=96,keystone:INSERT=2 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:02:02.549500 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-e744a758-5777-4f84-bb45-646f37b16483 None None] MFA Rules not processed for user `98d6b4669de84a0b9d17b726d56514f1`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:02:02.551024 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-e744a758-5777-4f84-bb45-646f37b16483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:02:02.599450 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fce091-dd44-45e6-90fd-07a4741d9eca admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:02:02.604488 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-a0fce091-dd44-45e6-90fd-07a4741d9eca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:02:02.663845 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1115/2216] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:02:02 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:02:02.675335 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e744a758-5777-4f84-bb45-646f37b16483 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:02:02.679245 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-e744a758-5777-4f84-bb45-646f37b16483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:02:02.683878 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fce091-dd44-45e6-90fd-07a4741d9eca admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:02:02.688813 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28731e01-425e-4137-b595-4d56ba39febb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:02:02.689488 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28731e01-425e-4137-b595-4d56ba39febb admin admin] REQUEST_METHOD: `DELETE` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:02.689774 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28731e01-425e-4137-b595-4d56ba39febb admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:02.691828 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28731e01-425e-4137-b595-4d56ba39febb admin admin] PATH_INFO: `/v3/projects/50fda2fed6ac4c69ac8dc997202e2e51` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:02.691828 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28731e01-425e-4137-b595-4d56ba39febb admin admin] RBAC: Authorizing `identity:delete_project(project_id=50fda2fed6ac4c69ac8dc997202e2e51)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:02:02.693291 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28731e01-425e-4137-b595-4d56ba39febb admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:02:02.737797 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e744a758-5777-4f84-bb45-646f37b16483 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:02:02.741559 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6c37d5-2998-41a5-bb69-6d5af8f1d5ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22b6a7c36f8a4795a75271b8079821c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:02:02.742163 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6c37d5-2998-41a5-bb69-6d5af8f1d5ee service cinder] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:02.742441 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6c37d5-2998-41a5-bb69-6d5af8f1d5ee service cinder] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:02.742882 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6c37d5-2998-41a5-bb69-6d5af8f1d5ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:02.752711 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6c37d5-2998-41a5-bb69-6d5af8f1d5ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:02:02.753874 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6c37d5-2998-41a5-bb69-6d5af8f1d5ee service cinder] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:02:02.763464 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1116/2217] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:02:02 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 22:02:02.815268 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6c37d5-2998-41a5-bb69-6d5af8f1d5ee service cinder] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:02:02.817398 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-6a6c37d5-2998-41a5-bb69-6d5af8f1d5ee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:02:02.844407 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6c37d5-2998-41a5-bb69-6d5af8f1d5ee service cinder] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:02:02.868318 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-28731e01-425e-4137-b595-4d56ba39febb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50fda2fed6ac4c69ac8dc997202e2e51', 'request_id': 'req-28731e01-425e-4137-b595-4d56ba39febb'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:02:02.877341 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-28731e01-425e-4137-b595-4d56ba39febb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50fda2fed6ac4c69ac8dc997202e2e51', 'request_id': 'req-28731e01-425e-4137-b595-4d56ba39febb'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:02:02.912197 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=92,keystone:DELETE=3,keystone:INSERT=5 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:02:02.923412 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3279ec2-0e2b-4703-8477-7277335fa4d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:02:02.924962 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3279ec2-0e2b-4703-8477-7277335fa4d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:02.925246 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3279ec2-0e2b-4703-8477-7277335fa4d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:02.925525 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3279ec2-0e2b-4703-8477-7277335fa4d9 admin admin] PATH_INFO: `/v3/projects/ac543f54100b49e1be0013ea2a313e66` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:02.926676 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3279ec2-0e2b-4703-8477-7277335fa4d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac543f54100b49e1be0013ea2a313e66)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:02:02.928744 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3279ec2-0e2b-4703-8477-7277335fa4d9 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:02:02.961878 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-28731e01-425e-4137-b595-4d56ba39febb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50fda2fed6ac4c69ac8dc997202e2e51', 'request_id': 'req-28731e01-425e-4137-b595-4d56ba39febb'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:02:02.974066 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-28731e01-425e-4137-b595-4d56ba39febb admin admin] The token cache is being invalidate because project 50fda2fed6ac4c69ac8dc997202e2e51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88096) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 22:02:02.974846 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-28731e01-425e-4137-b595-4d56ba39febb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:02:02.975184 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-28731e01-425e-4137-b595-4d56ba39febb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:02:02.976739 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1102/2218] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 18 22:02:02 2022] DELETE /identity/v3/projects/50fda2fed6ac4c69ac8dc997202e2e51 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 22:02:02.977507 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28731e01-425e-4137-b595-4d56ba39febb admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:02:02.978790 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-28731e01-425e-4137-b595-4d56ba39febb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:02:03.037471 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28731e01-425e-4137-b595-4d56ba39febb admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:02:03.041213 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279aa4a9-48fd-411b-b32f-b53cf1ff25f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22b6a7c36f8a4795a75271b8079821c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:02:03.041820 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279aa4a9-48fd-411b-b32f-b53cf1ff25f4 service cinder] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:03.042099 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279aa4a9-48fd-411b-b32f-b53cf1ff25f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:03.042366 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279aa4a9-48fd-411b-b32f-b53cf1ff25f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:03.044094 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-279aa4a9-48fd-411b-b32f-b53cf1ff25f4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:02:03.076447 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-d3279ec2-0e2b-4703-8477-7277335fa4d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac543f54100b49e1be0013ea2a313e66', 'request_id': 'req-d3279ec2-0e2b-4703-8477-7277335fa4d9'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:02:03.082077 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-d3279ec2-0e2b-4703-8477-7277335fa4d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac543f54100b49e1be0013ea2a313e66', 'request_id': 'req-d3279ec2-0e2b-4703-8477-7277335fa4d9'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:02:03.103505 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279aa4a9-48fd-411b-b32f-b53cf1ff25f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:02:03.104978 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279aa4a9-48fd-411b-b32f-b53cf1ff25f4 service cinder] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:02:03.114509 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1103/2219] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:02:02 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:02:03.115327 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279aa4a9-48fd-411b-b32f-b53cf1ff25f4 service cinder] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:02:03.116699 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-279aa4a9-48fd-411b-b32f-b53cf1ff25f4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:02:03.129549 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279aa4a9-48fd-411b-b32f-b53cf1ff25f4 service cinder] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:02:03.192236 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4cdda2-aa21-4d81-b91a-68c1273cbe93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:02:03.192902 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4cdda2-aa21-4d81-b91a-68c1273cbe93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:03.193192 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4cdda2-aa21-4d81-b91a-68c1273cbe93 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:03.193481 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4cdda2-aa21-4d81-b91a-68c1273cbe93 admin admin] PATH_INFO: `/v3/users/de90a7952269493988b05777fb04b3af` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:03.194625 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4cdda2-aa21-4d81-b91a-68c1273cbe93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de90a7952269493988b05777fb04b3af)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:02:03.196791 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4cdda2-aa21-4d81-b91a-68c1273cbe93 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:02:03.241676 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-d3279ec2-0e2b-4703-8477-7277335fa4d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac543f54100b49e1be0013ea2a313e66', 'request_id': 'req-d3279ec2-0e2b-4703-8477-7277335fa4d9'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:02:03.254090 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-d3279ec2-0e2b-4703-8477-7277335fa4d9 admin admin] The token cache is being invalidate because project ac543f54100b49e1be0013ea2a313e66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88097) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 22:02:03.254463 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-d3279ec2-0e2b-4703-8477-7277335fa4d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:02:03.255196 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-d3279ec2-0e2b-4703-8477-7277335fa4d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:02:03.256752 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1117/2220] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 18 22:02:02 2022] DELETE /identity/v3/projects/ac543f54100b49e1be0013ea2a313e66 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 22:02:03.261507 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e62884-42a7-478d-b9da-4d592d3da5f2 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:03.261796 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e62884-42a7-478d-b9da-4d592d3da5f2 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:03.262125 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e62884-42a7-478d-b9da-4d592d3da5f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:03.282185 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-14e62884-42a7-478d-b9da-4d592d3da5f2 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:02:03.290845 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-14e62884-42a7-478d-b9da-4d592d3da5f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:02:03.292334 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1118/2221] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:02:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 22:02:03.301645 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3c5ce6-e9be-43af-abe5-fa3fa6e424b9 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:03.301932 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3c5ce6-e9be-43af-abe5-fa3fa6e424b9 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:03.302208 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3c5ce6-e9be-43af-abe5-fa3fa6e424b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:03.323258 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-ee3c5ce6-e9be-43af-abe5-fa3fa6e424b9 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:02:03.324564 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-ee3c5ce6-e9be-43af-abe5-fa3fa6e424b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:02:03.333642 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1119/2222] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:02:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 22:02:03.337655 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3c5ce6-e9be-43af-abe5-fa3fa6e424b9 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:02:03.349544 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3c5ce6-e9be-43af-abe5-fa3fa6e424b9 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:02:03.353588 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91593a66-45fe-4d30-b37b-768c505aac9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:02:03.354188 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91593a66-45fe-4d30-b37b-768c505aac9f admin admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:03.354521 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91593a66-45fe-4d30-b37b-768c505aac9f admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:03.355096 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91593a66-45fe-4d30-b37b-768c505aac9f admin admin] PATH_INFO: `/v3/domains` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:03.355470 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91593a66-45fe-4d30-b37b-768c505aac9f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 22:02:03.355772 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91593a66-45fe-4d30-b37b-768c505aac9f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:02:03.357406 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91593a66-45fe-4d30-b37b-768c505aac9f admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:02:03.369459 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1120/2223] 10.222.0.27 () {58 vars in 1153 bytes} [Thu Aug 18 22:02:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 22:02:03.373758 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91593a66-45fe-4d30-b37b-768c505aac9f admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:02:03.383612 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91593a66-45fe-4d30-b37b-768c505aac9f admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:02:03.388193 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f4f539-e778-43c7-bf32-bb63088c0808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:02:03.388798 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f4f539-e778-43c7-bf32-bb63088c0808 admin admin] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:03.389083 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f4f539-e778-43c7-bf32-bb63088c0808 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:03.389355 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f4f539-e778-43c7-bf32-bb63088c0808 admin admin] PATH_INFO: `/v3/projects` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:03.389963 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f4f539-e778-43c7-bf32-bb63088c0808 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:02:03.391879 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f4f539-e778-43c7-bf32-bb63088c0808 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:02:03.437981 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-cd4cdda2-aa21-4d81-b91a-68c1273cbe93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de90a7952269493988b05777fb04b3af'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:02:03.445049 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-cd4cdda2-aa21-4d81-b91a-68c1273cbe93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de90a7952269493988b05777fb04b3af'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:02:03.445747 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-cd4cdda2-aa21-4d81-b91a-68c1273cbe93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de90a7952269493988b05777fb04b3af'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:02:03.446361 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-cd4cdda2-aa21-4d81-b91a-68c1273cbe93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de90a7952269493988b05777fb04b3af'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:02:03.458899 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-cd4cdda2-aa21-4d81-b91a-68c1273cbe93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de90a7952269493988b05777fb04b3af'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:02:03.511871 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1121/2224] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 18 22:02:03 2022] POST /identity/v3/projects => generated 383 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 22:02:03.516001 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f4f539-e778-43c7-bf32-bb63088c0808 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:02:03.518163 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-99f4f539-e778-43c7-bf32-bb63088c0808 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:02:03.560669 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:02:03.564698 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1104/2225] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 18 22:02:03 2022] DELETE /identity/v3/users/de90a7952269493988b05777fb04b3af => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:02:03.584542 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f4f539-e778-43c7-bf32-bb63088c0808 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:02:03.660158 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1a5efc-8513-412d-b7d4-9936e0f8e1dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:02:03.660819 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1a5efc-8513-412d-b7d4-9936e0f8e1dd admin admin] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:03.661107 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1a5efc-8513-412d-b7d4-9936e0f8e1dd admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:03.661460 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1a5efc-8513-412d-b7d4-9936e0f8e1dd admin admin] PATH_INFO: `/v3/users` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:03.662051 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1a5efc-8513-412d-b7d4-9936e0f8e1dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:02:03.663993 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1a5efc-8513-412d-b7d4-9936e0f8e1dd admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:02:03.860880 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1122/2226] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 18 22:02:03 2022] POST /identity/v3/users => generated 292 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 22:02:03.863178 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4cdda2-aa21-4d81-b91a-68c1273cbe93 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:02:03.873245 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4cdda2-aa21-4d81-b91a-68c1273cbe93 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:02:03.878991 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b792d588-0ca5-4949-ae35-cfab5f79026f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:02:03.879704 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b792d588-0ca5-4949-ae35-cfab5f79026f admin admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:03.879989 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b792d588-0ca5-4949-ae35-cfab5f79026f admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:03.880262 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b792d588-0ca5-4949-ae35-cfab5f79026f admin admin] PATH_INFO: `/v3/roles` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:03.881093 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b792d588-0ca5-4949-ae35-cfab5f79026f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:02:03.882713 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b792d588-0ca5-4949-ae35-cfab5f79026f admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:02:03.894707 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1105/2227] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:02:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:02:03.897672 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1a5efc-8513-412d-b7d4-9936e0f8e1dd admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:02:03.908582 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1a5efc-8513-412d-b7d4-9936e0f8e1dd admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:02:03.915541 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9502a500-63fd-4885-a6a2-ae717b9a890c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:02:03.916406 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9502a500-63fd-4885-a6a2-ae717b9a890c admin admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:03.916406 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9502a500-63fd-4885-a6a2-ae717b9a890c admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:03.916741 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9502a500-63fd-4885-a6a2-ae717b9a890c admin admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:03.917392 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9502a500-63fd-4885-a6a2-ae717b9a890c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:02:03.918998 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9502a500-63fd-4885-a6a2-ae717b9a890c admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:02:03.932787 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1123/2228] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:02:03 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:02:03.936222 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b792d588-0ca5-4949-ae35-cfab5f79026f admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:02:03.957439 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b792d588-0ca5-4949-ae35-cfab5f79026f admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:02:03.971658 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a774d66a-807f-4ef6-9503-8f8da3241ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:02:03.972725 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a774d66a-807f-4ef6-9503-8f8da3241ca6 admin admin] REQUEST_METHOD: `PUT` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:03.973013 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a774d66a-807f-4ef6-9503-8f8da3241ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:03.973299 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a774d66a-807f-4ef6-9503-8f8da3241ca6 admin admin] PATH_INFO: `/v3/projects/b341fa4471bc47df9e8ed648ee22241e/users/6d798acc659f494c9bcd44ac1568ac26/roles/de8f2438056f4af9879423f8a59e0e0b` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:04.002938 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a774d66a-807f-4ef6-9503-8f8da3241ca6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b341fa4471bc47df9e8ed648ee22241e, user_id=6d798acc659f494c9bcd44ac1568ac26, role_id=de8f2438056f4af9879423f8a59e0e0b)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:02:04.006199 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a774d66a-807f-4ef6-9503-8f8da3241ca6 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:02:04.084862 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:02:04.102609 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1106/2229] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 18 22:02:03 2022] PUT /identity/v3/projects/b341fa4471bc47df9e8ed648ee22241e/users/6d798acc659f494c9bcd44ac1568ac26/roles/de8f2438056f4af9879423f8a59e0e0b => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:02:04.113331 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64005613-a82b-483f-acf2-71803d4cbb6b None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:04.113624 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64005613-a82b-483f-acf2-71803d4cbb6b None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:04.113905 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64005613-a82b-483f-acf2-71803d4cbb6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:04.141121 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-64005613-a82b-483f-acf2-71803d4cbb6b None None] MFA Rules not processed for user `6d798acc659f494c9bcd44ac1568ac26`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:02:04.142848 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-64005613-a82b-483f-acf2-71803d4cbb6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:02:04.195407 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a774d66a-807f-4ef6-9503-8f8da3241ca6 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:02:04.196414 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-a774d66a-807f-4ef6-9503-8f8da3241ca6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:02:04.223240 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1124/2230] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:02:04 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:02:04.228042 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64005613-a82b-483f-acf2-71803d4cbb6b None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:02:04.291527 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a774d66a-807f-4ef6-9503-8f8da3241ca6 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:02:04.297345 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4d7343-8db5-4d0b-8679-67b81ab999e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:02:04.297899 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4d7343-8db5-4d0b-8679-67b81ab999e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:04.298181 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4d7343-8db5-4d0b-8679-67b81ab999e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:04.298513 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4d7343-8db5-4d0b-8679-67b81ab999e5 admin admin] PATH_INFO: `/v3/projects/7a8bfeddd61549a38156c63231aaf02b` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:04.300024 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4d7343-8db5-4d0b-8679-67b81ab999e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a8bfeddd61549a38156c63231aaf02b)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:02:04.301464 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64005613-a82b-483f-acf2-71803d4cbb6b None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:02:04.301971 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4d7343-8db5-4d0b-8679-67b81ab999e5 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:02:04.306380 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d527e2d9-f861-48de-9bf2-70209464db42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:02:04.306981 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d527e2d9-f861-48de-9bf2-70209464db42 admin admin] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:04.307280 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d527e2d9-f861-48de-9bf2-70209464db42 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:04.307567 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d527e2d9-f861-48de-9bf2-70209464db42 admin admin] PATH_INFO: `/v3/projects` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:04.308193 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d527e2d9-f861-48de-9bf2-70209464db42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:02:04.310275 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d527e2d9-f861-48de-9bf2-70209464db42 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:02:04.427800 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:02:04.427992 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1125/2231] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 18 22:02:04 2022] POST /identity/v3/projects => generated 381 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 22:02:04.429145 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d527e2d9-f861-48de-9bf2-70209464db42 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:02:04.434317 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-ad4d7343-8db5-4d0b-8679-67b81ab999e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a8bfeddd61549a38156c63231aaf02b', 'request_id': 'req-ad4d7343-8db5-4d0b-8679-67b81ab999e5'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:02:04.440430 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-ad4d7343-8db5-4d0b-8679-67b81ab999e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a8bfeddd61549a38156c63231aaf02b', 'request_id': 'req-ad4d7343-8db5-4d0b-8679-67b81ab999e5'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:02:04.492747 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d527e2d9-f861-48de-9bf2-70209464db42 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:02:04.497425 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cd4ecc-e05f-47c9-bf23-ceac66f866a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:02:04.498036 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cd4ecc-e05f-47c9-bf23-ceac66f866a8 admin admin] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:04.498312 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cd4ecc-e05f-47c9-bf23-ceac66f866a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:04.498593 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cd4ecc-e05f-47c9-bf23-ceac66f866a8 admin admin] PATH_INFO: `/v3/users` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:04.499212 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cd4ecc-e05f-47c9-bf23-ceac66f866a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:02:04.501231 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cd4ecc-e05f-47c9-bf23-ceac66f866a8 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:02:04.516011 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-ad4d7343-8db5-4d0b-8679-67b81ab999e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a8bfeddd61549a38156c63231aaf02b', 'request_id': 'req-ad4d7343-8db5-4d0b-8679-67b81ab999e5'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:02:04.528916 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:02:04.530429 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-ad4d7343-8db5-4d0b-8679-67b81ab999e5 admin admin] The token cache is being invalidate because project 7a8bfeddd61549a38156c63231aaf02b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88096) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 22:02:04.530771 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-ad4d7343-8db5-4d0b-8679-67b81ab999e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:02:04.531425 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-ad4d7343-8db5-4d0b-8679-67b81ab999e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:02:04.533642 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1107/2232] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 18 22:02:04 2022] DELETE /identity/v3/projects/7a8bfeddd61549a38156c63231aaf02b => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:02:04.538303 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1605156e-6632-4f18-8ad2-5d3da8cb66aa None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:04.538584 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1605156e-6632-4f18-8ad2-5d3da8cb66aa None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:04.538857 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1605156e-6632-4f18-8ad2-5d3da8cb66aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:04.558553 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-1605156e-6632-4f18-8ad2-5d3da8cb66aa None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:02:04.559780 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-1605156e-6632-4f18-8ad2-5d3da8cb66aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:02:04.567769 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1108/2233] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:02:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 22:02:04.575162 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5adac9e-eee8-4753-9a47-7f6f10bdde14 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:04.575442 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5adac9e-eee8-4753-9a47-7f6f10bdde14 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:04.575716 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5adac9e-eee8-4753-9a47-7f6f10bdde14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:04.594908 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-a5adac9e-eee8-4753-9a47-7f6f10bdde14 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:02:04.596795 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-a5adac9e-eee8-4753-9a47-7f6f10bdde14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:02:04.604858 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1109/2234] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:02:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 22:02:04.608893 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5adac9e-eee8-4753-9a47-7f6f10bdde14 None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:02:04.618720 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5adac9e-eee8-4753-9a47-7f6f10bdde14 None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:02:04.623544 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354c8eb2-8126-4677-921f-6d046cd44927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:02:04.624130 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354c8eb2-8126-4677-921f-6d046cd44927 admin admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:04.624419 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354c8eb2-8126-4677-921f-6d046cd44927 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:04.624781 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354c8eb2-8126-4677-921f-6d046cd44927 admin admin] PATH_INFO: `/v3/domains` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:04.624907 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1126/2235] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 18 22:02:04 2022] POST /identity/v3/users => generated 297 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 22:02:04.625498 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354c8eb2-8126-4677-921f-6d046cd44927 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 22:02:04.625855 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354c8eb2-8126-4677-921f-6d046cd44927 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:02:04.628041 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354c8eb2-8126-4677-921f-6d046cd44927 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:02:04.629406 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cd4ecc-e05f-47c9-bf23-ceac66f866a8 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:02:04.631066 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-d2cd4ecc-e05f-47c9-bf23-ceac66f866a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:02:04.644390 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1110/2236] 10.222.0.27 () {58 vars in 1153 bytes} [Thu Aug 18 22:02:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 22:02:04.644895 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cd4ecc-e05f-47c9-bf23-ceac66f866a8 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:02:04.645522 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354c8eb2-8126-4677-921f-6d046cd44927 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:02:04.651842 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9f7034-77de-46ca-b9ee-3efdfcd62293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:02:04.653025 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9f7034-77de-46ca-b9ee-3efdfcd62293 admin admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:04.653309 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9f7034-77de-46ca-b9ee-3efdfcd62293 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:04.653852 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9f7034-77de-46ca-b9ee-3efdfcd62293 admin admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:04.654574 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9f7034-77de-46ca-b9ee-3efdfcd62293 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:02:04.656274 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9f7034-77de-46ca-b9ee-3efdfcd62293 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:02:04.656612 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354c8eb2-8126-4677-921f-6d046cd44927 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:02:04.661876 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8747b5-29fa-4f1c-8d70-17321fe19935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:02:04.662489 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8747b5-29fa-4f1c-8d70-17321fe19935 admin admin] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:04.662771 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8747b5-29fa-4f1c-8d70-17321fe19935 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:04.663048 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8747b5-29fa-4f1c-8d70-17321fe19935 admin admin] PATH_INFO: `/v3/projects` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:04.664202 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8747b5-29fa-4f1c-8d70-17321fe19935 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:02:04.666405 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8747b5-29fa-4f1c-8d70-17321fe19935 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:02:04.671503 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1127/2237] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:02:04 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 22:02:04.672739 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9f7034-77de-46ca-b9ee-3efdfcd62293 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:02:04.684224 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9f7034-77de-46ca-b9ee-3efdfcd62293 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:02:04.695351 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c018c1-6c7f-4643-b1a5-a3ec57327ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:02:04.695351 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c018c1-6c7f-4643-b1a5-a3ec57327ae6 admin admin] REQUEST_METHOD: `PUT` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:04.695351 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c018c1-6c7f-4643-b1a5-a3ec57327ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:04.695351 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c018c1-6c7f-4643-b1a5-a3ec57327ae6 admin admin] PATH_INFO: `/v3/projects/547e2d7f2b934e0fb27021373370c7cd/users/631fc219ae3c4e0c950924918b7c4cc0/roles/0833202e2a3d47d1b6b3af57006641b1` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:04.707661 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c018c1-6c7f-4643-b1a5-a3ec57327ae6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=547e2d7f2b934e0fb27021373370c7cd, user_id=631fc219ae3c4e0c950924918b7c4cc0, role_id=0833202e2a3d47d1b6b3af57006641b1)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:02:04.710464 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c018c1-6c7f-4643-b1a5-a3ec57327ae6 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:02:04.783389 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1111/2238] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 18 22:02:04 2022] POST /identity/v3/projects => generated 379 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 22:02:04.785475 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8747b5-29fa-4f1c-8d70-17321fe19935 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:02:04.813006 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1128/2239] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 18 22:02:04 2022] PUT /identity/v3/projects/547e2d7f2b934e0fb27021373370c7cd/users/631fc219ae3c4e0c950924918b7c4cc0/roles/0833202e2a3d47d1b6b3af57006641b1 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:02:04.813694 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c018c1-6c7f-4643-b1a5-a3ec57327ae6 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:02:04.862560 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8747b5-29fa-4f1c-8d70-17321fe19935 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:02:04.892136 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c018c1-6c7f-4643-b1a5-a3ec57327ae6 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:02:04.896121 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b278f0c1-2052-4a7d-8ca4-5cd4beb28782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:02:04.896770 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b278f0c1-2052-4a7d-8ca4-5cd4beb28782 admin admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:04.897113 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b278f0c1-2052-4a7d-8ca4-5cd4beb28782 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:04.897533 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b278f0c1-2052-4a7d-8ca4-5cd4beb28782 admin admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:04.898189 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b278f0c1-2052-4a7d-8ca4-5cd4beb28782 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:02:04.901064 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b278f0c1-2052-4a7d-8ca4-5cd4beb28782 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:02:04.916635 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1129/2240] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:02:04 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 22:02:04.917702 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b278f0c1-2052-4a7d-8ca4-5cd4beb28782 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:02:04.928713 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b278f0c1-2052-4a7d-8ca4-5cd4beb28782 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:02:04.934230 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4bdf2b-8510-4f52-8850-98d2b54d2e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:02:04.934546 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe0a458-dda1-4196-ae6d-a5ebcebb7ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:02:04.935352 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4bdf2b-8510-4f52-8850-98d2b54d2e36 admin admin] REQUEST_METHOD: `PUT` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:04.935492 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe0a458-dda1-4196-ae6d-a5ebcebb7ece admin admin] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:04.935593 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4bdf2b-8510-4f52-8850-98d2b54d2e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:04.935593 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4bdf2b-8510-4f52-8850-98d2b54d2e36 admin admin] PATH_INFO: `/v3/projects/547e2d7f2b934e0fb27021373370c7cd/users/631fc219ae3c4e0c950924918b7c4cc0/roles/0833202e2a3d47d1b6b3af57006641b1` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:04.935775 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe0a458-dda1-4196-ae6d-a5ebcebb7ece admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:04.936941 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe0a458-dda1-4196-ae6d-a5ebcebb7ece admin admin] PATH_INFO: `/v3/users` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:04.937586 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe0a458-dda1-4196-ae6d-a5ebcebb7ece admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:02:04.937840 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4bdf2b-8510-4f52-8850-98d2b54d2e36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=547e2d7f2b934e0fb27021373370c7cd, user_id=631fc219ae3c4e0c950924918b7c4cc0, role_id=0833202e2a3d47d1b6b3af57006641b1)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:02:04.940238 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe0a458-dda1-4196-ae6d-a5ebcebb7ece admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:02:04.941317 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4bdf2b-8510-4f52-8850-98d2b54d2e36 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:02:04.955506 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1130/2241] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 18 22:02:04 2022] PUT /identity/v3/projects/547e2d7f2b934e0fb27021373370c7cd/users/631fc219ae3c4e0c950924918b7c4cc0/roles/0833202e2a3d47d1b6b3af57006641b1 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:02:04.966686 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38575cc6-5fe2-4003-92fb-b17e07d2a89c None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:04.966958 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38575cc6-5fe2-4003-92fb-b17e07d2a89c None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:04.967291 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38575cc6-5fe2-4003-92fb-b17e07d2a89c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:04.996767 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-38575cc6-5fe2-4003-92fb-b17e07d2a89c None None] MFA Rules not processed for user `631fc219ae3c4e0c950924918b7c4cc0`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:02:04.997992 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-38575cc6-5fe2-4003-92fb-b17e07d2a89c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:02:05.034544 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1112/2242] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 18 22:02:04 2022] POST /identity/v3/users => generated 290 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 22:02:05.038497 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe0a458-dda1-4196-ae6d-a5ebcebb7ece admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:02:05.049637 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe0a458-dda1-4196-ae6d-a5ebcebb7ece admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:02:05.084394 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1131/2243] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:02:04 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 22:02:05.102419 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38575cc6-5fe2-4003-92fb-b17e07d2a89c None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:02:05.103846 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-38575cc6-5fe2-4003-92fb-b17e07d2a89c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:02:05.109115 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd065770-6dca-41fe-8082-5fab99ae748e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:02:05.110465 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd065770-6dca-41fe-8082-5fab99ae748e admin admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:05.110580 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd065770-6dca-41fe-8082-5fab99ae748e admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:05.111023 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd065770-6dca-41fe-8082-5fab99ae748e admin admin] PATH_INFO: `/v3/roles` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:05.113200 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd065770-6dca-41fe-8082-5fab99ae748e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:02:05.114839 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd065770-6dca-41fe-8082-5fab99ae748e admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:02:05.128575 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1113/2244] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:02:05 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 22:02:05.129938 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd065770-6dca-41fe-8082-5fab99ae748e admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:02:05.143826 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd065770-6dca-41fe-8082-5fab99ae748e admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:02:05.151728 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77feeef9-4f3d-4670-9b1a-899f895bd737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:02:05.152919 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77feeef9-4f3d-4670-9b1a-899f895bd737 admin admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:05.153304 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77feeef9-4f3d-4670-9b1a-899f895bd737 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:05.153678 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77feeef9-4f3d-4670-9b1a-899f895bd737 admin admin] PATH_INFO: `/v3/roles` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:05.154924 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77feeef9-4f3d-4670-9b1a-899f895bd737 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:02:05.157309 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77feeef9-4f3d-4670-9b1a-899f895bd737 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:02:05.170528 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1114/2245] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:02:05 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 22:02:05.172709 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38575cc6-5fe2-4003-92fb-b17e07d2a89c None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:02:05.182877 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77feeef9-4f3d-4670-9b1a-899f895bd737 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:02:05.182969 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ff18c9-e852-417f-92a3-b9300cfb5fe1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22b6a7c36f8a4795a75271b8079821c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:02:05.182969 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ff18c9-e852-417f-92a3-b9300cfb5fe1 service cinder] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:05.182969 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ff18c9-e852-417f-92a3-b9300cfb5fe1 service cinder] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:05.182969 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ff18c9-e852-417f-92a3-b9300cfb5fe1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:05.186481 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77feeef9-4f3d-4670-9b1a-899f895bd737 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:02:05.190609 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ff18c9-e852-417f-92a3-b9300cfb5fe1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:02:05.192114 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ff18c9-e852-417f-92a3-b9300cfb5fe1 service cinder] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:02:05.193150 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb090fb0-9c7c-4592-82f3-1ed0299a5384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:02:05.193939 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb090fb0-9c7c-4592-82f3-1ed0299a5384 admin admin] REQUEST_METHOD: `PUT` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:05.194285 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb090fb0-9c7c-4592-82f3-1ed0299a5384 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:05.194623 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb090fb0-9c7c-4592-82f3-1ed0299a5384 admin admin] PATH_INFO: `/v3/projects/f57babaff043435ca6c421705d4d2841/users/adaebda3f3b94cfe8c94216f9d225415/roles/de8f2438056f4af9879423f8a59e0e0b` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:05.202705 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1132/2246] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:02:05 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 22:02:05.218155 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb090fb0-9c7c-4592-82f3-1ed0299a5384 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f57babaff043435ca6c421705d4d2841, user_id=adaebda3f3b94cfe8c94216f9d225415, role_id=de8f2438056f4af9879423f8a59e0e0b)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:02:05.221568 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb090fb0-9c7c-4592-82f3-1ed0299a5384 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:02:05.301014 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1115/2247] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 18 22:02:05 2022] PUT /identity/v3/projects/f57babaff043435ca6c421705d4d2841/users/adaebda3f3b94cfe8c94216f9d225415/roles/de8f2438056f4af9879423f8a59e0e0b => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:02:05.310941 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fcbb92-5f19-4e2e-a599-82b63e10ed2e None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:05.311227 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fcbb92-5f19-4e2e-a599-82b63e10ed2e None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:05.311502 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fcbb92-5f19-4e2e-a599-82b63e10ed2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:05.339203 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-68fcbb92-5f19-4e2e-a599-82b63e10ed2e None None] MFA Rules not processed for user `adaebda3f3b94cfe8c94216f9d225415`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:02:05.341189 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:02:05.342342 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-68fcbb92-5f19-4e2e-a599-82b63e10ed2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:02:05.383522 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb090fb0-9c7c-4592-82f3-1ed0299a5384 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:02:05.409161 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1133/2248] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:02:05 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 22:02:05.413798 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fcbb92-5f19-4e2e-a599-82b63e10ed2e None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:02:05.439715 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb090fb0-9c7c-4592-82f3-1ed0299a5384 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:02:05.444789 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d1a7a1-a0fd-4d80-82c6-bb4f4ab163ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22b6a7c36f8a4795a75271b8079821c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:02:05.445408 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d1a7a1-a0fd-4d80-82c6-bb4f4ab163ef service cinder] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:05.445687 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d1a7a1-a0fd-4d80-82c6-bb4f4ab163ef service cinder] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:05.446412 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d1a7a1-a0fd-4d80-82c6-bb4f4ab163ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:05.448420 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-b0d1a7a1-a0fd-4d80-82c6-bb4f4ab163ef service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:02:05.497069 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fcbb92-5f19-4e2e-a599-82b63e10ed2e None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:02:05.512046 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:02:05.514267 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dd4df1-6015-4902-85b4-65dea69bc1bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:02:05.514913 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dd4df1-6015-4902-85b4-65dea69bc1bc admin admin] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:05.515191 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dd4df1-6015-4902-85b4-65dea69bc1bc admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:05.515462 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dd4df1-6015-4902-85b4-65dea69bc1bc admin admin] PATH_INFO: `/v3/projects` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:05.516118 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dd4df1-6015-4902-85b4-65dea69bc1bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:02:05.518261 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dd4df1-6015-4902-85b4-65dea69bc1bc admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:02:05.522595 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d1a7a1-a0fd-4d80-82c6-bb4f4ab163ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:02:05.524975 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d1a7a1-a0fd-4d80-82c6-bb4f4ab163ef service cinder] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:02:05.534824 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1116/2249] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:02:05 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:02:05.620695 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1134/2250] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 18 22:02:05 2022] POST /identity/v3/projects => generated 379 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 22:02:05.625054 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d1a7a1-a0fd-4d80-82c6-bb4f4ab163ef service cinder] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:02:05.631516 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:02:05.636262 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d1a7a1-a0fd-4d80-82c6-bb4f4ab163ef service cinder] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:02:05.696712 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f40a74-c85b-49af-8617-a21aae30b73a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:02:05.697329 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f40a74-c85b-49af-8617-a21aae30b73a admin admin] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:05.697612 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f40a74-c85b-49af-8617-a21aae30b73a admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:05.697881 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f40a74-c85b-49af-8617-a21aae30b73a admin admin] PATH_INFO: `/v3/users` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:05.699318 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f40a74-c85b-49af-8617-a21aae30b73a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:02:05.700474 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f40a74-c85b-49af-8617-a21aae30b73a admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:02:05.738993 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dd4df1-6015-4902-85b4-65dea69bc1bc admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:02:05.740893 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-62dd4df1-6015-4902-85b4-65dea69bc1bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:02:05.754048 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dd4df1-6015-4902-85b4-65dea69bc1bc admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:02:05.759332 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1822eded-ef33-4156-b36a-94222b7a5ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:02:05.759955 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1822eded-ef33-4156-b36a-94222b7a5ffe admin admin] REQUEST_METHOD: `DELETE` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:05.760235 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1822eded-ef33-4156-b36a-94222b7a5ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:05.760509 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1822eded-ef33-4156-b36a-94222b7a5ffe admin admin] PATH_INFO: `/v3/users/eb9846eb78d047289ca1a7a423da83bb` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:05.761692 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1822eded-ef33-4156-b36a-94222b7a5ffe admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb9846eb78d047289ca1a7a423da83bb)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:02:05.763942 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1822eded-ef33-4156-b36a-94222b7a5ffe admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:02:05.773178 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1117/2251] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 18 22:02:05 2022] POST /identity/v3/users => generated 296 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 22:02:05.777914 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f40a74-c85b-49af-8617-a21aae30b73a admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:02:05.789840 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f40a74-c85b-49af-8617-a21aae30b73a admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:02:05.794958 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05137b8d-54d9-4de2-9a3c-8ff1715a2f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:02:05.795559 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05137b8d-54d9-4de2-9a3c-8ff1715a2f02 admin admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:05.795862 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05137b8d-54d9-4de2-9a3c-8ff1715a2f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:05.796153 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05137b8d-54d9-4de2-9a3c-8ff1715a2f02 admin admin] PATH_INFO: `/v3/roles` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:05.796828 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05137b8d-54d9-4de2-9a3c-8ff1715a2f02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:02:05.798540 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05137b8d-54d9-4de2-9a3c-8ff1715a2f02 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:02:05.809056 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1118/2252] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:02:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:02:05.813468 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05137b8d-54d9-4de2-9a3c-8ff1715a2f02 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:02:05.823871 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05137b8d-54d9-4de2-9a3c-8ff1715a2f02 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:02:05.829650 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf2c94c-866d-4637-8550-41881aba5f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:02:05.833572 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf2c94c-866d-4637-8550-41881aba5f8f admin admin] REQUEST_METHOD: `PUT` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:05.833572 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf2c94c-866d-4637-8550-41881aba5f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:05.833572 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf2c94c-866d-4637-8550-41881aba5f8f admin admin] PATH_INFO: `/v3/projects/4716f0a82eb4409394dfeb13466524b0/users/e831800ea67741378a2a95e2bbd9739a/roles/0833202e2a3d47d1b6b3af57006641b1` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:05.847357 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf2c94c-866d-4637-8550-41881aba5f8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4716f0a82eb4409394dfeb13466524b0, user_id=e831800ea67741378a2a95e2bbd9739a, role_id=0833202e2a3d47d1b6b3af57006641b1)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:02:05.850065 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf2c94c-866d-4637-8550-41881aba5f8f admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:02:05.946161 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1119/2253] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 18 22:02:05 2022] PUT /identity/v3/projects/4716f0a82eb4409394dfeb13466524b0/users/e831800ea67741378a2a95e2bbd9739a/roles/0833202e2a3d47d1b6b3af57006641b1 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 22:02:05.950136 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf2c94c-866d-4637-8550-41881aba5f8f admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:02:06.013857 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-1822eded-ef33-4156-b36a-94222b7a5ffe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb9846eb78d047289ca1a7a423da83bb'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:02:06.014073 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf2c94c-866d-4637-8550-41881aba5f8f admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:02:06.020301 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f4b368-8730-4a90-b499-365a20d0bfbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:02:06.020952 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f4b368-8730-4a90-b499-365a20d0bfbe admin admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:06.021234 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f4b368-8730-4a90-b499-365a20d0bfbe admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:06.021514 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f4b368-8730-4a90-b499-365a20d0bfbe admin admin] PATH_INFO: `/v3/roles` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:06.022168 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f4b368-8730-4a90-b499-365a20d0bfbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:02:06.023391 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-1822eded-ef33-4156-b36a-94222b7a5ffe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb9846eb78d047289ca1a7a423da83bb'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:02:06.024032 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f4b368-8730-4a90-b499-365a20d0bfbe admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:02:06.024490 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-1822eded-ef33-4156-b36a-94222b7a5ffe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb9846eb78d047289ca1a7a423da83bb'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:02:06.035228 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1120/2254] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:02:05 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 22:02:06.040868 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f4b368-8730-4a90-b499-365a20d0bfbe admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:02:06.043469 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-1822eded-ef33-4156-b36a-94222b7a5ffe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb9846eb78d047289ca1a7a423da83bb'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:02:06.051632 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f4b368-8730-4a90-b499-365a20d0bfbe admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:02:06.060087 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcfa574-cf39-4406-b73c-2910af20c8b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:02:06.060934 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcfa574-cf39-4406-b73c-2910af20c8b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:06.061343 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcfa574-cf39-4406-b73c-2910af20c8b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:06.061685 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcfa574-cf39-4406-b73c-2910af20c8b7 admin admin] PATH_INFO: `/v3/projects/4716f0a82eb4409394dfeb13466524b0/users/e831800ea67741378a2a95e2bbd9739a/roles/0833202e2a3d47d1b6b3af57006641b1` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:06.063717 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcfa574-cf39-4406-b73c-2910af20c8b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4716f0a82eb4409394dfeb13466524b0, user_id=e831800ea67741378a2a95e2bbd9739a, role_id=0833202e2a3d47d1b6b3af57006641b1)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:02:06.067815 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcfa574-cf39-4406-b73c-2910af20c8b7 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:02:06.082046 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1121/2255] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 18 22:02:06 2022] PUT /identity/v3/projects/4716f0a82eb4409394dfeb13466524b0/users/e831800ea67741378a2a95e2bbd9739a/roles/0833202e2a3d47d1b6b3af57006641b1 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 22:02:06.082898 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcfa574-cf39-4406-b73c-2910af20c8b7 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:02:06.128657 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-1822eded-ef33-4156-b36a-94222b7a5ffe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb9846eb78d047289ca1a7a423da83bb'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:02:06.138401 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1135/2256] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 18 22:02:05 2022] DELETE /identity/v3/users/eb9846eb78d047289ca1a7a423da83bb => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 22:02:06.138401 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa59c9dd-3159-4408-b407-e765fbc6cfd9 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:06.138401 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa59c9dd-3159-4408-b407-e765fbc6cfd9 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:06.138401 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa59c9dd-3159-4408-b407-e765fbc6cfd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:06.150327 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcfa574-cf39-4406-b73c-2910af20c8b7 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:02:06.170597 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-fa59c9dd-3159-4408-b407-e765fbc6cfd9 None None] MFA Rules not processed for user `e831800ea67741378a2a95e2bbd9739a`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:02:06.171885 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-fa59c9dd-3159-4408-b407-e765fbc6cfd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:02:06.208983 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58cfe0f-269f-475b-b222-ce3a1e6ee786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:02:06.209762 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58cfe0f-269f-475b-b222-ce3a1e6ee786 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:06.210398 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58cfe0f-269f-475b-b222-ce3a1e6ee786 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:06.210875 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58cfe0f-269f-475b-b222-ce3a1e6ee786 admin admin] PATH_INFO: `/v3/users/6d798acc659f494c9bcd44ac1568ac26` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:06.212770 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:02:06.216275 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58cfe0f-269f-475b-b222-ce3a1e6ee786 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d798acc659f494c9bcd44ac1568ac26)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:02:06.216275 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58cfe0f-269f-475b-b222-ce3a1e6ee786 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:02:06.242438 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1136/2257] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:02:06 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:02:06.243938 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bc4477-81eb-4c95-8ce3-f9bfcc58fd2d None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:06.244262 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bc4477-81eb-4c95-8ce3-f9bfcc58fd2d None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:06.244507 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bc4477-81eb-4c95-8ce3-f9bfcc58fd2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:06.263269 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-59bc4477-81eb-4c95-8ce3-f9bfcc58fd2d None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:02:06.264485 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-59bc4477-81eb-4c95-8ce3-f9bfcc58fd2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:02:06.272255 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1137/2258] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:02:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:02:06.273214 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bc4477-81eb-4c95-8ce3-f9bfcc58fd2d None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:02:06.274698 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-59bc4477-81eb-4c95-8ce3-f9bfcc58fd2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:02:06.330389 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bc4477-81eb-4c95-8ce3-f9bfcc58fd2d None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:02:06.334034 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abebc4e3-208e-4b28-b319-cbf669dbedf0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22b6a7c36f8a4795a75271b8079821c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:02:06.334629 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abebc4e3-208e-4b28-b319-cbf669dbedf0 service cinder] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:06.334906 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abebc4e3-208e-4b28-b319-cbf669dbedf0 service cinder] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:06.335178 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abebc4e3-208e-4b28-b319-cbf669dbedf0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:06.343911 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abebc4e3-208e-4b28-b319-cbf669dbedf0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:02:06.345376 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abebc4e3-208e-4b28-b319-cbf669dbedf0 service cinder] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:02:06.355535 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1138/2259] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:02:06 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:02:06.356405 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abebc4e3-208e-4b28-b319-cbf669dbedf0 service cinder] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:02:06.357840 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-abebc4e3-208e-4b28-b319-cbf669dbedf0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:02:06.413694 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abebc4e3-208e-4b28-b319-cbf669dbedf0 service cinder] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:02:06.417504 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e58679-14a8-4099-bae1-8fbb85265b97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a937971ad1a4b0c8697c764f214d446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:02:06.418104 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e58679-14a8-4099-bae1-8fbb85265b97 service neutron] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:06.418404 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e58679-14a8-4099-bae1-8fbb85265b97 service neutron] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:06.418679 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e58679-14a8-4099-bae1-8fbb85265b97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:06.427979 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e58679-14a8-4099-bae1-8fbb85265b97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:02:06.429536 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e58679-14a8-4099-bae1-8fbb85265b97 service neutron] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:02:06.438902 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1139/2260] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:02:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:02:06.441639 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-d58cfe0f-269f-475b-b222-ce3a1e6ee786 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d798acc659f494c9bcd44ac1568ac26'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:02:06.451007 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:02:06.453182 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-d58cfe0f-269f-475b-b222-ce3a1e6ee786 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d798acc659f494c9bcd44ac1568ac26'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:02:06.453738 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-d58cfe0f-269f-475b-b222-ce3a1e6ee786 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d798acc659f494c9bcd44ac1568ac26'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:02:06.454406 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-d58cfe0f-269f-475b-b222-ce3a1e6ee786 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d798acc659f494c9bcd44ac1568ac26'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:02:06.469322 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-d58cfe0f-269f-475b-b222-ce3a1e6ee786 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d798acc659f494c9bcd44ac1568ac26'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:02:06.536376 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:02:06.536940 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e58679-14a8-4099-bae1-8fbb85265b97 service neutron] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:02:06.538681 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-e0e58679-14a8-4099-bae1-8fbb85265b97 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:02:06.553782 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e58679-14a8-4099-bae1-8fbb85265b97 service neutron] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:02:06.558615 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94d3161-6a70-483a-aa9a-3edb572fc573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:02:06.559239 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94d3161-6a70-483a-aa9a-3edb572fc573 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:06.559518 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94d3161-6a70-483a-aa9a-3edb572fc573 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:06.559814 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94d3161-6a70-483a-aa9a-3edb572fc573 admin admin] PATH_INFO: `/v3/users/f49f57a8ef05424491dbdf989522f76b` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:06.561082 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94d3161-6a70-483a-aa9a-3edb572fc573 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f49f57a8ef05424491dbdf989522f76b)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:02:06.563000 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94d3161-6a70-483a-aa9a-3edb572fc573 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:02:06.567618 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1122/2261] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 18 22:02:06 2022] DELETE /identity/v3/users/6d798acc659f494c9bcd44ac1568ac26 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:02:06.573360 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a692d05-d338-4c48-96ef-809c9ee04792 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:06.573694 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a692d05-d338-4c48-96ef-809c9ee04792 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:06.573963 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a692d05-d338-4c48-96ef-809c9ee04792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:06.597504 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:02:06.597990 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-9a692d05-d338-4c48-96ef-809c9ee04792 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:02:06.599208 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-9a692d05-d338-4c48-96ef-809c9ee04792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:02:06.663633 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1123/2262] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:02:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 22:02:06.675807 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a692d05-d338-4c48-96ef-809c9ee04792 None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:02:06.677350 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-9a692d05-d338-4c48-96ef-809c9ee04792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:02:06.745601 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a692d05-d338-4c48-96ef-809c9ee04792 None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:02:06.749649 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717931cd-c0d9-4f04-9e53-e1b76e9eb789 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a937971ad1a4b0c8697c764f214d446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:02:06.750255 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717931cd-c0d9-4f04-9e53-e1b76e9eb789 service neutron] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:06.750549 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717931cd-c0d9-4f04-9e53-e1b76e9eb789 service neutron] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:06.751237 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717931cd-c0d9-4f04-9e53-e1b76e9eb789 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:06.762543 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717931cd-c0d9-4f04-9e53-e1b76e9eb789 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:02:06.764075 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717931cd-c0d9-4f04-9e53-e1b76e9eb789 service neutron] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:02:06.777057 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1124/2263] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:02:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 22:02:06.803008 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:02:06.810490 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-b94d3161-6a70-483a-aa9a-3edb572fc573 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f49f57a8ef05424491dbdf989522f76b'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:02:06.819411 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-b94d3161-6a70-483a-aa9a-3edb572fc573 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f49f57a8ef05424491dbdf989522f76b'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:02:06.820380 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-b94d3161-6a70-483a-aa9a-3edb572fc573 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f49f57a8ef05424491dbdf989522f76b'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:02:06.834019 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-b94d3161-6a70-483a-aa9a-3edb572fc573 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f49f57a8ef05424491dbdf989522f76b'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:02:06.850458 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:02:06.929353 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717931cd-c0d9-4f04-9e53-e1b76e9eb789 service neutron] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:02:06.930763 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-717931cd-c0d9-4f04-9e53-e1b76e9eb789 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:02:06.943425 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717931cd-c0d9-4f04-9e53-e1b76e9eb789 service neutron] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:02:06.948117 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7c766b-3253-4388-93a0-690517ce9240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:02:06.948783 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7c766b-3253-4388-93a0-690517ce9240 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:06.949067 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7c766b-3253-4388-93a0-690517ce9240 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:06.949347 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7c766b-3253-4388-93a0-690517ce9240 admin admin] PATH_INFO: `/v3/users/adaebda3f3b94cfe8c94216f9d225415` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:06.950466 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7c766b-3253-4388-93a0-690517ce9240 admin admin] RBAC: Authorizing `identity:delete_user(user_id=adaebda3f3b94cfe8c94216f9d225415)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:02:06.952424 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7c766b-3253-4388-93a0-690517ce9240 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:02:06.967947 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-b94d3161-6a70-483a-aa9a-3edb572fc573 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f49f57a8ef05424491dbdf989522f76b'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:02:06.974922 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1140/2264] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 18 22:02:06 2022] DELETE /identity/v3/users/f49f57a8ef05424491dbdf989522f76b => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 22:02:06.979187 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcc84c7-8ff8-4f3f-bcfb-3f9774689cbe None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:06.979470 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcc84c7-8ff8-4f3f-bcfb-3f9774689cbe None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:06.979744 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcc84c7-8ff8-4f3f-bcfb-3f9774689cbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:06.998344 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-bdcc84c7-8ff8-4f3f-bcfb-3f9774689cbe None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:02:06.999600 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-bdcc84c7-8ff8-4f3f-bcfb-3f9774689cbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:02:07.064199 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1141/2265] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:02:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 22:02:07.067607 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcc84c7-8ff8-4f3f-bcfb-3f9774689cbe None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:02:07.067607 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-bdcc84c7-8ff8-4f3f-bcfb-3f9774689cbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:02:07.078973 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcc84c7-8ff8-4f3f-bcfb-3f9774689cbe None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:02:07.089608 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90aad0d9-641a-49f7-aa27-7d5171ebc7ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:02:07.090092 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aad0d9-641a-49f7-aa27-7d5171ebc7ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:07.090344 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aad0d9-641a-49f7-aa27-7d5171ebc7ee admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:07.090766 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aad0d9-641a-49f7-aa27-7d5171ebc7ee admin admin] PATH_INFO: `/v3/projects/5ebc14f7586a439590222f2f2be59085` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:07.091968 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90aad0d9-641a-49f7-aa27-7d5171ebc7ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ebc14f7586a439590222f2f2be59085)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:02:07.093936 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90aad0d9-641a-49f7-aa27-7d5171ebc7ee admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:02:07.164926 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-9f7c766b-3253-4388-93a0-690517ce9240 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'adaebda3f3b94cfe8c94216f9d225415'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:02:07.171868 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-9f7c766b-3253-4388-93a0-690517ce9240 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'adaebda3f3b94cfe8c94216f9d225415'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:02:07.172549 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-9f7c766b-3253-4388-93a0-690517ce9240 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'adaebda3f3b94cfe8c94216f9d225415'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:02:07.173195 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-9f7c766b-3253-4388-93a0-690517ce9240 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'adaebda3f3b94cfe8c94216f9d225415'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:02:07.186261 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-9f7c766b-3253-4388-93a0-690517ce9240 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'adaebda3f3b94cfe8c94216f9d225415'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:02:07.203536 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-90aad0d9-641a-49f7-aa27-7d5171ebc7ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ebc14f7586a439590222f2f2be59085', 'request_id': 'req-90aad0d9-641a-49f7-aa27-7d5171ebc7ee'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:02:07.209883 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-90aad0d9-641a-49f7-aa27-7d5171ebc7ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ebc14f7586a439590222f2f2be59085', 'request_id': 'req-90aad0d9-641a-49f7-aa27-7d5171ebc7ee'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:02:07.306303 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1125/2266] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 18 22:02:06 2022] DELETE /identity/v3/users/adaebda3f3b94cfe8c94216f9d225415 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 22:02:07.306303 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7c766b-3253-4388-93a0-690517ce9240 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:02:07.306303 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-9f7c766b-3253-4388-93a0-690517ce9240 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:02:07.372045 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7c766b-3253-4388-93a0-690517ce9240 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:02:07.375875 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182a9a63-b01b-4f1d-beca-051deb727cb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a937971ad1a4b0c8697c764f214d446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:02:07.376484 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182a9a63-b01b-4f1d-beca-051deb727cb5 service neutron] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:07.377513 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182a9a63-b01b-4f1d-beca-051deb727cb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:07.377802 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182a9a63-b01b-4f1d-beca-051deb727cb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:07.379134 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-90aad0d9-641a-49f7-aa27-7d5171ebc7ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ebc14f7586a439590222f2f2be59085', 'request_id': 'req-90aad0d9-641a-49f7-aa27-7d5171ebc7ee'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:02:07.379679 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-182a9a63-b01b-4f1d-beca-051deb727cb5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:02:07.390670 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-90aad0d9-641a-49f7-aa27-7d5171ebc7ee admin admin] The token cache is being invalidate because project 5ebc14f7586a439590222f2f2be59085 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88097) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 22:02:07.390981 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-90aad0d9-641a-49f7-aa27-7d5171ebc7ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:02:07.391706 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-90aad0d9-641a-49f7-aa27-7d5171ebc7ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:02:07.393471 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1142/2267] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 18 22:02:07 2022] DELETE /identity/v3/projects/5ebc14f7586a439590222f2f2be59085 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:02:07.394772 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb21775-a4d6-4412-adef-081e40f7811a None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:07.395108 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb21775-a4d6-4412-adef-081e40f7811a None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:07.395382 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb21775-a4d6-4412-adef-081e40f7811a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:07.414489 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-eeb21775-a4d6-4412-adef-081e40f7811a None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:02:07.417723 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-eeb21775-a4d6-4412-adef-081e40f7811a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:02:07.449029 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:02:07.449465 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182a9a63-b01b-4f1d-beca-051deb727cb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:02:07.451050 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182a9a63-b01b-4f1d-beca-051deb727cb5 service neutron] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:02:07.461432 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1126/2268] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:02:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:02:07.462697 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182a9a63-b01b-4f1d-beca-051deb727cb5 service neutron] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:02:07.464216 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-182a9a63-b01b-4f1d-beca-051deb727cb5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:02:07.480007 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1143/2269] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:02:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:02:07.480837 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182a9a63-b01b-4f1d-beca-051deb727cb5 service neutron] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:02:07.481283 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c507079-b43f-42b9-a8e8-835a304f0631 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:07.481574 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c507079-b43f-42b9-a8e8-835a304f0631 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:07.481851 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c507079-b43f-42b9-a8e8-835a304f0631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:07.490375 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e13140-a761-4edb-82e5-a6590b0a695d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:02:07.491231 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e13140-a761-4edb-82e5-a6590b0a695d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:07.491791 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e13140-a761-4edb-82e5-a6590b0a695d admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:07.492165 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e13140-a761-4edb-82e5-a6590b0a695d admin admin] PATH_INFO: `/v3/projects/b341fa4471bc47df9e8ed648ee22241e` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:07.493678 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e13140-a761-4edb-82e5-a6590b0a695d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b341fa4471bc47df9e8ed648ee22241e)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:02:07.496451 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e13140-a761-4edb-82e5-a6590b0a695d admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:02:07.503772 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-5c507079-b43f-42b9-a8e8-835a304f0631 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:02:07.505045 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-5c507079-b43f-42b9-a8e8-835a304f0631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:02:07.515955 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1144/2270] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:02:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:02:07.517651 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c507079-b43f-42b9-a8e8-835a304f0631 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:02:07.518767 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-5c507079-b43f-42b9-a8e8-835a304f0631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:02:07.534303 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c507079-b43f-42b9-a8e8-835a304f0631 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:02:07.540161 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad85df0-8529-44b8-879a-13527a71dbc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a937971ad1a4b0c8697c764f214d446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:02:07.540802 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad85df0-8529-44b8-879a-13527a71dbc5 service neutron] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:07.541129 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad85df0-8529-44b8-879a-13527a71dbc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:07.541397 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad85df0-8529-44b8-879a-13527a71dbc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:07.552285 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad85df0-8529-44b8-879a-13527a71dbc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:02:07.553754 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad85df0-8529-44b8-879a-13527a71dbc5 service neutron] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:02:07.563676 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1145/2271] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:02:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:02:07.566144 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86fbe02-89d7-4c42-a36e-b535d77b5ba2 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:07.566482 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86fbe02-89d7-4c42-a36e-b535d77b5ba2 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:07.566757 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86fbe02-89d7-4c42-a36e-b535d77b5ba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:07.588574 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-c86fbe02-89d7-4c42-a36e-b535d77b5ba2 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:02:07.589857 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-c86fbe02-89d7-4c42-a36e-b535d77b5ba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:02:07.600804 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1146/2272] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:02:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:02:07.606479 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86fbe02-89d7-4c42-a36e-b535d77b5ba2 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:02:07.617859 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86fbe02-89d7-4c42-a36e-b535d77b5ba2 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:02:07.623491 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:02:07.631800 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-07e13140-a761-4edb-82e5-a6590b0a695d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b341fa4471bc47df9e8ed648ee22241e', 'request_id': 'req-07e13140-a761-4edb-82e5-a6590b0a695d'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:02:07.644433 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-07e13140-a761-4edb-82e5-a6590b0a695d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b341fa4471bc47df9e8ed648ee22241e', 'request_id': 'req-07e13140-a761-4edb-82e5-a6590b0a695d'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:02:07.686306 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716dcb60-0452-44e4-b434-acb0fc200394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:02:07.686952 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716dcb60-0452-44e4-b434-acb0fc200394 admin admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:07.687236 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716dcb60-0452-44e4-b434-acb0fc200394 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:07.687513 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716dcb60-0452-44e4-b434-acb0fc200394 admin admin] PATH_INFO: `/v3/domains` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:07.688304 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716dcb60-0452-44e4-b434-acb0fc200394 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 22:02:07.688648 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716dcb60-0452-44e4-b434-acb0fc200394 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:02:07.690518 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716dcb60-0452-44e4-b434-acb0fc200394 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:02:07.701800 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-07e13140-a761-4edb-82e5-a6590b0a695d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b341fa4471bc47df9e8ed648ee22241e', 'request_id': 'req-07e13140-a761-4edb-82e5-a6590b0a695d'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:02:07.704072 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1147/2273] 10.222.0.27 () {58 vars in 1153 bytes} [Thu Aug 18 22:02:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 22:02:07.712445 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716dcb60-0452-44e4-b434-acb0fc200394 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:02:07.715577 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-07e13140-a761-4edb-82e5-a6590b0a695d admin admin] The token cache is being invalidate because project b341fa4471bc47df9e8ed648ee22241e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88096) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 22:02:07.716291 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-07e13140-a761-4edb-82e5-a6590b0a695d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:02:07.716540 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-07e13140-a761-4edb-82e5-a6590b0a695d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:02:07.718302 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1127/2274] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 18 22:02:07 2022] DELETE /identity/v3/projects/b341fa4471bc47df9e8ed648ee22241e => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:02:07.721240 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716dcb60-0452-44e4-b434-acb0fc200394 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:02:07.727500 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0678fb-16f4-4715-9801-6a2651710167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:02:07.729680 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0678fb-16f4-4715-9801-6a2651710167 admin admin] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:07.729680 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0678fb-16f4-4715-9801-6a2651710167 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:07.729680 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0678fb-16f4-4715-9801-6a2651710167 admin admin] PATH_INFO: `/v3/projects` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:07.730703 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0678fb-16f4-4715-9801-6a2651710167 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:02:07.732629 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0678fb-16f4-4715-9801-6a2651710167 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:02:07.735387 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e13140-a761-4edb-82e5-a6590b0a695d admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:02:07.737625 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-07e13140-a761-4edb-82e5-a6590b0a695d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:02:07.752313 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e13140-a761-4edb-82e5-a6590b0a695d admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:02:07.760885 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b3b6f0-0d0e-421d-8295-fd448ce4873e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:02:07.761534 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b3b6f0-0d0e-421d-8295-fd448ce4873e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:07.761813 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b3b6f0-0d0e-421d-8295-fd448ce4873e admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:07.762085 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b3b6f0-0d0e-421d-8295-fd448ce4873e admin admin] PATH_INFO: `/v3/users/631fc219ae3c4e0c950924918b7c4cc0` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:07.763427 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b3b6f0-0d0e-421d-8295-fd448ce4873e admin admin] RBAC: Authorizing `identity:delete_user(user_id=631fc219ae3c4e0c950924918b7c4cc0)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:02:07.765615 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b3b6f0-0d0e-421d-8295-fd448ce4873e admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:02:07.850330 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1148/2275] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 18 22:02:07 2022] POST /identity/v3/projects => generated 373 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 22:02:07.854337 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0678fb-16f4-4715-9801-6a2651710167 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:02:07.856299 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-2a0678fb-16f4-4715-9801-6a2651710167 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:02:07.936633 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0678fb-16f4-4715-9801-6a2651710167 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:02:07.947666 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686f6d40-6d87-4a0f-be66-c76fba3759d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:02:07.948280 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686f6d40-6d87-4a0f-be66-c76fba3759d9 admin admin] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:07.948555 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686f6d40-6d87-4a0f-be66-c76fba3759d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:07.948853 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686f6d40-6d87-4a0f-be66-c76fba3759d9 admin admin] PATH_INFO: `/v3/users` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:07.949664 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686f6d40-6d87-4a0f-be66-c76fba3759d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:02:07.951561 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686f6d40-6d87-4a0f-be66-c76fba3759d9 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:02:08.017016 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-f6b3b6f0-0d0e-421d-8295-fd448ce4873e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '631fc219ae3c4e0c950924918b7c4cc0'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:02:08.024552 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-f6b3b6f0-0d0e-421d-8295-fd448ce4873e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '631fc219ae3c4e0c950924918b7c4cc0'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:02:08.025256 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-f6b3b6f0-0d0e-421d-8295-fd448ce4873e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '631fc219ae3c4e0c950924918b7c4cc0'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:02:08.025939 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-f6b3b6f0-0d0e-421d-8295-fd448ce4873e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '631fc219ae3c4e0c950924918b7c4cc0'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:02:08.039610 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-f6b3b6f0-0d0e-421d-8295-fd448ce4873e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '631fc219ae3c4e0c950924918b7c4cc0'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:02:08.119728 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1149/2276] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 18 22:02:07 2022] POST /identity/v3/users => generated 287 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 22:02:08.119728 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686f6d40-6d87-4a0f-be66-c76fba3759d9 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:02:08.121962 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-686f6d40-6d87-4a0f-be66-c76fba3759d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:02:08.143705 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686f6d40-6d87-4a0f-be66-c76fba3759d9 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:02:08.154122 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1128/2277] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 18 22:02:07 2022] DELETE /identity/v3/users/631fc219ae3c4e0c950924918b7c4cc0 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:02:08.155342 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b3b6f0-0d0e-421d-8295-fd448ce4873e admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:02:08.162372 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-f6b3b6f0-0d0e-421d-8295-fd448ce4873e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:02:08.163138 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:02:08.167583 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05c1f22-9522-4d95-acf5-5c9d5ff53c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:02:08.168132 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05c1f22-9522-4d95-acf5-5c9d5ff53c37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:08.168636 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05c1f22-9522-4d95-acf5-5c9d5ff53c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:08.168937 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05c1f22-9522-4d95-acf5-5c9d5ff53c37 admin admin] PATH_INFO: `/v3/projects/f57babaff043435ca6c421705d4d2841` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:08.176318 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05c1f22-9522-4d95-acf5-5c9d5ff53c37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f57babaff043435ca6c421705d4d2841)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:02:08.181920 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05c1f22-9522-4d95-acf5-5c9d5ff53c37 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:02:08.242780 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b3b6f0-0d0e-421d-8295-fd448ce4873e admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:02:08.247581 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86880694-aba4-4022-984b-0f27de42f461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:02:08.248233 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86880694-aba4-4022-984b-0f27de42f461 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:08.248848 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86880694-aba4-4022-984b-0f27de42f461 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:08.249211 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86880694-aba4-4022-984b-0f27de42f461 admin admin] PATH_INFO: `/v3/projects/73756301b48846089d210ad68d4d79ae` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:08.250474 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86880694-aba4-4022-984b-0f27de42f461 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73756301b48846089d210ad68d4d79ae)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:02:08.253245 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86880694-aba4-4022-984b-0f27de42f461 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:02:08.328360 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-d05c1f22-9522-4d95-acf5-5c9d5ff53c37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f57babaff043435ca6c421705d4d2841', 'request_id': 'req-d05c1f22-9522-4d95-acf5-5c9d5ff53c37'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:02:08.334625 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-d05c1f22-9522-4d95-acf5-5c9d5ff53c37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f57babaff043435ca6c421705d4d2841', 'request_id': 'req-d05c1f22-9522-4d95-acf5-5c9d5ff53c37'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:02:08.446959 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-86880694-aba4-4022-984b-0f27de42f461 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73756301b48846089d210ad68d4d79ae', 'request_id': 'req-86880694-aba4-4022-984b-0f27de42f461'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:02:08.452888 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-86880694-aba4-4022-984b-0f27de42f461 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73756301b48846089d210ad68d4d79ae', 'request_id': 'req-86880694-aba4-4022-984b-0f27de42f461'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:02:08.458800 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-d05c1f22-9522-4d95-acf5-5c9d5ff53c37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f57babaff043435ca6c421705d4d2841', 'request_id': 'req-d05c1f22-9522-4d95-acf5-5c9d5ff53c37'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:02:08.477198 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-d05c1f22-9522-4d95-acf5-5c9d5ff53c37 admin admin] The token cache is being invalidate because project f57babaff043435ca6c421705d4d2841 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88097) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 22:02:08.477495 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-d05c1f22-9522-4d95-acf5-5c9d5ff53c37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:02:08.478189 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-d05c1f22-9522-4d95-acf5-5c9d5ff53c37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:02:08.483137 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1150/2278] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 18 22:02:08 2022] DELETE /identity/v3/projects/f57babaff043435ca6c421705d4d2841 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:02:08.483137 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05c1f22-9522-4d95-acf5-5c9d5ff53c37 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:02:08.483137 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-d05c1f22-9522-4d95-acf5-5c9d5ff53c37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:02:08.540240 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-86880694-aba4-4022-984b-0f27de42f461 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73756301b48846089d210ad68d4d79ae', 'request_id': 'req-86880694-aba4-4022-984b-0f27de42f461'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:02:08.565638 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-86880694-aba4-4022-984b-0f27de42f461 admin admin] The token cache is being invalidate because project 73756301b48846089d210ad68d4d79ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88096) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 22:02:08.565638 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-86880694-aba4-4022-984b-0f27de42f461 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:02:08.566811 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-86880694-aba4-4022-984b-0f27de42f461 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:02:08.569598 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1129/2279] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 18 22:02:08 2022] DELETE /identity/v3/projects/73756301b48846089d210ad68d4d79ae => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:02:08.570833 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86880694-aba4-4022-984b-0f27de42f461 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:02:08.574250 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-86880694-aba4-4022-984b-0f27de42f461 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:02:08.586515 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05c1f22-9522-4d95-acf5-5c9d5ff53c37 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:02:08.667572 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c71d48f-1bd0-4398-a0b6-14af25aae974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:02:08.668423 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c71d48f-1bd0-4398-a0b6-14af25aae974 admin admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:08.668749 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c71d48f-1bd0-4398-a0b6-14af25aae974 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:08.669088 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c71d48f-1bd0-4398-a0b6-14af25aae974 admin admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:08.669744 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c71d48f-1bd0-4398-a0b6-14af25aae974 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:02:08.671584 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c71d48f-1bd0-4398-a0b6-14af25aae974 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:02:08.684622 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1151/2280] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:02:08 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:02:08.692171 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c71d48f-1bd0-4398-a0b6-14af25aae974 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:02:08.692171 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-7c71d48f-1bd0-4398-a0b6-14af25aae974 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:02:08.693447 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86880694-aba4-4022-984b-0f27de42f461 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:02:08.699494 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc07a542-5651-4b33-af58-b2388fd15789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:02:08.700143 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc07a542-5651-4b33-af58-b2388fd15789 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:08.700463 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc07a542-5651-4b33-af58-b2388fd15789 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:08.700820 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc07a542-5651-4b33-af58-b2388fd15789 admin admin] PATH_INFO: `/v3/users/e831800ea67741378a2a95e2bbd9739a` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:08.702019 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc07a542-5651-4b33-af58-b2388fd15789 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e831800ea67741378a2a95e2bbd9739a)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:02:08.702426 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c71d48f-1bd0-4398-a0b6-14af25aae974 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:02:08.703999 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc07a542-5651-4b33-af58-b2388fd15789 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:02:08.708882 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1cfc4e-ba77-413c-bed2-905950a709b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:02:08.709710 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1cfc4e-ba77-413c-bed2-905950a709b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:08.710748 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1cfc4e-ba77-413c-bed2-905950a709b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:08.711037 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1cfc4e-ba77-413c-bed2-905950a709b3 admin admin] PATH_INFO: `/v3/users/98d6b4669de84a0b9d17b726d56514f1` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:08.712302 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1cfc4e-ba77-413c-bed2-905950a709b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98d6b4669de84a0b9d17b726d56514f1)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:02:08.714392 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1cfc4e-ba77-413c-bed2-905950a709b3 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:02:08.972743 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-cc07a542-5651-4b33-af58-b2388fd15789 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e831800ea67741378a2a95e2bbd9739a'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:02:08.979814 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-cc07a542-5651-4b33-af58-b2388fd15789 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e831800ea67741378a2a95e2bbd9739a'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:02:08.980494 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-cc07a542-5651-4b33-af58-b2388fd15789 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e831800ea67741378a2a95e2bbd9739a'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:02:08.981329 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-cc07a542-5651-4b33-af58-b2388fd15789 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e831800ea67741378a2a95e2bbd9739a'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:02:08.993384 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-cc07a542-5651-4b33-af58-b2388fd15789 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e831800ea67741378a2a95e2bbd9739a'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:02:09.062022 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-1d1cfc4e-ba77-413c-bed2-905950a709b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98d6b4669de84a0b9d17b726d56514f1'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:02:09.069500 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-1d1cfc4e-ba77-413c-bed2-905950a709b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98d6b4669de84a0b9d17b726d56514f1'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:02:09.070197 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-1d1cfc4e-ba77-413c-bed2-905950a709b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98d6b4669de84a0b9d17b726d56514f1'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:02:09.082767 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-1d1cfc4e-ba77-413c-bed2-905950a709b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98d6b4669de84a0b9d17b726d56514f1'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:02:09.085574 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1130/2281] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 18 22:02:08 2022] DELETE /identity/v3/users/e831800ea67741378a2a95e2bbd9739a => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:02:09.087088 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc07a542-5651-4b33-af58-b2388fd15789 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:02:09.088470 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-cc07a542-5651-4b33-af58-b2388fd15789 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:02:09.156460 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc07a542-5651-4b33-af58-b2388fd15789 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:02:09.163182 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:02:09.164328 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1a43ab-35dd-4a2f-bf4d-955baf53da92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:02:09.165078 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1a43ab-35dd-4a2f-bf4d-955baf53da92 admin admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:09.165365 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1a43ab-35dd-4a2f-bf4d-955baf53da92 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:09.165639 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1a43ab-35dd-4a2f-bf4d-955baf53da92 admin admin] PATH_INFO: `/v3/roles` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:09.166331 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1a43ab-35dd-4a2f-bf4d-955baf53da92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:02:09.167966 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1a43ab-35dd-4a2f-bf4d-955baf53da92 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:02:09.181856 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1131/2282] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:02:09 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:02:09.181856 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1a43ab-35dd-4a2f-bf4d-955baf53da92 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:02:09.181856 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-8c1a43ab-35dd-4a2f-bf4d-955baf53da92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:02:09.193865 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1a43ab-35dd-4a2f-bf4d-955baf53da92 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:02:09.198533 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831ced9a-71ea-41eb-859c-da5bc4b5929c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:02:09.200346 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831ced9a-71ea-41eb-859c-da5bc4b5929c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:09.200346 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831ced9a-71ea-41eb-859c-da5bc4b5929c admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:09.200346 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831ced9a-71ea-41eb-859c-da5bc4b5929c admin admin] PATH_INFO: `/v3/projects/547e2d7f2b934e0fb27021373370c7cd` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:09.200791 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831ced9a-71ea-41eb-859c-da5bc4b5929c admin admin] RBAC: Authorizing `identity:delete_project(project_id=547e2d7f2b934e0fb27021373370c7cd)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:02:09.202679 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831ced9a-71ea-41eb-859c-da5bc4b5929c admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:02:09.224582 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-1d1cfc4e-ba77-413c-bed2-905950a709b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98d6b4669de84a0b9d17b726d56514f1'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:02:09.231048 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1152/2283] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 18 22:02:08 2022] DELETE /identity/v3/users/98d6b4669de84a0b9d17b726d56514f1 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:02:09.231824 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1cfc4e-ba77-413c-bed2-905950a709b3 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:02:09.234990 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-1d1cfc4e-ba77-413c-bed2-905950a709b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:02:09.302545 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1cfc4e-ba77-413c-bed2-905950a709b3 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:02:09.307544 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afc7f45-c031-4eab-a091-0fac6d27bc40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:02:09.308258 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afc7f45-c031-4eab-a091-0fac6d27bc40 admin admin] REQUEST_METHOD: `PUT` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:09.308535 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afc7f45-c031-4eab-a091-0fac6d27bc40 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:09.308857 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afc7f45-c031-4eab-a091-0fac6d27bc40 admin admin] PATH_INFO: `/v3/projects/d89c087daf95425ab5fdbf183070352e/users/d5705cba22524ce3913e125d70d4559b/roles/de8f2438056f4af9879423f8a59e0e0b` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:09.326184 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afc7f45-c031-4eab-a091-0fac6d27bc40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d89c087daf95425ab5fdbf183070352e, user_id=d5705cba22524ce3913e125d70d4559b, role_id=de8f2438056f4af9879423f8a59e0e0b)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:02:09.328971 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afc7f45-c031-4eab-a091-0fac6d27bc40 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:02:09.405661 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1153/2284] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 18 22:02:09 2022] PUT /identity/v3/projects/d89c087daf95425ab5fdbf183070352e/users/d5705cba22524ce3913e125d70d4559b/roles/de8f2438056f4af9879423f8a59e0e0b => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:02:09.414803 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-831ced9a-71ea-41eb-859c-da5bc4b5929c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '547e2d7f2b934e0fb27021373370c7cd', 'request_id': 'req-831ced9a-71ea-41eb-859c-da5bc4b5929c'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:02:09.417827 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa492548-c14b-4acf-ace7-357aa2408567 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:09.418146 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa492548-c14b-4acf-ace7-357aa2408567 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:09.419287 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa492548-c14b-4acf-ace7-357aa2408567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:09.427739 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-831ced9a-71ea-41eb-859c-da5bc4b5929c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '547e2d7f2b934e0fb27021373370c7cd', 'request_id': 'req-831ced9a-71ea-41eb-859c-da5bc4b5929c'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:02:09.451074 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-fa492548-c14b-4acf-ace7-357aa2408567 None None] MFA Rules not processed for user `d5705cba22524ce3913e125d70d4559b`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:02:09.452296 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-fa492548-c14b-4acf-ace7-357aa2408567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:02:09.493964 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-831ced9a-71ea-41eb-859c-da5bc4b5929c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '547e2d7f2b934e0fb27021373370c7cd', 'request_id': 'req-831ced9a-71ea-41eb-859c-da5bc4b5929c'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:02:09.508799 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-831ced9a-71ea-41eb-859c-da5bc4b5929c admin admin] The token cache is being invalidate because project 547e2d7f2b934e0fb27021373370c7cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88096) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 22:02:09.509069 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-831ced9a-71ea-41eb-859c-da5bc4b5929c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:02:09.509767 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-831ced9a-71ea-41eb-859c-da5bc4b5929c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:02:09.511478 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1132/2285] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 18 22:02:09 2022] DELETE /identity/v3/projects/547e2d7f2b934e0fb27021373370c7cd => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:02:09.516089 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3fead3-5d01-42a3-a65c-2b68f6d649f9 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:09.516449 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3fead3-5d01-42a3-a65c-2b68f6d649f9 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:09.516810 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3fead3-5d01-42a3-a65c-2b68f6d649f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:09.525567 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1154/2286] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:02:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:02:09.550475 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-0e3fead3-5d01-42a3-a65c-2b68f6d649f9 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:02:09.550475 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-0e3fead3-5d01-42a3-a65c-2b68f6d649f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:02:09.552770 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa492548-c14b-4acf-ace7-357aa2408567 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:02:09.554435 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-fa492548-c14b-4acf-ace7-357aa2408567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:02:09.621813 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1133/2287] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:02:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 22:02:09.631972 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef336c44-c533-40da-bba8-de6466bb63e5 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:09.632723 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef336c44-c533-40da-bba8-de6466bb63e5 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:09.633029 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef336c44-c533-40da-bba8-de6466bb63e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:09.641422 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa492548-c14b-4acf-ace7-357aa2408567 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:02:09.646865 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e794fcb-b5b0-4ca6-8e4d-c1728b5f2ed9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22b6a7c36f8a4795a75271b8079821c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:02:09.646865 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e794fcb-b5b0-4ca6-8e4d-c1728b5f2ed9 service cinder] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:09.647572 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e794fcb-b5b0-4ca6-8e4d-c1728b5f2ed9 service cinder] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:09.647572 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e794fcb-b5b0-4ca6-8e4d-c1728b5f2ed9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:09.649500 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-1e794fcb-b5b0-4ca6-8e4d-c1728b5f2ed9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:02:09.661332 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e794fcb-b5b0-4ca6-8e4d-c1728b5f2ed9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:02:09.662789 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e794fcb-b5b0-4ca6-8e4d-c1728b5f2ed9 service cinder] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:02:09.664895 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-ef336c44-c533-40da-bba8-de6466bb63e5 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:02:09.667632 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-ef336c44-c533-40da-bba8-de6466bb63e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:02:09.673118 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1155/2288] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:02:09 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:02:09.677089 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1134/2289] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:02:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:02:09.681556 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e794fcb-b5b0-4ca6-8e4d-c1728b5f2ed9 service cinder] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:02:09.695896 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e794fcb-b5b0-4ca6-8e4d-c1728b5f2ed9 service cinder] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:02:09.701795 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5d0217-022e-4596-9873-5c37e0ca0788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:02:09.702393 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5d0217-022e-4596-9873-5c37e0ca0788 admin admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:09.703686 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5d0217-022e-4596-9873-5c37e0ca0788 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:09.703686 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5d0217-022e-4596-9873-5c37e0ca0788 admin admin] PATH_INFO: `/v3/domains` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:09.703686 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5d0217-022e-4596-9873-5c37e0ca0788 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 22:02:09.703941 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5d0217-022e-4596-9873-5c37e0ca0788 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:02:09.705799 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5d0217-022e-4596-9873-5c37e0ca0788 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:02:09.724345 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1156/2290] 10.222.0.27 () {58 vars in 1153 bytes} [Thu Aug 18 22:02:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 22:02:09.725797 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef336c44-c533-40da-bba8-de6466bb63e5 None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:02:09.737989 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef336c44-c533-40da-bba8-de6466bb63e5 None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:02:09.743013 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8b4bbf-4def-405d-9bb4-49051bf9ff7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:02:09.743847 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8b4bbf-4def-405d-9bb4-49051bf9ff7c admin admin] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:09.744123 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8b4bbf-4def-405d-9bb4-49051bf9ff7c admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:09.744556 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8b4bbf-4def-405d-9bb4-49051bf9ff7c admin admin] PATH_INFO: `/v3/projects` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:09.745530 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8b4bbf-4def-405d-9bb4-49051bf9ff7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:02:09.747844 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8b4bbf-4def-405d-9bb4-49051bf9ff7c admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:02:09.793896 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5d0217-022e-4596-9873-5c37e0ca0788 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:02:09.795730 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-fd5d0217-022e-4596-9873-5c37e0ca0788 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:02:09.810488 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5d0217-022e-4596-9873-5c37e0ca0788 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:02:09.833307 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0536512c-0a19-4020-9a6c-51be0e4047c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:02:09.833307 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0536512c-0a19-4020-9a6c-51be0e4047c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:09.833307 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0536512c-0a19-4020-9a6c-51be0e4047c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:09.833307 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0536512c-0a19-4020-9a6c-51be0e4047c2 admin admin] PATH_INFO: `/v3/users/d5705cba22524ce3913e125d70d4559b` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:09.837533 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0536512c-0a19-4020-9a6c-51be0e4047c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5705cba22524ce3913e125d70d4559b)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:02:09.837533 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0536512c-0a19-4020-9a6c-51be0e4047c2 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:02:09.901169 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1135/2291] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 18 22:02:09 2022] POST /identity/v3/projects => generated 373 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 22:02:09.902273 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8b4bbf-4def-405d-9bb4-49051bf9ff7c admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:02:09.903954 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-db8b4bbf-4def-405d-9bb4-49051bf9ff7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:02:09.922427 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:02:09.973809 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8b4bbf-4def-405d-9bb4-49051bf9ff7c admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:02:09.978901 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bbe92c-e795-4f24-9c59-5a1adfab42e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:02:09.979535 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bbe92c-e795-4f24-9c59-5a1adfab42e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:09.979830 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bbe92c-e795-4f24-9c59-5a1adfab42e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:09.980148 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bbe92c-e795-4f24-9c59-5a1adfab42e0 admin admin] PATH_INFO: `/v3/projects/4716f0a82eb4409394dfeb13466524b0` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:09.981327 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bbe92c-e795-4f24-9c59-5a1adfab42e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4716f0a82eb4409394dfeb13466524b0)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:02:09.983188 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bbe92c-e795-4f24-9c59-5a1adfab42e0 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:02:10.067767 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-0536512c-0a19-4020-9a6c-51be0e4047c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5705cba22524ce3913e125d70d4559b'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:02:10.076473 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-0536512c-0a19-4020-9a6c-51be0e4047c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5705cba22524ce3913e125d70d4559b'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:02:10.077297 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-0536512c-0a19-4020-9a6c-51be0e4047c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5705cba22524ce3913e125d70d4559b'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:02:10.090906 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-0536512c-0a19-4020-9a6c-51be0e4047c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5705cba22524ce3913e125d70d4559b'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:02:10.099528 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-10bbe92c-e795-4f24-9c59-5a1adfab42e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4716f0a82eb4409394dfeb13466524b0', 'request_id': 'req-10bbe92c-e795-4f24-9c59-5a1adfab42e0'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:02:10.105528 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-10bbe92c-e795-4f24-9c59-5a1adfab42e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4716f0a82eb4409394dfeb13466524b0', 'request_id': 'req-10bbe92c-e795-4f24-9c59-5a1adfab42e0'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:02:10.185472 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-0536512c-0a19-4020-9a6c-51be0e4047c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5705cba22524ce3913e125d70d4559b'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:02:10.192002 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1157/2292] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 18 22:02:09 2022] DELETE /identity/v3/users/d5705cba22524ce3913e125d70d4559b => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:02:10.199879 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0536512c-0a19-4020-9a6c-51be0e4047c2 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:02:10.199879 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-0536512c-0a19-4020-9a6c-51be0e4047c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:02:10.258388 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0536512c-0a19-4020-9a6c-51be0e4047c2 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:02:10.266262 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f524d49-4bb6-4cb1-898a-60f2ebbe3cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:02:10.266262 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f524d49-4bb6-4cb1-898a-60f2ebbe3cca admin admin] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:10.266262 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f524d49-4bb6-4cb1-898a-60f2ebbe3cca admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:10.266262 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f524d49-4bb6-4cb1-898a-60f2ebbe3cca admin admin] PATH_INFO: `/v3/users` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:10.266695 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-10bbe92c-e795-4f24-9c59-5a1adfab42e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4716f0a82eb4409394dfeb13466524b0', 'request_id': 'req-10bbe92c-e795-4f24-9c59-5a1adfab42e0'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:02:10.266798 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f524d49-4bb6-4cb1-898a-60f2ebbe3cca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:02:10.266798 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f524d49-4bb6-4cb1-898a-60f2ebbe3cca admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:02:10.278220 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-10bbe92c-e795-4f24-9c59-5a1adfab42e0 admin admin] The token cache is being invalidate because project 4716f0a82eb4409394dfeb13466524b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88096) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 22:02:10.278507 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-10bbe92c-e795-4f24-9c59-5a1adfab42e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:02:10.279250 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-10bbe92c-e795-4f24-9c59-5a1adfab42e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:02:10.280821 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1136/2293] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 18 22:02:09 2022] DELETE /identity/v3/projects/4716f0a82eb4409394dfeb13466524b0 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:02:10.281600 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bbe92c-e795-4f24-9c59-5a1adfab42e0 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:02:10.282868 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-10bbe92c-e795-4f24-9c59-5a1adfab42e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:02:10.348958 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bbe92c-e795-4f24-9c59-5a1adfab42e0 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:02:10.353797 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accc35b1-a378-4148-9201-b9b82d81f285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:02:10.354427 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accc35b1-a378-4148-9201-b9b82d81f285 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:10.354707 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accc35b1-a378-4148-9201-b9b82d81f285 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:10.354980 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accc35b1-a378-4148-9201-b9b82d81f285 admin admin] PATH_INFO: `/v3/projects/405cbf0079ed4d45a52cf5bc94f072fe` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:10.356266 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accc35b1-a378-4148-9201-b9b82d81f285 admin admin] RBAC: Authorizing `identity:delete_project(project_id=405cbf0079ed4d45a52cf5bc94f072fe)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:02:10.358237 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accc35b1-a378-4148-9201-b9b82d81f285 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:02:10.380452 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1158/2294] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 18 22:02:10 2022] POST /identity/v3/users => generated 287 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 22:02:10.382370 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004d045c-4567-4335-9431-4645a5cf7013 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:10.382370 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004d045c-4567-4335-9431-4645a5cf7013 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:10.382370 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004d045c-4567-4335-9431-4645a5cf7013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:10.401454 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-004d045c-4567-4335-9431-4645a5cf7013 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:02:10.402713 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-004d045c-4567-4335-9431-4645a5cf7013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:02:10.410913 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1159/2295] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:02:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:02:10.412079 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8031d7-5df7-469e-89b6-0a4daf6e924a None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:10.412366 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8031d7-5df7-469e-89b6-0a4daf6e924a None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:10.412667 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8031d7-5df7-469e-89b6-0a4daf6e924a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:10.432821 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-2c8031d7-5df7-469e-89b6-0a4daf6e924a None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:02:10.434033 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-2c8031d7-5df7-469e-89b6-0a4daf6e924a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:02:10.442892 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1160/2296] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:02:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:02:10.443730 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8031d7-5df7-469e-89b6-0a4daf6e924a None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:02:10.445092 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-2c8031d7-5df7-469e-89b6-0a4daf6e924a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:02:10.457163 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8031d7-5df7-469e-89b6-0a4daf6e924a None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:02:10.463256 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd2a3dc-3bb5-4a4a-b452-76deb657a5e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:02:10.463869 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd2a3dc-3bb5-4a4a-b452-76deb657a5e5 admin admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:10.464140 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd2a3dc-3bb5-4a4a-b452-76deb657a5e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:10.464412 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd2a3dc-3bb5-4a4a-b452-76deb657a5e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:10.465106 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd2a3dc-3bb5-4a4a-b452-76deb657a5e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:02:10.466702 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd2a3dc-3bb5-4a4a-b452-76deb657a5e5 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:02:10.477652 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-accc35b1-a378-4148-9201-b9b82d81f285 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '405cbf0079ed4d45a52cf5bc94f072fe', 'request_id': 'req-accc35b1-a378-4148-9201-b9b82d81f285'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:02:10.477809 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1161/2297] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:02:10 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:02:10.478470 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd2a3dc-3bb5-4a4a-b452-76deb657a5e5 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:02:10.480984 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-fbd2a3dc-3bb5-4a4a-b452-76deb657a5e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:02:10.483991 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-accc35b1-a378-4148-9201-b9b82d81f285 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '405cbf0079ed4d45a52cf5bc94f072fe', 'request_id': 'req-accc35b1-a378-4148-9201-b9b82d81f285'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:02:10.539206 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd2a3dc-3bb5-4a4a-b452-76deb657a5e5 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:02:10.573504 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-accc35b1-a378-4148-9201-b9b82d81f285 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '405cbf0079ed4d45a52cf5bc94f072fe', 'request_id': 'req-accc35b1-a378-4148-9201-b9b82d81f285'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:02:10.586039 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-accc35b1-a378-4148-9201-b9b82d81f285 admin admin] The token cache is being invalidate because project 405cbf0079ed4d45a52cf5bc94f072fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88096) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 22:02:10.586378 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-accc35b1-a378-4148-9201-b9b82d81f285 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:02:10.587058 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-accc35b1-a378-4148-9201-b9b82d81f285 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:02:10.588941 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1137/2298] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 18 22:02:10 2022] DELETE /identity/v3/projects/405cbf0079ed4d45a52cf5bc94f072fe => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:02:10.590008 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bdde16-1aab-45e3-a154-c3d21f6ff759 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:10.590291 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bdde16-1aab-45e3-a154-c3d21f6ff759 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:10.590725 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bdde16-1aab-45e3-a154-c3d21f6ff759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:10.592569 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2448fb1c-4a48-4a07-9fa1-28a47440bc2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a937971ad1a4b0c8697c764f214d446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:02:10.593239 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2448fb1c-4a48-4a07-9fa1-28a47440bc2a service neutron] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:10.593526 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2448fb1c-4a48-4a07-9fa1-28a47440bc2a service neutron] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:10.593806 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2448fb1c-4a48-4a07-9fa1-28a47440bc2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:10.596199 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-2448fb1c-4a48-4a07-9fa1-28a47440bc2a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:02:10.616674 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-b8bdde16-1aab-45e3-a154-c3d21f6ff759 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:02:10.617904 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-b8bdde16-1aab-45e3-a154-c3d21f6ff759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:02:10.672390 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2448fb1c-4a48-4a07-9fa1-28a47440bc2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:02:10.675023 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2448fb1c-4a48-4a07-9fa1-28a47440bc2a service neutron] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:02:10.685734 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1162/2299] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:02:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:02:10.686469 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2448fb1c-4a48-4a07-9fa1-28a47440bc2a service neutron] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:02:10.687754 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-2448fb1c-4a48-4a07-9fa1-28a47440bc2a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:02:10.692514 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1138/2300] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:02:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:02:10.693247 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183765b9-8bbb-4b69-bfc0-a457ff6f2c5d None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:10.693542 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183765b9-8bbb-4b69-bfc0-a457ff6f2c5d None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:10.693979 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183765b9-8bbb-4b69-bfc0-a457ff6f2c5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:10.703821 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2448fb1c-4a48-4a07-9fa1-28a47440bc2a service neutron] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:02:10.716651 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-183765b9-8bbb-4b69-bfc0-a457ff6f2c5d None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:02:10.718150 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-183765b9-8bbb-4b69-bfc0-a457ff6f2c5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:02:10.720200 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9092e5aa-dee0-4c43-bdf6-7ec27b7dc645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:02:10.721937 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9092e5aa-dee0-4c43-bdf6-7ec27b7dc645 admin admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:10.722632 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9092e5aa-dee0-4c43-bdf6-7ec27b7dc645 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:10.723169 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9092e5aa-dee0-4c43-bdf6-7ec27b7dc645 admin admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:10.724070 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9092e5aa-dee0-4c43-bdf6-7ec27b7dc645 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:02:10.728806 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9092e5aa-dee0-4c43-bdf6-7ec27b7dc645 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:02:10.728916 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1139/2301] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:02:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:02:10.728916 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183765b9-8bbb-4b69-bfc0-a457ff6f2c5d None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:02:10.739332 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183765b9-8bbb-4b69-bfc0-a457ff6f2c5d None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:02:10.744051 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbca7969-b2f3-471f-9c7f-5446986fd485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:02:10.744684 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbca7969-b2f3-471f-9c7f-5446986fd485 admin admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:10.744964 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbca7969-b2f3-471f-9c7f-5446986fd485 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:10.745233 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbca7969-b2f3-471f-9c7f-5446986fd485 admin admin] PATH_INFO: `/v3/domains` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:10.745882 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbca7969-b2f3-471f-9c7f-5446986fd485 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 22:02:10.746183 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbca7969-b2f3-471f-9c7f-5446986fd485 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:02:10.747379 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1163/2302] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:02:10 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:02:10.747785 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbca7969-b2f3-471f-9c7f-5446986fd485 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:02:10.749311 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a1155d-1acc-4ba1-b33c-2b7c42c33c60 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:10.749662 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a1155d-1acc-4ba1-b33c-2b7c42c33c60 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:10.752741 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a1155d-1acc-4ba1-b33c-2b7c42c33c60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:10.762230 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:02:10.770440 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1140/2303] 10.222.0.27 () {58 vars in 1153 bytes} [Thu Aug 18 22:02:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 22:02:10.793605 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-96a1155d-1acc-4ba1-b33c-2b7c42c33c60 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:02:10.793605 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-96a1155d-1acc-4ba1-b33c-2b7c42c33c60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:02:10.793814 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbca7969-b2f3-471f-9c7f-5446986fd485 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:02:10.793914 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1164/2304] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:02:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:02:10.793914 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a1155d-1acc-4ba1-b33c-2b7c42c33c60 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:02:10.794058 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbca7969-b2f3-471f-9c7f-5446986fd485 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:02:10.795563 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0548a35b-74ca-4dbe-b5be-5a4a28760325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:02:10.796306 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0548a35b-74ca-4dbe-b5be-5a4a28760325 admin admin] REQUEST_METHOD: `PUT` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:10.796917 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0548a35b-74ca-4dbe-b5be-5a4a28760325 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:10.797259 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0548a35b-74ca-4dbe-b5be-5a4a28760325 admin admin] PATH_INFO: `/v3/projects/d389c76aaee94d8188d77094680b574e/users/30e1af0c95eb483ebf302cfdecfbc1a1/roles/de8f2438056f4af9879423f8a59e0e0b` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:10.799886 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a1155d-1acc-4ba1-b33c-2b7c42c33c60 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:02:10.806038 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f0530a-d4b7-4e25-8080-c9a16c366ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:02:10.806949 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f0530a-d4b7-4e25-8080-c9a16c366ed4 admin admin] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:10.807224 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f0530a-d4b7-4e25-8080-c9a16c366ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:10.807493 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f0530a-d4b7-4e25-8080-c9a16c366ed4 admin admin] PATH_INFO: `/v3/projects` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:10.808127 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f0530a-d4b7-4e25-8080-c9a16c366ed4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:02:10.810118 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f0530a-d4b7-4e25-8080-c9a16c366ed4 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:02:10.821192 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0548a35b-74ca-4dbe-b5be-5a4a28760325 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d389c76aaee94d8188d77094680b574e, user_id=30e1af0c95eb483ebf302cfdecfbc1a1, role_id=de8f2438056f4af9879423f8a59e0e0b)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:02:10.823925 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0548a35b-74ca-4dbe-b5be-5a4a28760325 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:02:10.911379 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1165/2305] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 18 22:02:10 2022] POST /identity/v3/projects => generated 391 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 22:02:10.911379 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f0530a-d4b7-4e25-8080-c9a16c366ed4 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:02:10.912086 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1141/2306] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 18 22:02:10 2022] PUT /identity/v3/projects/d389c76aaee94d8188d77094680b574e/users/30e1af0c95eb483ebf302cfdecfbc1a1/roles/de8f2438056f4af9879423f8a59e0e0b => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:02:10.923216 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0548a35b-74ca-4dbe-b5be-5a4a28760325 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:02:11.009025 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f0530a-d4b7-4e25-8080-c9a16c366ed4 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:02:11.013976 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7914a6b-cad6-42c1-8179-76a0873702d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:02:11.014686 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7914a6b-cad6-42c1-8179-76a0873702d1 admin admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:11.014966 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7914a6b-cad6-42c1-8179-76a0873702d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:11.015237 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7914a6b-cad6-42c1-8179-76a0873702d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:11.015885 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7914a6b-cad6-42c1-8179-76a0873702d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 22:02:11.016183 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7914a6b-cad6-42c1-8179-76a0873702d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:02:11.018393 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7914a6b-cad6-42c1-8179-76a0873702d1 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:02:11.030918 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0548a35b-74ca-4dbe-b5be-5a4a28760325 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:02:11.038139 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1166/2307] 10.222.0.27 () {58 vars in 1153 bytes} [Thu Aug 18 22:02:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 22:02:11.039543 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4343c458-1255-4154-bf06-e6c268061990 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:11.039830 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4343c458-1255-4154-bf06-e6c268061990 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:11.041575 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4343c458-1255-4154-bf06-e6c268061990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:11.049937 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b361a654-48db-41ff-919d-0bf9f77d6b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:02:11.052926 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b361a654-48db-41ff-919d-0bf9f77d6b50 admin admin] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:11.053213 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b361a654-48db-41ff-919d-0bf9f77d6b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:11.054608 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b361a654-48db-41ff-919d-0bf9f77d6b50 admin admin] PATH_INFO: `/v3/users` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:11.055300 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b361a654-48db-41ff-919d-0bf9f77d6b50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:02:11.058897 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b361a654-48db-41ff-919d-0bf9f77d6b50 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:02:11.083594 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-4343c458-1255-4154-bf06-e6c268061990 None None] MFA Rules not processed for user `30e1af0c95eb483ebf302cfdecfbc1a1`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:02:11.085614 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-4343c458-1255-4154-bf06-e6c268061990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:02:11.177490 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1167/2308] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:02:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:02:11.181267 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1142/2309] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 18 22:02:10 2022] POST /identity/v3/users => generated 296 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 22:02:11.181267 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b361a654-48db-41ff-919d-0bf9f77d6b50 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:02:11.181267 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-b361a654-48db-41ff-919d-0bf9f77d6b50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:02:11.188191 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4343c458-1255-4154-bf06-e6c268061990 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:02:11.199584 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b361a654-48db-41ff-919d-0bf9f77d6b50 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:02:11.202588 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4343c458-1255-4154-bf06-e6c268061990 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:02:11.204466 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0adae5b-e4e9-4c0e-a46e-79f407b669bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:02:11.205164 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0adae5b-e4e9-4c0e-a46e-79f407b669bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:11.205624 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0adae5b-e4e9-4c0e-a46e-79f407b669bc admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:11.206077 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0adae5b-e4e9-4c0e-a46e-79f407b669bc admin admin] PATH_INFO: `/v3/projects/d89c087daf95425ab5fdbf183070352e` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:11.207305 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0adae5b-e4e9-4c0e-a46e-79f407b669bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=d89c087daf95425ab5fdbf183070352e)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:02:11.208711 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ed5002-dad2-4ba4-829e-d216b2de16c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:02:11.209324 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ed5002-dad2-4ba4-829e-d216b2de16c1 admin admin] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:11.209563 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0adae5b-e4e9-4c0e-a46e-79f407b669bc admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:02:11.209738 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ed5002-dad2-4ba4-829e-d216b2de16c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:11.209907 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ed5002-dad2-4ba4-829e-d216b2de16c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:11.210486 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ed5002-dad2-4ba4-829e-d216b2de16c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:02:11.212389 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ed5002-dad2-4ba4-829e-d216b2de16c1 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:02:11.326392 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1168/2310] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 18 22:02:11 2022] POST /identity/v3/projects => generated 381 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 22:02:11.327461 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ed5002-dad2-4ba4-829e-d216b2de16c1 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:02:11.348911 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-f0adae5b-e4e9-4c0e-a46e-79f407b669bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd89c087daf95425ab5fdbf183070352e', 'request_id': 'req-f0adae5b-e4e9-4c0e-a46e-79f407b669bc'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:02:11.355489 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-f0adae5b-e4e9-4c0e-a46e-79f407b669bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd89c087daf95425ab5fdbf183070352e', 'request_id': 'req-f0adae5b-e4e9-4c0e-a46e-79f407b669bc'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:02:11.398807 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ed5002-dad2-4ba4-829e-d216b2de16c1 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:02:11.406823 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da509063-4b59-4f9f-9b19-f00970db0d76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:02:11.407444 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da509063-4b59-4f9f-9b19-f00970db0d76 admin admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:11.407731 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da509063-4b59-4f9f-9b19-f00970db0d76 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:11.408010 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da509063-4b59-4f9f-9b19-f00970db0d76 admin admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:11.409555 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da509063-4b59-4f9f-9b19-f00970db0d76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:02:11.411206 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da509063-4b59-4f9f-9b19-f00970db0d76 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:02:11.421715 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1169/2311] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:02:11 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:02:11.423262 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da509063-4b59-4f9f-9b19-f00970db0d76 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:02:11.425325 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-da509063-4b59-4f9f-9b19-f00970db0d76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:02:11.442429 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-f0adae5b-e4e9-4c0e-a46e-79f407b669bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd89c087daf95425ab5fdbf183070352e', 'request_id': 'req-f0adae5b-e4e9-4c0e-a46e-79f407b669bc'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:02:11.452072 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:02:11.462985 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-f0adae5b-e4e9-4c0e-a46e-79f407b669bc admin admin] The token cache is being invalidate because project d89c087daf95425ab5fdbf183070352e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88096) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 22:02:11.463279 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-f0adae5b-e4e9-4c0e-a46e-79f407b669bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:02:11.463978 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-f0adae5b-e4e9-4c0e-a46e-79f407b669bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:02:11.465648 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1143/2312] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 18 22:02:11 2022] DELETE /identity/v3/projects/d89c087daf95425ab5fdbf183070352e => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:02:11.474475 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0adae5b-e4e9-4c0e-a46e-79f407b669bc admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:02:11.489700 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-f0adae5b-e4e9-4c0e-a46e-79f407b669bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:02:11.504726 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da509063-4b59-4f9f-9b19-f00970db0d76 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:02:11.508987 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367318bb-568e-4984-8e0e-fb057a76a72d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22b6a7c36f8a4795a75271b8079821c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:02:11.509700 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367318bb-568e-4984-8e0e-fb057a76a72d service cinder] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:11.510041 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367318bb-568e-4984-8e0e-fb057a76a72d service cinder] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:11.510330 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367318bb-568e-4984-8e0e-fb057a76a72d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:11.512256 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-367318bb-568e-4984-8e0e-fb057a76a72d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:02:11.565280 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0adae5b-e4e9-4c0e-a46e-79f407b669bc admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:02:11.570822 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77089f9b-9ad4-4520-b200-ff7272a4750b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:02:11.571492 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77089f9b-9ad4-4520-b200-ff7272a4750b admin admin] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:11.571774 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77089f9b-9ad4-4520-b200-ff7272a4750b admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:11.572094 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77089f9b-9ad4-4520-b200-ff7272a4750b admin admin] PATH_INFO: `/v3/users` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:11.572869 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77089f9b-9ad4-4520-b200-ff7272a4750b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:02:11.574798 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77089f9b-9ad4-4520-b200-ff7272a4750b admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:02:11.582399 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367318bb-568e-4984-8e0e-fb057a76a72d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:02:11.584179 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367318bb-568e-4984-8e0e-fb057a76a72d service cinder] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:02:11.594501 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1170/2313] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:02:11 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:02:11.595518 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367318bb-568e-4984-8e0e-fb057a76a72d service cinder] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:02:11.597184 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-367318bb-568e-4984-8e0e-fb057a76a72d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:02:11.612484 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367318bb-568e-4984-8e0e-fb057a76a72d service cinder] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:02:11.617866 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6253d2c-8ce5-4ca7-b419-106a59eeca10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:02:11.618483 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6253d2c-8ce5-4ca7-b419-106a59eeca10 admin admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:11.618761 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6253d2c-8ce5-4ca7-b419-106a59eeca10 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:11.619064 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6253d2c-8ce5-4ca7-b419-106a59eeca10 admin admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:11.619766 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6253d2c-8ce5-4ca7-b419-106a59eeca10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:02:11.623180 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6253d2c-8ce5-4ca7-b419-106a59eeca10 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:02:11.640149 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1171/2314] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:02:11 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:02:11.641347 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6253d2c-8ce5-4ca7-b419-106a59eeca10 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:02:11.655231 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6253d2c-8ce5-4ca7-b419-106a59eeca10 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:02:11.660909 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1144/2315] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 18 22:02:11 2022] POST /identity/v3/users => generated 291 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 22:02:11.661885 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5e89e4-af10-42fb-ac93-db07da0d55a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:02:11.662018 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77089f9b-9ad4-4520-b200-ff7272a4750b admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:02:11.662694 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5e89e4-af10-42fb-ac93-db07da0d55a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:11.662970 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5e89e4-af10-42fb-ac93-db07da0d55a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:11.663253 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5e89e4-af10-42fb-ac93-db07da0d55a3 admin admin] PATH_INFO: `/v3/projects/a1ae2fd3993544be9fe54321f4e84f0e/users/129d21be644248a99ac1c8acf85a897b/roles/de8f2438056f4af9879423f8a59e0e0b` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:11.673057 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77089f9b-9ad4-4520-b200-ff7272a4750b admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:02:11.680124 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0a585b-1133-4999-902e-1ce9c2529956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:02:11.680832 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0a585b-1133-4999-902e-1ce9c2529956 admin admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:11.681115 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0a585b-1133-4999-902e-1ce9c2529956 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:11.681292 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5e89e4-af10-42fb-ac93-db07da0d55a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1ae2fd3993544be9fe54321f4e84f0e, user_id=129d21be644248a99ac1c8acf85a897b, role_id=de8f2438056f4af9879423f8a59e0e0b)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:02:11.681396 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0a585b-1133-4999-902e-1ce9c2529956 admin admin] PATH_INFO: `/v3/roles` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:11.682060 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0a585b-1133-4999-902e-1ce9c2529956 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:02:11.683670 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0a585b-1133-4999-902e-1ce9c2529956 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:02:11.683965 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5e89e4-af10-42fb-ac93-db07da0d55a3 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:02:11.694675 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1145/2316] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:02:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:02:11.698256 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0a585b-1133-4999-902e-1ce9c2529956 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:02:11.708836 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0a585b-1133-4999-902e-1ce9c2529956 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:02:11.713654 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b521ef71-e932-4a59-b25d-0e0fda3d12a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:02:11.714248 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b521ef71-e932-4a59-b25d-0e0fda3d12a0 admin admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:11.714526 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b521ef71-e932-4a59-b25d-0e0fda3d12a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:11.714802 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b521ef71-e932-4a59-b25d-0e0fda3d12a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:11.715434 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b521ef71-e932-4a59-b25d-0e0fda3d12a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:02:11.718188 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b521ef71-e932-4a59-b25d-0e0fda3d12a0 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:02:11.731128 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:02:11.732411 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1146/2317] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:02:11 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 22:02:11.733262 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b521ef71-e932-4a59-b25d-0e0fda3d12a0 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:02:11.743095 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b521ef71-e932-4a59-b25d-0e0fda3d12a0 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:02:11.747914 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10619470-8df9-4cfe-a463-e6dcc82ffaa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:02:11.748570 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10619470-8df9-4cfe-a463-e6dcc82ffaa6 admin admin] REQUEST_METHOD: `PUT` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:11.748927 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10619470-8df9-4cfe-a463-e6dcc82ffaa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:11.749202 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10619470-8df9-4cfe-a463-e6dcc82ffaa6 admin admin] PATH_INFO: `/v3/projects/5097a40f10e24ef1bd555ef0d802af11/users/8af33ff52d894cc0b8ea6aec00934e8e/roles/de8f2438056f4af9879423f8a59e0e0b` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:11.764947 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10619470-8df9-4cfe-a463-e6dcc82ffaa6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5097a40f10e24ef1bd555ef0d802af11, user_id=8af33ff52d894cc0b8ea6aec00934e8e, role_id=de8f2438056f4af9879423f8a59e0e0b)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:02:11.768714 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10619470-8df9-4cfe-a463-e6dcc82ffaa6 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:02:11.780441 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1172/2318] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 18 22:02:11 2022] PUT /identity/v3/projects/a1ae2fd3993544be9fe54321f4e84f0e/users/129d21be644248a99ac1c8acf85a897b/roles/de8f2438056f4af9879423f8a59e0e0b => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 22:02:11.791949 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec69c4a-bebc-4fe7-88d5-2916caf31475 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:11.792233 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec69c4a-bebc-4fe7-88d5-2916caf31475 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:11.792500 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec69c4a-bebc-4fe7-88d5-2916caf31475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:11.821123 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-eec69c4a-bebc-4fe7-88d5-2916caf31475 None None] MFA Rules not processed for user `129d21be644248a99ac1c8acf85a897b`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:02:11.822095 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-eec69c4a-bebc-4fe7-88d5-2916caf31475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:02:11.890196 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1173/2319] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:02:11 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 22:02:11.901480 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec69c4a-bebc-4fe7-88d5-2916caf31475 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:02:11.902887 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-eec69c4a-bebc-4fe7-88d5-2916caf31475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:02:11.903754 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1147/2320] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 18 22:02:11 2022] PUT /identity/v3/projects/5097a40f10e24ef1bd555ef0d802af11/users/8af33ff52d894cc0b8ea6aec00934e8e/roles/de8f2438056f4af9879423f8a59e0e0b => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:02:11.908580 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d9915c-f2c2-4dd3-8296-6c001abb87a5 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:11.909239 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d9915c-f2c2-4dd3-8296-6c001abb87a5 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:11.909652 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d9915c-f2c2-4dd3-8296-6c001abb87a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:11.932209 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-48d9915c-f2c2-4dd3-8296-6c001abb87a5 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:02:11.933586 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-48d9915c-f2c2-4dd3-8296-6c001abb87a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:02:11.968046 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec69c4a-bebc-4fe7-88d5-2916caf31475 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:02:11.995074 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1148/2321] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:02:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 22:02:12.005364 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d9915c-f2c2-4dd3-8296-6c001abb87a5 None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:02:12.006824 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-48d9915c-f2c2-4dd3-8296-6c001abb87a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:02:12.020222 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d526c5-edb9-4bae-8f09-8d3834bc11ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22b6a7c36f8a4795a75271b8079821c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:02:12.020974 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d526c5-edb9-4bae-8f09-8d3834bc11ad service cinder] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:12.021209 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d526c5-edb9-4bae-8f09-8d3834bc11ad service cinder] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:12.021484 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d526c5-edb9-4bae-8f09-8d3834bc11ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:12.069692 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d9915c-f2c2-4dd3-8296-6c001abb87a5 None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:02:12.074930 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345f5181-af9e-45d1-8783-e3aedfd0353e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a937971ad1a4b0c8697c764f214d446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:02:12.075910 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345f5181-af9e-45d1-8783-e3aedfd0353e service neutron] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:12.076427 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345f5181-af9e-45d1-8783-e3aedfd0353e service neutron] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:12.076960 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345f5181-af9e-45d1-8783-e3aedfd0353e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:12.083966 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d526c5-edb9-4bae-8f09-8d3834bc11ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:02:12.086750 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d526c5-edb9-4bae-8f09-8d3834bc11ad service cinder] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:02:12.087614 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345f5181-af9e-45d1-8783-e3aedfd0353e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:02:12.089092 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345f5181-af9e-45d1-8783-e3aedfd0353e service neutron] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:02:12.097319 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1174/2322] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:02:11 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:02:12.099922 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1149/2323] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:02:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 22:02:12.541751 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:02:12.925973 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:02:13.428971 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:02:13.517908 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213e7755-3651-4371-a4ce-838609dc21e9 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:13.518434 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213e7755-3651-4371-a4ce-838609dc21e9 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:13.518638 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213e7755-3651-4371-a4ce-838609dc21e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:13.555201 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-213e7755-3651-4371-a4ce-838609dc21e9 None None] MFA Rules not processed for user `8af33ff52d894cc0b8ea6aec00934e8e`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:02:13.556710 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-213e7755-3651-4371-a4ce-838609dc21e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:02:13.664103 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1175/2324] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:02:13 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:02:13.726624 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345f5181-af9e-45d1-8783-e3aedfd0353e service neutron] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:02:13.728044 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-345f5181-af9e-45d1-8783-e3aedfd0353e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:02:13.742459 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345f5181-af9e-45d1-8783-e3aedfd0353e service neutron] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:02:13.746839 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90724e15-75bd-44d9-b468-22ce4caf8d59 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22b6a7c36f8a4795a75271b8079821c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:02:13.747637 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90724e15-75bd-44d9-b468-22ce4caf8d59 service cinder] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:13.748014 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90724e15-75bd-44d9-b468-22ce4caf8d59 service cinder] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:13.748294 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90724e15-75bd-44d9-b468-22ce4caf8d59 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:13.758182 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90724e15-75bd-44d9-b468-22ce4caf8d59 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:02:13.759968 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90724e15-75bd-44d9-b468-22ce4caf8d59 service cinder] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:02:13.770243 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1150/2325] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:02:13 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 22:02:13.822133 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:02:14.322130 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:02:15.018525 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:02:15.198999 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:02:15.592091 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad71855e-f2fe-43a7-8a47-7d8e7616501a None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:15.592390 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad71855e-f2fe-43a7-8a47-7d8e7616501a None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:15.592690 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad71855e-f2fe-43a7-8a47-7d8e7616501a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:15.613579 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-ad71855e-f2fe-43a7-8a47-7d8e7616501a None None] MFA Rules not processed for user `8af33ff52d894cc0b8ea6aec00934e8e`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:02:15.614939 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-ad71855e-f2fe-43a7-8a47-7d8e7616501a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:02:15.624636 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:02:15.624636 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1176/2326] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:02:15 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:02:16.008347 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:02:16.256460 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:02:16.533821 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90724e15-75bd-44d9-b468-22ce4caf8d59 service cinder] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:02:16.535411 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-90724e15-75bd-44d9-b468-22ce4caf8d59 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:02:16.551166 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90724e15-75bd-44d9-b468-22ce4caf8d59 service cinder] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:02:16.587629 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63adfce9-738c-4da0-a917-2d90493e1d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:02:16.588282 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63adfce9-738c-4da0-a917-2d90493e1d60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:16.588567 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63adfce9-738c-4da0-a917-2d90493e1d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:16.593754 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63adfce9-738c-4da0-a917-2d90493e1d60 admin admin] PATH_INFO: `/v3/users/30e1af0c95eb483ebf302cfdecfbc1a1` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:16.595610 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63adfce9-738c-4da0-a917-2d90493e1d60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30e1af0c95eb483ebf302cfdecfbc1a1)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:02:16.597768 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63adfce9-738c-4da0-a917-2d90493e1d60 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:02:16.744396 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:02:16.838945 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-63adfce9-738c-4da0-a917-2d90493e1d60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30e1af0c95eb483ebf302cfdecfbc1a1'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:02:16.849252 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-63adfce9-738c-4da0-a917-2d90493e1d60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30e1af0c95eb483ebf302cfdecfbc1a1'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:02:16.850166 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-63adfce9-738c-4da0-a917-2d90493e1d60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30e1af0c95eb483ebf302cfdecfbc1a1'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:02:16.850796 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-63adfce9-738c-4da0-a917-2d90493e1d60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30e1af0c95eb483ebf302cfdecfbc1a1'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:02:16.867131 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-63adfce9-738c-4da0-a917-2d90493e1d60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30e1af0c95eb483ebf302cfdecfbc1a1'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:02:16.965124 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1151/2327] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 18 22:02:16 2022] DELETE /identity/v3/users/30e1af0c95eb483ebf302cfdecfbc1a1 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:02:16.970474 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7fede1-f2e1-4a69-bc02-48857fb08979 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:16.970829 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7fede1-f2e1-4a69-bc02-48857fb08979 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:16.971118 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7fede1-f2e1-4a69-bc02-48857fb08979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:16.995522 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-5f7fede1-f2e1-4a69-bc02-48857fb08979 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:02:16.996801 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-5f7fede1-f2e1-4a69-bc02-48857fb08979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:02:17.064154 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1177/2328] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:02:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 22:02:17.074209 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63adfce9-738c-4da0-a917-2d90493e1d60 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:02:17.075614 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-63adfce9-738c-4da0-a917-2d90493e1d60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:02:17.136169 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63adfce9-738c-4da0-a917-2d90493e1d60 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:02:17.139730 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90db2f29-d5f9-456b-b451-f39df8b62173 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a937971ad1a4b0c8697c764f214d446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:02:17.140343 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90db2f29-d5f9-456b-b451-f39df8b62173 service neutron] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:17.140654 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90db2f29-d5f9-456b-b451-f39df8b62173 service neutron] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:17.141239 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90db2f29-d5f9-456b-b451-f39df8b62173 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:17.153063 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90db2f29-d5f9-456b-b451-f39df8b62173 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:02:17.154658 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90db2f29-d5f9-456b-b451-f39df8b62173 service neutron] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:02:17.165069 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1152/2329] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:02:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:02:17.233722 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:02:17.740585 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:02:17.760190 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7fede1-f2e1-4a69-bc02-48857fb08979 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:02:17.762059 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-5f7fede1-f2e1-4a69-bc02-48857fb08979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:02:17.782502 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7fede1-f2e1-4a69-bc02-48857fb08979 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:02:17.794570 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c7b037-95e9-446b-a295-a61836ff1f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:02:17.800681 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c7b037-95e9-446b-a295-a61836ff1f96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:17.800681 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c7b037-95e9-446b-a295-a61836ff1f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:17.800681 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c7b037-95e9-446b-a295-a61836ff1f96 admin admin] PATH_INFO: `/v3/projects/d389c76aaee94d8188d77094680b574e` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:17.800681 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c7b037-95e9-446b-a295-a61836ff1f96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d389c76aaee94d8188d77094680b574e)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:02:17.800681 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c7b037-95e9-446b-a295-a61836ff1f96 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:02:17.919766 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-b8c7b037-95e9-446b-a295-a61836ff1f96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd389c76aaee94d8188d77094680b574e', 'request_id': 'req-b8c7b037-95e9-446b-a295-a61836ff1f96'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:02:17.925514 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-b8c7b037-95e9-446b-a295-a61836ff1f96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd389c76aaee94d8188d77094680b574e', 'request_id': 'req-b8c7b037-95e9-446b-a295-a61836ff1f96'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:02:18.005256 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-b8c7b037-95e9-446b-a295-a61836ff1f96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd389c76aaee94d8188d77094680b574e', 'request_id': 'req-b8c7b037-95e9-446b-a295-a61836ff1f96'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:02:18.018188 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-b8c7b037-95e9-446b-a295-a61836ff1f96 admin admin] The token cache is being invalidate because project d389c76aaee94d8188d77094680b574e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88097) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 22:02:18.018513 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-b8c7b037-95e9-446b-a295-a61836ff1f96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:02:18.019169 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-b8c7b037-95e9-446b-a295-a61836ff1f96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:02:18.021065 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1178/2330] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 18 22:02:17 2022] DELETE /identity/v3/projects/d389c76aaee94d8188d77094680b574e => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:02:18.026422 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2cb64c-f4dd-4b30-b192-b9bc1c12b715 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:18.026707 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2cb64c-f4dd-4b30-b192-b9bc1c12b715 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:18.026984 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2cb64c-f4dd-4b30-b192-b9bc1c12b715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:18.049030 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-af2cb64c-f4dd-4b30-b192-b9bc1c12b715 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:02:18.050274 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-af2cb64c-f4dd-4b30-b192-b9bc1c12b715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:02:18.126959 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1153/2331] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:02:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:02:18.136849 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aa7f48-5d50-436a-8a86-b3ba0a006d3f None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:18.137135 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aa7f48-5d50-436a-8a86-b3ba0a006d3f None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:18.137667 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aa7f48-5d50-436a-8a86-b3ba0a006d3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:18.160710 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-59aa7f48-5d50-436a-8a86-b3ba0a006d3f None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:02:18.163257 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-59aa7f48-5d50-436a-8a86-b3ba0a006d3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:02:18.165185 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:02:18.174213 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1179/2332] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:02:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:02:18.179350 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2cb64c-f4dd-4b30-b192-b9bc1c12b715 None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:02:18.189642 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2cb64c-f4dd-4b30-b192-b9bc1c12b715 None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:02:18.194858 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce54666-3d01-4486-b6ea-537d3389cffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:02:18.196290 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce54666-3d01-4486-b6ea-537d3389cffb admin admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:18.196579 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce54666-3d01-4486-b6ea-537d3389cffb admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:18.197666 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce54666-3d01-4486-b6ea-537d3389cffb admin admin] PATH_INFO: `/v3/domains` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:18.198481 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce54666-3d01-4486-b6ea-537d3389cffb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 22:02:18.198790 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce54666-3d01-4486-b6ea-537d3389cffb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:02:18.200409 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce54666-3d01-4486-b6ea-537d3389cffb admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:02:18.216073 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1154/2333] 10.222.0.27 () {58 vars in 1153 bytes} [Thu Aug 18 22:02:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 22:02:18.221485 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aa7f48-5d50-436a-8a86-b3ba0a006d3f None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:02:18.232934 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aa7f48-5d50-436a-8a86-b3ba0a006d3f None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:02:18.238023 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5842c818-8649-4c9a-8740-e3d170e66b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:02:18.238706 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5842c818-8649-4c9a-8740-e3d170e66b7c admin admin] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:18.239602 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5842c818-8649-4c9a-8740-e3d170e66b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:18.239992 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5842c818-8649-4c9a-8740-e3d170e66b7c admin admin] PATH_INFO: `/v3/projects` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:18.241214 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5842c818-8649-4c9a-8740-e3d170e66b7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:02:18.243259 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5842c818-8649-4c9a-8740-e3d170e66b7c admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:02:18.315721 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1180/2334] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 18 22:02:18 2022] POST /identity/v3/projects => generated 371 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 22:02:18.320052 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce54666-3d01-4486-b6ea-537d3389cffb admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:02:18.328077 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:02:18.333219 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce54666-3d01-4486-b6ea-537d3389cffb admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:02:18.398361 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6936477-0b76-4a85-b4ac-c2c788c534cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:02:18.399285 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6936477-0b76-4a85-b4ac-c2c788c534cc admin admin] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:18.399924 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6936477-0b76-4a85-b4ac-c2c788c534cc admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:18.400238 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6936477-0b76-4a85-b4ac-c2c788c534cc admin admin] PATH_INFO: `/v3/users` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:18.400955 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6936477-0b76-4a85-b4ac-c2c788c534cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:02:18.403316 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6936477-0b76-4a85-b4ac-c2c788c534cc admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:02:18.427885 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:02:18.511521 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1155/2335] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 18 22:02:18 2022] POST /identity/v3/users => generated 286 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 22:02:18.516291 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5842c818-8649-4c9a-8740-e3d170e66b7c admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:02:18.529237 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5842c818-8649-4c9a-8740-e3d170e66b7c admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:02:18.534105 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:02:18.536454 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e36f86-bae9-4eae-9091-8eba90058294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:02:18.537248 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e36f86-bae9-4eae-9091-8eba90058294 admin admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:18.537587 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e36f86-bae9-4eae-9091-8eba90058294 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:18.538074 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e36f86-bae9-4eae-9091-8eba90058294 admin admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:18.538737 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e36f86-bae9-4eae-9091-8eba90058294 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:02:18.540357 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e36f86-bae9-4eae-9091-8eba90058294 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:02:18.552137 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1181/2336] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:02:18 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:02:18.556232 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6936477-0b76-4a85-b4ac-c2c788c534cc admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:02:18.566867 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6936477-0b76-4a85-b4ac-c2c788c534cc admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:02:18.572260 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1707d6-8a2f-4880-9c45-8f911c616b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:02:18.572919 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1707d6-8a2f-4880-9c45-8f911c616b17 admin admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:18.573211 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1707d6-8a2f-4880-9c45-8f911c616b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:18.573485 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1707d6-8a2f-4880-9c45-8f911c616b17 admin admin] PATH_INFO: `/v3/roles` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:18.574135 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1707d6-8a2f-4880-9c45-8f911c616b17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:02:18.576109 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1707d6-8a2f-4880-9c45-8f911c616b17 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:02:18.590931 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1156/2337] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:02:18 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:02:18.594343 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e36f86-bae9-4eae-9091-8eba90058294 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:02:18.605753 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e36f86-bae9-4eae-9091-8eba90058294 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:02:18.614227 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211f85c3-2aca-4092-968a-9c14d176b7d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:02:18.615016 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211f85c3-2aca-4092-968a-9c14d176b7d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:18.615474 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211f85c3-2aca-4092-968a-9c14d176b7d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:18.615749 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211f85c3-2aca-4092-968a-9c14d176b7d9 admin admin] PATH_INFO: `/v3/projects/87be2dfcfe5b44fb88354cc811ae52a9/users/ae15ceb5c00f4b0d9b3fa0fe16c5a0b0/roles/de8f2438056f4af9879423f8a59e0e0b` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:18.632494 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211f85c3-2aca-4092-968a-9c14d176b7d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87be2dfcfe5b44fb88354cc811ae52a9, user_id=ae15ceb5c00f4b0d9b3fa0fe16c5a0b0, role_id=de8f2438056f4af9879423f8a59e0e0b)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:02:18.635441 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211f85c3-2aca-4092-968a-9c14d176b7d9 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:02:18.706070 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1182/2338] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 18 22:02:18 2022] PUT /identity/v3/projects/87be2dfcfe5b44fb88354cc811ae52a9/users/ae15ceb5c00f4b0d9b3fa0fe16c5a0b0/roles/de8f2438056f4af9879423f8a59e0e0b => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:02:18.712303 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe2a6d2-cead-4ea0-97d9-2ef146c2dbe4 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:18.712661 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe2a6d2-cead-4ea0-97d9-2ef146c2dbe4 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:18.712936 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe2a6d2-cead-4ea0-97d9-2ef146c2dbe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:18.733503 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-bfe2a6d2-cead-4ea0-97d9-2ef146c2dbe4 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:02:18.734728 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-bfe2a6d2-cead-4ea0-97d9-2ef146c2dbe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:02:18.795496 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1157/2339] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:02:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:02:18.806233 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211f85c3-2aca-4092-968a-9c14d176b7d9 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:02:18.808663 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-211f85c3-2aca-4092-968a-9c14d176b7d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:02:18.876452 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211f85c3-2aca-4092-968a-9c14d176b7d9 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:02:18.881051 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedcaaf4-8788-42e6-bbc4-c95350e421e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a937971ad1a4b0c8697c764f214d446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:02:18.881671 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedcaaf4-8788-42e6-bbc4-c95350e421e1 service neutron] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:18.882612 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedcaaf4-8788-42e6-bbc4-c95350e421e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:18.882612 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedcaaf4-8788-42e6-bbc4-c95350e421e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:18.891837 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedcaaf4-8788-42e6-bbc4-c95350e421e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:02:18.893463 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedcaaf4-8788-42e6-bbc4-c95350e421e1 service neutron] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:02:18.906256 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1183/2340] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:02:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:02:18.960293 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:02:19.026006 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:02:19.559814 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:02:19.714034 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:02:20.262883 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:02:20.382663 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:02:20.842213 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c2ccd2-d68e-47d0-a31e-f99d81a90d30 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:20.842819 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c2ccd2-d68e-47d0-a31e-f99d81a90d30 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:20.842819 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c2ccd2-d68e-47d0-a31e-f99d81a90d30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:20.874137 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-41c2ccd2-d68e-47d0-a31e-f99d81a90d30 None None] MFA Rules not processed for user `ae15ceb5c00f4b0d9b3fa0fe16c5a0b0`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:02:20.875934 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-41c2ccd2-d68e-47d0-a31e-f99d81a90d30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:02:20.959648 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1158/2341] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:02:20 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:02:20.970381 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedcaaf4-8788-42e6-bbc4-c95350e421e1 service neutron] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:02:20.972054 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-eedcaaf4-8788-42e6-bbc4-c95350e421e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:02:21.036977 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedcaaf4-8788-42e6-bbc4-c95350e421e1 service neutron] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:02:21.040961 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3d0087-b16d-4ae9-816d-e57a13ad7c36 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22b6a7c36f8a4795a75271b8079821c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:02:21.041560 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3d0087-b16d-4ae9-816d-e57a13ad7c36 service cinder] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:21.041840 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3d0087-b16d-4ae9-816d-e57a13ad7c36 service cinder] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:21.042212 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3d0087-b16d-4ae9-816d-e57a13ad7c36 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:21.053015 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3d0087-b16d-4ae9-816d-e57a13ad7c36 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:02:21.054932 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3d0087-b16d-4ae9-816d-e57a13ad7c36 service cinder] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:02:21.065453 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1184/2342] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:02:20 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:02:21.118065 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:02:21.191521 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:02:21.965429 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:02:22.448739 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:02:22.837216 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:02:22.927652 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ff7903-0360-400c-b401-e8d1202fde51 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:22.927652 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ff7903-0360-400c-b401-e8d1202fde51 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:22.927652 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ff7903-0360-400c-b401-e8d1202fde51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:22.948310 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-a0ff7903-0360-400c-b401-e8d1202fde51 None None] MFA Rules not processed for user `ae15ceb5c00f4b0d9b3fa0fe16c5a0b0`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:02:22.949945 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-a0ff7903-0360-400c-b401-e8d1202fde51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:02:22.957436 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1159/2343] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:02:22 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:02:23.460875 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:02:23.514271 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:02:23.950696 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa3b895-b5bf-4c06-83d2-acfafc916606 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:23.950980 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa3b895-b5bf-4c06-83d2-acfafc916606 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:23.951477 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa3b895-b5bf-4c06-83d2-acfafc916606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:23.972767 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-0fa3b895-b5bf-4c06-83d2-acfafc916606 None None] MFA Rules not processed for user `886cb8649faf4bbdb7e290915b6c275d`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:02:23.974004 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-0fa3b895-b5bf-4c06-83d2-acfafc916606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:02:24.031099 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1185/2344] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:02:23 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:02:24.815373 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ff7903-0360-400c-b401-e8d1202fde51 None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:02:24.816861 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-a0ff7903-0360-400c-b401-e8d1202fde51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:02:24.844951 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ff7903-0360-400c-b401-e8d1202fde51 None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:02:24.854585 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a2eb89-690d-4364-b196-b643adcd4ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:02:24.855243 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a2eb89-690d-4364-b196-b643adcd4ec0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:24.855523 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a2eb89-690d-4364-b196-b643adcd4ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:24.855796 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a2eb89-690d-4364-b196-b643adcd4ec0 admin admin] PATH_INFO: `/v3/users/129d21be644248a99ac1c8acf85a897b` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:24.856998 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a2eb89-690d-4364-b196-b643adcd4ec0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=129d21be644248a99ac1c8acf85a897b)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:02:24.859249 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a2eb89-690d-4364-b196-b643adcd4ec0 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:02:25.076494 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-54a2eb89-690d-4364-b196-b643adcd4ec0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '129d21be644248a99ac1c8acf85a897b'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:02:25.083519 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-54a2eb89-690d-4364-b196-b643adcd4ec0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '129d21be644248a99ac1c8acf85a897b'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:02:25.084229 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-54a2eb89-690d-4364-b196-b643adcd4ec0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '129d21be644248a99ac1c8acf85a897b'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:02:25.084893 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-54a2eb89-690d-4364-b196-b643adcd4ec0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '129d21be644248a99ac1c8acf85a897b'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:02:25.096765 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-54a2eb89-690d-4364-b196-b643adcd4ec0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '129d21be644248a99ac1c8acf85a897b'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:02:25.131980 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:02:25.170554 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1160/2345] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 18 22:02:24 2022] DELETE /identity/v3/users/129d21be644248a99ac1c8acf85a897b => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:02:25.175258 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1185c0b3-2772-4468-8490-99949078d67c None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:25.175563 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1185c0b3-2772-4468-8490-99949078d67c None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:25.175837 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1185c0b3-2772-4468-8490-99949078d67c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:25.196780 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-1185c0b3-2772-4468-8490-99949078d67c None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:02:25.198020 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-1185c0b3-2772-4468-8490-99949078d67c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:02:25.257063 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:02:25.267698 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1186/2346] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:02:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:02:25.277024 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a2eb89-690d-4364-b196-b643adcd4ec0 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:02:25.278575 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-54a2eb89-690d-4364-b196-b643adcd4ec0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:02:25.343178 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a2eb89-690d-4364-b196-b643adcd4ec0 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:02:25.347457 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55464a31-3292-4728-8915-8a589bfe7947 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a937971ad1a4b0c8697c764f214d446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:02:25.348085 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55464a31-3292-4728-8915-8a589bfe7947 service neutron] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:25.348507 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55464a31-3292-4728-8915-8a589bfe7947 service neutron] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:25.349539 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55464a31-3292-4728-8915-8a589bfe7947 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:25.360408 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55464a31-3292-4728-8915-8a589bfe7947 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:02:25.362068 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55464a31-3292-4728-8915-8a589bfe7947 service neutron] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:02:25.380490 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1161/2347] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:02:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:02:25.660224 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:02:25.740479 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:02:25.827501 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1185c0b3-2772-4468-8490-99949078d67c None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:02:25.829105 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-1185c0b3-2772-4468-8490-99949078d67c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:02:25.842759 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1185c0b3-2772-4468-8490-99949078d67c None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:02:25.849446 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d429585-9cab-4c6a-ad5c-4eb11adad19f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:02:25.849446 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d429585-9cab-4c6a-ad5c-4eb11adad19f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:25.849863 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d429585-9cab-4c6a-ad5c-4eb11adad19f admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:25.850193 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d429585-9cab-4c6a-ad5c-4eb11adad19f admin admin] PATH_INFO: `/v3/projects/a1ae2fd3993544be9fe54321f4e84f0e` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:25.851139 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d429585-9cab-4c6a-ad5c-4eb11adad19f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1ae2fd3993544be9fe54321f4e84f0e)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:02:25.853155 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d429585-9cab-4c6a-ad5c-4eb11adad19f admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:02:25.999780 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-2d429585-9cab-4c6a-ad5c-4eb11adad19f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1ae2fd3993544be9fe54321f4e84f0e', 'request_id': 'req-2d429585-9cab-4c6a-ad5c-4eb11adad19f'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:02:26.005619 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-2d429585-9cab-4c6a-ad5c-4eb11adad19f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1ae2fd3993544be9fe54321f4e84f0e', 'request_id': 'req-2d429585-9cab-4c6a-ad5c-4eb11adad19f'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:02:26.085145 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-2d429585-9cab-4c6a-ad5c-4eb11adad19f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1ae2fd3993544be9fe54321f4e84f0e', 'request_id': 'req-2d429585-9cab-4c6a-ad5c-4eb11adad19f'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:02:26.100342 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-2d429585-9cab-4c6a-ad5c-4eb11adad19f admin admin] The token cache is being invalidate because project a1ae2fd3993544be9fe54321f4e84f0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88097) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 22:02:26.100342 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-2d429585-9cab-4c6a-ad5c-4eb11adad19f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:02:26.100342 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-2d429585-9cab-4c6a-ad5c-4eb11adad19f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:02:26.102268 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1187/2348] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 18 22:02:25 2022] DELETE /identity/v3/projects/a1ae2fd3993544be9fe54321f4e84f0e => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:02:26.369121 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:02:26.476923 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:02:26.868328 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:02:26.931056 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:02:27.818548 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:02:27.897972 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:02:29.007508 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:DELETE=18,keystone:SELECT=80,keystone:INSERT=2 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:02:29.094491 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:02:30.217666 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:02:30.251080 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:02:30.480970 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:02:30.502509 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:02:30.571092 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:02:30.753687 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:02:30.828169 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:02:30.913888 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:02:30.991743 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:DELETE=3,keystone:SELECT=92,keystone:INSERT=5 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:02:31.059867 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:02:31.140010 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=89,keystone:DELETE=6,keystone:INSERT=5 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:02:31.283448 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:02:31.432400 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:02:37.940511 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bb95fe-1563-4fce-8b2f-36854b825221 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:37.941201 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bb95fe-1563-4fce-8b2f-36854b825221 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:37.941201 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bb95fe-1563-4fce-8b2f-36854b825221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:37.962954 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:02:37.967272 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-46bb95fe-1563-4fce-8b2f-36854b825221 None None] MFA Rules not processed for user `f079aa6ed5594a4982172b51b93ac54f`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:02:37.968514 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-46bb95fe-1563-4fce-8b2f-36854b825221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:02:38.026507 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1162/2349] 10.222.0.27 () {58 vars in 1009 bytes} [Thu Aug 18 22:02:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:02:38.084659 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d429585-9cab-4c6a-ad5c-4eb11adad19f admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:02:38.086239 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-2d429585-9cab-4c6a-ad5c-4eb11adad19f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:02:38.192521 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d429585-9cab-4c6a-ad5c-4eb11adad19f admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:02:38.201041 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bc5564-5460-4f5d-8b7f-d243a71c5588 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae59e6dca304c949942ae769acedc74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:02:38.202014 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bc5564-5460-4f5d-8b7f-d243a71c5588 service swift] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:38.202448 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bc5564-5460-4f5d-8b7f-d243a71c5588 service swift] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:38.203538 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bc5564-5460-4f5d-8b7f-d243a71c5588 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:38.217943 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bc5564-5460-4f5d-8b7f-d243a71c5588 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:02:38.221367 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bc5564-5460-4f5d-8b7f-d243a71c5588 service swift] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:02:38.233900 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1188/2350] 10.222.0.27 () {60 vars in 1384 bytes} [Thu Aug 18 22:02:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 18 22:02:46.283766 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3d176e-dc97-42f2-8d5c-37c7c47ef672 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:46.284911 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3d176e-dc97-42f2-8d5c-37c7c47ef672 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:46.285613 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3d176e-dc97-42f2-8d5c-37c7c47ef672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:46.307771 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-aa3d176e-dc97-42f2-8d5c-37c7c47ef672 None None] MFA Rules not processed for user `ae15ceb5c00f4b0d9b3fa0fe16c5a0b0`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:02:46.309464 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-aa3d176e-dc97-42f2-8d5c-37c7c47ef672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:02:46.374856 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1163/2351] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:02:46 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:02:48.229679 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=49,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:02:56.366579 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=48 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:02:57.343423 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16de80f1-67a6-4b8d-aeea-bf4d60da9c01 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:57.343948 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16de80f1-67a6-4b8d-aeea-bf4d60da9c01 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:57.347722 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16de80f1-67a6-4b8d-aeea-bf4d60da9c01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:57.363373 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-16de80f1-67a6-4b8d-aeea-bf4d60da9c01 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:02:57.364619 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-16de80f1-67a6-4b8d-aeea-bf4d60da9c01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:02:57.427663 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1189/2352] 10.222.0.84 () {58 vars in 1016 bytes} [Thu Aug 18 22:02:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:02:57.453027 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3d176e-dc97-42f2-8d5c-37c7c47ef672 None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:02:57.454599 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-aa3d176e-dc97-42f2-8d5c-37c7c47ef672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:02:57.531076 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3d176e-dc97-42f2-8d5c-37c7c47ef672 None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:02:57.536843 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b249bd33-0297-44e7-8ab7-34c7b584b8ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a39cd50340184779ac589bbcb7cac9aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:02:57.537480 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b249bd33-0297-44e7-8ab7-34c7b584b8ba service nova] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:57.537766 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b249bd33-0297-44e7-8ab7-34c7b584b8ba service nova] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:57.538043 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b249bd33-0297-44e7-8ab7-34c7b584b8ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:57.546670 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b249bd33-0297-44e7-8ab7-34c7b584b8ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:02:57.548218 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b249bd33-0297-44e7-8ab7-34c7b584b8ba service nova] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:02:57.558380 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1164/2353] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:02:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:02:57.782782 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b4f5ab-6737-46a0-8fb6-3ae728b9132a None None] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:57.783073 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b4f5ab-6737-46a0-8fb6-3ae728b9132a None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:57.783503 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b4f5ab-6737-46a0-8fb6-3ae728b9132a None None] PATH_INFO: `/` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:57.785109 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1190/2354] 10.222.0.27 () {54 vars in 921 bytes} [Thu Aug 18 22:02:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 22:02:57.791474 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0ea122-25a6-41b8-b6ee-b29afc5cc0ed None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:57.791832 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0ea122-25a6-41b8-b6ee-b29afc5cc0ed None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:57.792199 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0ea122-25a6-41b8-b6ee-b29afc5cc0ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:57.814060 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-fb0ea122-25a6-41b8-b6ee-b29afc5cc0ed None None] MFA Rules not processed for user `a39cd50340184779ac589bbcb7cac9aa`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:02:57.815212 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-fb0ea122-25a6-41b8-b6ee-b29afc5cc0ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:02:57.825571 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1165/2355] 10.222.0.27 () {58 vars in 1018 bytes} [Thu Aug 18 22:02:57 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:02:57.836898 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b4f5ab-6737-46a0-8fb6-3ae728b9132a None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:02:57.838689 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-31b4f5ab-6737-46a0-8fb6-3ae728b9132a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:02:57.897807 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b4f5ab-6737-46a0-8fb6-3ae728b9132a None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:02:57.901938 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0bab68-ad6c-495a-9671-897683b895d1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85dfef6a910547da9706d294e7d40fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:02:57.902538 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0bab68-ad6c-495a-9671-897683b895d1 service glance] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:57.902820 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0bab68-ad6c-495a-9671-897683b895d1 service glance] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:57.903094 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0bab68-ad6c-495a-9671-897683b895d1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:57.913110 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0bab68-ad6c-495a-9671-897683b895d1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:02:57.915370 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0bab68-ad6c-495a-9671-897683b895d1 service glance] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:02:57.926113 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1191/2356] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:02:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:02:58.113295 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef3a6e0-4d53-4adc-80bd-fc88ababfcde None None] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:58.115784 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef3a6e0-4d53-4adc-80bd-fc88ababfcde None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:58.115784 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef3a6e0-4d53-4adc-80bd-fc88ababfcde None None] PATH_INFO: `/` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:58.115784 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1166/2357] 10.222.0.27 () {54 vars in 921 bytes} [Thu Aug 18 22:02:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 22:02:58.120486 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af9c230-faae-4dcb-adb2-e150fa1a1988 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:58.120832 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af9c230-faae-4dcb-adb2-e150fa1a1988 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:58.121140 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af9c230-faae-4dcb-adb2-e150fa1a1988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:58.140983 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-8af9c230-faae-4dcb-adb2-e150fa1a1988 None None] MFA Rules not processed for user `6a937971ad1a4b0c8697c764f214d446`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:02:58.142194 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-8af9c230-faae-4dcb-adb2-e150fa1a1988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:02:58.193868 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1192/2358] 10.222.0.27 () {58 vars in 1018 bytes} [Thu Aug 18 22:02:58 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 22:02:58.205811 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef3a6e0-4d53-4adc-80bd-fc88ababfcde None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:02:58.207487 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-bef3a6e0-4d53-4adc-80bd-fc88ababfcde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:02:58.221420 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef3a6e0-4d53-4adc-80bd-fc88ababfcde None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:02:58.225056 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89940ca5-9aa8-49c0-bc53-81b0fd887ce5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a937971ad1a4b0c8697c764f214d446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:02:58.225650 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89940ca5-9aa8-49c0-bc53-81b0fd887ce5 service neutron] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:58.225929 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89940ca5-9aa8-49c0-bc53-81b0fd887ce5 service neutron] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:58.226204 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89940ca5-9aa8-49c0-bc53-81b0fd887ce5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:58.234216 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89940ca5-9aa8-49c0-bc53-81b0fd887ce5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:02:58.235618 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89940ca5-9aa8-49c0-bc53-81b0fd887ce5 service neutron] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:02:58.243665 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1167/2359] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:02:58 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:02:58.332852 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fb0c64-9862-4d87-86b3-98622893cfd3 None None] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:58.333079 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fb0c64-9862-4d87-86b3-98622893cfd3 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:58.333356 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fb0c64-9862-4d87-86b3-98622893cfd3 None None] PATH_INFO: `/` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:58.334862 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1193/2360] 10.222.0.27 () {54 vars in 921 bytes} [Thu Aug 18 22:02:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 22:02:58.342387 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd2a483-9bd2-4eed-ad0c-5278f43bddcf None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:58.342668 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd2a483-9bd2-4eed-ad0c-5278f43bddcf None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:58.342944 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd2a483-9bd2-4eed-ad0c-5278f43bddcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:58.363251 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-6dd2a483-9bd2-4eed-ad0c-5278f43bddcf None None] MFA Rules not processed for user `a39cd50340184779ac589bbcb7cac9aa`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:02:58.367788 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-6dd2a483-9bd2-4eed-ad0c-5278f43bddcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:02:58.373933 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1168/2361] 10.222.0.27 () {58 vars in 1018 bytes} [Thu Aug 18 22:02:58 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:02:58.385309 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fb0c64-9862-4d87-86b3-98622893cfd3 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:02:58.387137 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-72fb0c64-9862-4d87-86b3-98622893cfd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:02:58.401164 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fb0c64-9862-4d87-86b3-98622893cfd3 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:02:58.404655 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1df2ff1-2647-4443-a5df-23c81eda1ef6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a937971ad1a4b0c8697c764f214d446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:02:58.405238 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1df2ff1-2647-4443-a5df-23c81eda1ef6 service neutron] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:02:58.405515 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1df2ff1-2647-4443-a5df-23c81eda1ef6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:02:58.405785 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1df2ff1-2647-4443-a5df-23c81eda1ef6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:02:58.415778 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1df2ff1-2647-4443-a5df-23c81eda1ef6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:02:58.417234 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1df2ff1-2647-4443-a5df-23c81eda1ef6 service neutron] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:02:58.427841 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1194/2362] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:02:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:03:02.718088 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4d436b-5cda-487e-b489-a1fc9fc6c17d None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:03:02.721430 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4d436b-5cda-487e-b489-a1fc9fc6c17d None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:03:02.721430 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4d436b-5cda-487e-b489-a1fc9fc6c17d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:03:02.739293 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-3f4d436b-5cda-487e-b489-a1fc9fc6c17d None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:03:02.744382 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-3f4d436b-5cda-487e-b489-a1fc9fc6c17d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:03:02.749033 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1169/2363] 10.222.0.84 () {58 vars in 1016 bytes} [Thu Aug 18 22:03:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:03:02.779521 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1df2ff1-2647-4443-a5df-23c81eda1ef6 service neutron] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:03:02.781746 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-a1df2ff1-2647-4443-a5df-23c81eda1ef6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:03:02.798547 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1df2ff1-2647-4443-a5df-23c81eda1ef6 service neutron] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:03:02.804977 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f48d40-9852-4da8-ba90-e7dcfb1cdb06 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a39cd50340184779ac589bbcb7cac9aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:03:02.805740 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f48d40-9852-4da8-ba90-e7dcfb1cdb06 service nova] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:03:02.806081 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f48d40-9852-4da8-ba90-e7dcfb1cdb06 service nova] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:03:02.806421 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f48d40-9852-4da8-ba90-e7dcfb1cdb06 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:03:02.816236 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f48d40-9852-4da8-ba90-e7dcfb1cdb06 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:03:02.818159 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f48d40-9852-4da8-ba90-e7dcfb1cdb06 service nova] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:03:02.830634 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1195/2364] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:03:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:03:06.144372 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcc4c2d-28ce-4bae-b398-cb88df81e4a6 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:03:06.144882 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcc4c2d-28ce-4bae-b398-cb88df81e4a6 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:03:06.144960 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcc4c2d-28ce-4bae-b398-cb88df81e4a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:03:06.166908 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-cbcc4c2d-28ce-4bae-b398-cb88df81e4a6 None None] MFA Rules not processed for user `f079aa6ed5594a4982172b51b93ac54f`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:03:06.168103 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-cbcc4c2d-28ce-4bae-b398-cb88df81e4a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:03:06.175770 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1170/2365] 10.222.0.27 () {58 vars in 1009 bytes} [Thu Aug 18 22:03:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:03:06.188169 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f48d40-9852-4da8-ba90-e7dcfb1cdb06 service nova] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:03:06.200200 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f48d40-9852-4da8-ba90-e7dcfb1cdb06 service nova] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:03:06.205411 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b2e66b-9a78-47a0-9eb0-5e25858aeb89 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae59e6dca304c949942ae769acedc74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:03:06.206008 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b2e66b-9a78-47a0-9eb0-5e25858aeb89 service swift] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:03:06.206291 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b2e66b-9a78-47a0-9eb0-5e25858aeb89 service swift] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:03:06.206650 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b2e66b-9a78-47a0-9eb0-5e25858aeb89 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:03:06.215817 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b2e66b-9a78-47a0-9eb0-5e25858aeb89 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:03:06.217444 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b2e66b-9a78-47a0-9eb0-5e25858aeb89 service swift] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:03:06.225710 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1196/2366] 10.222.0.27 () {60 vars in 1384 bytes} [Thu Aug 18 22:03:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 18 22:03:08.233905 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9e4e65-34ff-4a44-b339-878e8e9ce458 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:03:08.234459 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9e4e65-34ff-4a44-b339-878e8e9ce458 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:03:08.234459 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9e4e65-34ff-4a44-b339-878e8e9ce458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:03:08.255939 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-5f9e4e65-34ff-4a44-b339-878e8e9ce458 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:03:08.257186 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-5f9e4e65-34ff-4a44-b339-878e8e9ce458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:03:08.271982 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1171/2367] 10.222.0.84 () {58 vars in 1016 bytes} [Thu Aug 18 22:03:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:03:08.296586 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b2e66b-9a78-47a0-9eb0-5e25858aeb89 service swift] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:03:08.309179 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b2e66b-9a78-47a0-9eb0-5e25858aeb89 service swift] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:03:08.314783 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f531956d-c49d-4af5-9058-60add8e898eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a39cd50340184779ac589bbcb7cac9aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:03:08.315383 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f531956d-c49d-4af5-9058-60add8e898eb service nova] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:03:08.315658 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f531956d-c49d-4af5-9058-60add8e898eb service nova] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:03:08.315928 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f531956d-c49d-4af5-9058-60add8e898eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:03:08.325795 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f531956d-c49d-4af5-9058-60add8e898eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:03:08.327374 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f531956d-c49d-4af5-9058-60add8e898eb service nova] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:03:08.332370 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:03:08.337706 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1197/2368] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:03:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:03:18.250300 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=55 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:03:22.475351 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97399620-aa03-40a2-b23e-7c51e60c2750 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:03:22.475976 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97399620-aa03-40a2-b23e-7c51e60c2750 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:03:22.475976 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97399620-aa03-40a2-b23e-7c51e60c2750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:03:22.497449 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-97399620-aa03-40a2-b23e-7c51e60c2750 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:03:22.498643 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-97399620-aa03-40a2-b23e-7c51e60c2750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:03:22.506462 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1172/2369] 10.222.0.84 () {58 vars in 1016 bytes} [Thu Aug 18 22:03:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:03:22.528900 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f531956d-c49d-4af5-9058-60add8e898eb service nova] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:03:22.540497 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f531956d-c49d-4af5-9058-60add8e898eb service nova] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:03:22.545983 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8c5f01-6841-4d17-a1f7-3dabad5d8cbd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a39cd50340184779ac589bbcb7cac9aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:03:22.546594 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8c5f01-6841-4d17-a1f7-3dabad5d8cbd service nova] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:03:22.546874 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8c5f01-6841-4d17-a1f7-3dabad5d8cbd service nova] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:03:22.547147 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8c5f01-6841-4d17-a1f7-3dabad5d8cbd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:03:22.555365 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8c5f01-6841-4d17-a1f7-3dabad5d8cbd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:03:22.557487 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8c5f01-6841-4d17-a1f7-3dabad5d8cbd service nova] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:03:22.567146 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1198/2370] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:03:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:03:25.310707 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13dfbf9-7a25-4682-887b-c4459e35b354 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:03:25.311145 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13dfbf9-7a25-4682-887b-c4459e35b354 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:03:25.311276 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13dfbf9-7a25-4682-887b-c4459e35b354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:03:25.330753 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-c13dfbf9-7a25-4682-887b-c4459e35b354 None None] MFA Rules not processed for user `f079aa6ed5594a4982172b51b93ac54f`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:03:25.331940 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-c13dfbf9-7a25-4682-887b-c4459e35b354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:03:25.339763 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1173/2371] 10.222.0.27 () {58 vars in 1009 bytes} [Thu Aug 18 22:03:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:03:25.352358 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8c5f01-6841-4d17-a1f7-3dabad5d8cbd service nova] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:03:25.363824 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8c5f01-6841-4d17-a1f7-3dabad5d8cbd service nova] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:03:25.369139 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3a483f-5b74-4c69-8894-960a4eb37c77 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae59e6dca304c949942ae769acedc74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:03:25.369732 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3a483f-5b74-4c69-8894-960a4eb37c77 service swift] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:03:25.370012 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3a483f-5b74-4c69-8894-960a4eb37c77 service swift] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:03:25.370286 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3a483f-5b74-4c69-8894-960a4eb37c77 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:03:25.379952 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3a483f-5b74-4c69-8894-960a4eb37c77 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:03:25.382421 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3a483f-5b74-4c69-8894-960a4eb37c77 service swift] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:03:25.391777 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1199/2372] 10.222.0.27 () {60 vars in 1384 bytes} [Thu Aug 18 22:03:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 18 22:03:32.016201 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8901e37d-0aad-461d-a02e-f3b212ae7e59 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:03:32.016845 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8901e37d-0aad-461d-a02e-f3b212ae7e59 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:03:32.016845 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8901e37d-0aad-461d-a02e-f3b212ae7e59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:03:32.038625 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-8901e37d-0aad-461d-a02e-f3b212ae7e59 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:03:32.040412 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-8901e37d-0aad-461d-a02e-f3b212ae7e59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:03:32.052978 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1174/2373] 10.222.0.84 () {58 vars in 1016 bytes} [Thu Aug 18 22:03:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:03:32.076053 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3a483f-5b74-4c69-8894-960a4eb37c77 service swift] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:03:32.089530 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3a483f-5b74-4c69-8894-960a4eb37c77 service swift] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:03:32.095811 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7cf3a0-8ee1-4953-86ca-11344d79de10 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a39cd50340184779ac589bbcb7cac9aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:03:32.096484 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7cf3a0-8ee1-4953-86ca-11344d79de10 service nova] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:03:32.096854 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7cf3a0-8ee1-4953-86ca-11344d79de10 service nova] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:03:32.097208 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7cf3a0-8ee1-4953-86ca-11344d79de10 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:03:32.108178 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7cf3a0-8ee1-4953-86ca-11344d79de10 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:03:32.109802 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7cf3a0-8ee1-4953-86ca-11344d79de10 service nova] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:03:32.128794 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1200/2374] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:03:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 22:03:32.261801 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da979c89-cd67-478f-ae50-bccf1f3a3e60 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:03:32.262209 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da979c89-cd67-478f-ae50-bccf1f3a3e60 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:03:32.262593 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da979c89-cd67-478f-ae50-bccf1f3a3e60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:03:32.285470 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-da979c89-cd67-478f-ae50-bccf1f3a3e60 None None] MFA Rules not processed for user `f079aa6ed5594a4982172b51b93ac54f`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:03:32.287492 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-da979c89-cd67-478f-ae50-bccf1f3a3e60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:03:32.305849 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1175/2375] 10.222.0.27 () {58 vars in 967 bytes} [Thu Aug 18 22:03:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:03:32.322219 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7cf3a0-8ee1-4953-86ca-11344d79de10 service nova] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:03:32.343717 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7cf3a0-8ee1-4953-86ca-11344d79de10 service nova] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:03:32.361271 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a10e57-36e6-44c4-ab59-72f8383aba27 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae59e6dca304c949942ae769acedc74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:03:32.362084 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a10e57-36e6-44c4-ab59-72f8383aba27 service swift] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:03:32.362385 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a10e57-36e6-44c4-ab59-72f8383aba27 service swift] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:03:32.362676 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a10e57-36e6-44c4-ab59-72f8383aba27 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:03:32.377745 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a10e57-36e6-44c4-ab59-72f8383aba27 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:03:32.380284 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a10e57-36e6-44c4-ab59-72f8383aba27 service swift] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:03:32.390918 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1201/2376] 10.222.0.27 () {60 vars in 1384 bytes} [Thu Aug 18 22:03:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 18 22:03:36.304530 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faa5d47-5aa9-4aaa-9a58-bef8d533ef22 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:03:36.305190 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faa5d47-5aa9-4aaa-9a58-bef8d533ef22 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:03:36.305650 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faa5d47-5aa9-4aaa-9a58-bef8d533ef22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:03:36.326657 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-9faa5d47-5aa9-4aaa-9a58-bef8d533ef22 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:03:36.328229 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-9faa5d47-5aa9-4aaa-9a58-bef8d533ef22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:03:36.338416 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1176/2377] 10.222.0.84 () {58 vars in 1016 bytes} [Thu Aug 18 22:03:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:03:36.361499 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a10e57-36e6-44c4-ab59-72f8383aba27 service swift] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:03:36.376005 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a10e57-36e6-44c4-ab59-72f8383aba27 service swift] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:03:36.382606 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881a571a-3f6c-4b34-b77d-ac41cdc1450a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a39cd50340184779ac589bbcb7cac9aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:03:36.383864 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881a571a-3f6c-4b34-b77d-ac41cdc1450a service nova] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:03:36.384309 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881a571a-3f6c-4b34-b77d-ac41cdc1450a service nova] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:03:36.384797 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881a571a-3f6c-4b34-b77d-ac41cdc1450a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:03:36.405252 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881a571a-3f6c-4b34-b77d-ac41cdc1450a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:03:36.406844 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881a571a-3f6c-4b34-b77d-ac41cdc1450a service nova] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:03:36.431257 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1202/2378] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:03:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:03:38.005245 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faa5d47-5aa9-4aaa-9a58-bef8d533ef22 None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:03:38.007028 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-9faa5d47-5aa9-4aaa-9a58-bef8d533ef22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:03:38.089555 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faa5d47-5aa9-4aaa-9a58-bef8d533ef22 None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:03:38.094963 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e666fa6-e41b-45e0-b5ce-ec9bb0a9856f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b44c0cf2d8b34f3e81c59d19eedbdfcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:03:38.095585 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e666fa6-e41b-45e0-b5ce-ec9bb0a9856f service placement] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:03:38.095869 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e666fa6-e41b-45e0-b5ce-ec9bb0a9856f service placement] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:03:38.096146 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e666fa6-e41b-45e0-b5ce-ec9bb0a9856f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:03:38.100877 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-6e666fa6-e41b-45e0-b5ce-ec9bb0a9856f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:03:38.116510 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e666fa6-e41b-45e0-b5ce-ec9bb0a9856f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:03:38.119060 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e666fa6-e41b-45e0-b5ce-ec9bb0a9856f service placement] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:03:38.134374 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1177/2379] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:03:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 22:03:43.142896 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2730c2f-8e88-414c-882e-8087a18d8a0b None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:03:43.143327 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2730c2f-8e88-414c-882e-8087a18d8a0b None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:03:43.143429 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2730c2f-8e88-414c-882e-8087a18d8a0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:03:43.163064 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-a2730c2f-8e88-414c-882e-8087a18d8a0b None None] MFA Rules not processed for user `f079aa6ed5594a4982172b51b93ac54f`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:03:43.165214 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-a2730c2f-8e88-414c-882e-8087a18d8a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:03:43.172112 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1203/2380] 10.222.0.27 () {58 vars in 967 bytes} [Thu Aug 18 22:03:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:03:43.185009 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e666fa6-e41b-45e0-b5ce-ec9bb0a9856f service placement] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:03:43.196244 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e666fa6-e41b-45e0-b5ce-ec9bb0a9856f service placement] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:03:43.201326 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aa7e82-7c7d-427f-8611-85d0079f8dcc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae59e6dca304c949942ae769acedc74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:03:43.201924 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aa7e82-7c7d-427f-8611-85d0079f8dcc service swift] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:03:43.202233 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aa7e82-7c7d-427f-8611-85d0079f8dcc service swift] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:03:43.202508 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aa7e82-7c7d-427f-8611-85d0079f8dcc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:03:43.211113 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41aa7e82-7c7d-427f-8611-85d0079f8dcc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:03:43.212853 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41aa7e82-7c7d-427f-8611-85d0079f8dcc service swift] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:03:43.220838 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1178/2381] 10.222.0.27 () {60 vars in 1384 bytes} [Thu Aug 18 22:03:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 18 22:03:46.304641 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2730c2f-8e88-414c-882e-8087a18d8a0b None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:03:46.305324 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-a2730c2f-8e88-414c-882e-8087a18d8a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:03:46.319931 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2730c2f-8e88-414c-882e-8087a18d8a0b None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:03:46.324824 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5429374-0166-4847-a0d3-2a21d5bc0340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:03:46.325457 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5429374-0166-4847-a0d3-2a21d5bc0340 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:03:46.325739 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5429374-0166-4847-a0d3-2a21d5bc0340 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:03:46.326040 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5429374-0166-4847-a0d3-2a21d5bc0340 admin admin] PATH_INFO: `/v3/users/ae15ceb5c00f4b0d9b3fa0fe16c5a0b0` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:03:46.327265 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5429374-0166-4847-a0d3-2a21d5bc0340 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae15ceb5c00f4b0d9b3fa0fe16c5a0b0)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:03:46.329115 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5429374-0166-4847-a0d3-2a21d5bc0340 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:03:46.487932 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-b5429374-0166-4847-a0d3-2a21d5bc0340 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae15ceb5c00f4b0d9b3fa0fe16c5a0b0'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:03:46.495009 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-b5429374-0166-4847-a0d3-2a21d5bc0340 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae15ceb5c00f4b0d9b3fa0fe16c5a0b0'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:03:46.495706 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-b5429374-0166-4847-a0d3-2a21d5bc0340 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae15ceb5c00f4b0d9b3fa0fe16c5a0b0'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:03:46.508713 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-b5429374-0166-4847-a0d3-2a21d5bc0340 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae15ceb5c00f4b0d9b3fa0fe16c5a0b0'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:03:46.559730 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-b5429374-0166-4847-a0d3-2a21d5bc0340 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae15ceb5c00f4b0d9b3fa0fe16c5a0b0'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:03:46.565731 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1204/2382] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 18 22:03:46 2022] DELETE /identity/v3/users/ae15ceb5c00f4b0d9b3fa0fe16c5a0b0 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:03:46.798615 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aa7e82-7c7d-427f-8611-85d0079f8dcc service swift] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:03:46.809560 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aa7e82-7c7d-427f-8611-85d0079f8dcc service swift] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:03:46.869756 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e58e88-82a1-40e8-bbd7-6613636b40d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:03:46.870392 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e58e88-82a1-40e8-bbd7-6613636b40d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:03:46.870674 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e58e88-82a1-40e8-bbd7-6613636b40d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:03:46.870949 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e58e88-82a1-40e8-bbd7-6613636b40d2 admin admin] PATH_INFO: `/v3/projects/87be2dfcfe5b44fb88354cc811ae52a9` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:03:46.872081 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e58e88-82a1-40e8-bbd7-6613636b40d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87be2dfcfe5b44fb88354cc811ae52a9)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:03:46.874010 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e58e88-82a1-40e8-bbd7-6613636b40d2 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:03:46.978146 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:03:46.981147 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-05e58e88-82a1-40e8-bbd7-6613636b40d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87be2dfcfe5b44fb88354cc811ae52a9', 'request_id': 'req-05e58e88-82a1-40e8-bbd7-6613636b40d2'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:03:46.986563 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-05e58e88-82a1-40e8-bbd7-6613636b40d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87be2dfcfe5b44fb88354cc811ae52a9', 'request_id': 'req-05e58e88-82a1-40e8-bbd7-6613636b40d2'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:03:47.053378 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-05e58e88-82a1-40e8-bbd7-6613636b40d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87be2dfcfe5b44fb88354cc811ae52a9', 'request_id': 'req-05e58e88-82a1-40e8-bbd7-6613636b40d2'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:03:47.065298 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-05e58e88-82a1-40e8-bbd7-6613636b40d2 admin admin] The token cache is being invalidate because project 87be2dfcfe5b44fb88354cc811ae52a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88096) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 22:03:47.065595 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-05e58e88-82a1-40e8-bbd7-6613636b40d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:03:47.066221 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-05e58e88-82a1-40e8-bbd7-6613636b40d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:03:47.067759 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1179/2383] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 18 22:03:46 2022] DELETE /identity/v3/projects/87be2dfcfe5b44fb88354cc811ae52a9 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:03:47.073376 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fcb3ef-7861-446d-9bb4-ed899362cc56 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:03:47.073661 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fcb3ef-7861-446d-9bb4-ed899362cc56 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:03:47.073934 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fcb3ef-7861-446d-9bb4-ed899362cc56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:03:47.094612 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-62fcb3ef-7861-446d-9bb4-ed899362cc56 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:03:47.095857 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-62fcb3ef-7861-446d-9bb4-ed899362cc56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:03:47.149675 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:03:47.159575 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1205/2384] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:03:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:03:47.168098 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9874cb-a217-45b8-8991-f67b954b1f70 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:03:47.168321 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9874cb-a217-45b8-8991-f67b954b1f70 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:03:47.168613 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9874cb-a217-45b8-8991-f67b954b1f70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:03:47.193700 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-5b9874cb-a217-45b8-8991-f67b954b1f70 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:03:47.195719 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-5b9874cb-a217-45b8-8991-f67b954b1f70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:03:47.204648 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1180/2385] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:03:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:03:47.208707 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fcb3ef-7861-446d-9bb4-ed899362cc56 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:03:47.219931 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fcb3ef-7861-446d-9bb4-ed899362cc56 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:03:47.224734 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829e22be-b86e-4740-a41c-5c871b8adb77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:03:47.225535 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829e22be-b86e-4740-a41c-5c871b8adb77 admin admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:03:47.225815 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829e22be-b86e-4740-a41c-5c871b8adb77 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:03:47.226200 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829e22be-b86e-4740-a41c-5c871b8adb77 admin admin] PATH_INFO: `/v3/domains` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:03:47.226958 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829e22be-b86e-4740-a41c-5c871b8adb77 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 22:03:47.227254 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829e22be-b86e-4740-a41c-5c871b8adb77 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:03:47.228917 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829e22be-b86e-4740-a41c-5c871b8adb77 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:03:47.244457 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1206/2386] 10.222.0.27 () {58 vars in 1153 bytes} [Thu Aug 18 22:03:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 22:03:47.248650 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9874cb-a217-45b8-8991-f67b954b1f70 None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:03:47.258888 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9874cb-a217-45b8-8991-f67b954b1f70 None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:03:47.263822 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c4eeb3-e818-41ac-97a8-359ee0c30e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:03:47.264429 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c4eeb3-e818-41ac-97a8-359ee0c30e77 admin admin] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:03:47.264750 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c4eeb3-e818-41ac-97a8-359ee0c30e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:03:47.265022 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c4eeb3-e818-41ac-97a8-359ee0c30e77 admin admin] PATH_INFO: `/v3/projects` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:03:47.265650 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c4eeb3-e818-41ac-97a8-359ee0c30e77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:03:47.267574 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c4eeb3-e818-41ac-97a8-359ee0c30e77 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:03:47.341191 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1181/2387] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 18 22:03:47 2022] POST /identity/v3/projects => generated 367 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 22:03:47.342454 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829e22be-b86e-4740-a41c-5c871b8adb77 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:03:47.353596 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829e22be-b86e-4740-a41c-5c871b8adb77 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:03:47.416333 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeae14b-c24d-454f-a069-180de44b2c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:03:47.416983 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeae14b-c24d-454f-a069-180de44b2c5b admin admin] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:03:47.417344 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeae14b-c24d-454f-a069-180de44b2c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:03:47.417599 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeae14b-c24d-454f-a069-180de44b2c5b admin admin] PATH_INFO: `/v3/users` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:03:47.418175 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbeae14b-c24d-454f-a069-180de44b2c5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:03:47.420105 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbeae14b-c24d-454f-a069-180de44b2c5b admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:03:47.511622 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1207/2388] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 18 22:03:47 2022] POST /identity/v3/users => generated 284 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 22:03:47.515806 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c4eeb3-e818-41ac-97a8-359ee0c30e77 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:03:47.527815 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c4eeb3-e818-41ac-97a8-359ee0c30e77 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:03:47.532783 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5715268f-d846-4568-a0b7-4450e42128d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:03:47.533382 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5715268f-d846-4568-a0b7-4450e42128d4 admin admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:03:47.533660 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5715268f-d846-4568-a0b7-4450e42128d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:03:47.533930 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5715268f-d846-4568-a0b7-4450e42128d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:03:47.534568 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5715268f-d846-4568-a0b7-4450e42128d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:03:47.536181 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5715268f-d846-4568-a0b7-4450e42128d4 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:03:47.546779 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1182/2389] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:03:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:03:47.553144 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeae14b-c24d-454f-a069-180de44b2c5b admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:03:47.563301 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeae14b-c24d-454f-a069-180de44b2c5b admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:03:47.568098 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3ec939-79df-4695-959a-46535d4c6ba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:03:47.568726 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3ec939-79df-4695-959a-46535d4c6ba2 admin admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:03:47.569003 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3ec939-79df-4695-959a-46535d4c6ba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:03:47.569321 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3ec939-79df-4695-959a-46535d4c6ba2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:03:47.570110 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3ec939-79df-4695-959a-46535d4c6ba2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:03:47.571753 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3ec939-79df-4695-959a-46535d4c6ba2 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:03:47.582623 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1208/2390] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:03:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:03:47.587180 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5715268f-d846-4568-a0b7-4450e42128d4 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:03:47.597181 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5715268f-d846-4568-a0b7-4450e42128d4 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:03:47.602128 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955f5c8a-11ba-4a64-9f64-bbad957782c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:03:47.602777 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955f5c8a-11ba-4a64-9f64-bbad957782c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:03:47.603060 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955f5c8a-11ba-4a64-9f64-bbad957782c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:03:47.603336 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955f5c8a-11ba-4a64-9f64-bbad957782c2 admin admin] PATH_INFO: `/v3/projects/5699621d24d04983af6741a8b6155111/users/03dc67e539d64f2db029eadc9968fa4c/roles/de8f2438056f4af9879423f8a59e0e0b` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:03:47.618308 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955f5c8a-11ba-4a64-9f64-bbad957782c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5699621d24d04983af6741a8b6155111, user_id=03dc67e539d64f2db029eadc9968fa4c, role_id=de8f2438056f4af9879423f8a59e0e0b)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:03:47.621034 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955f5c8a-11ba-4a64-9f64-bbad957782c2 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:03:47.677066 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1183/2391] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 18 22:03:47 2022] PUT /identity/v3/projects/5699621d24d04983af6741a8b6155111/users/03dc67e539d64f2db029eadc9968fa4c/roles/de8f2438056f4af9879423f8a59e0e0b => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:03:47.687832 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebb39d4-8cde-40c4-94ed-5e2bf8d0c27b None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:03:47.688340 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebb39d4-8cde-40c4-94ed-5e2bf8d0c27b None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:03:47.688473 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebb39d4-8cde-40c4-94ed-5e2bf8d0c27b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:03:47.717282 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-bebb39d4-8cde-40c4-94ed-5e2bf8d0c27b None None] MFA Rules not processed for user `03dc67e539d64f2db029eadc9968fa4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:03:47.718519 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-bebb39d4-8cde-40c4-94ed-5e2bf8d0c27b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:03:47.785126 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1209/2392] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:03:47 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:03:47.797010 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955f5c8a-11ba-4a64-9f64-bbad957782c2 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:03:47.798844 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-955f5c8a-11ba-4a64-9f64-bbad957782c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:03:47.859026 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955f5c8a-11ba-4a64-9f64-bbad957782c2 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:03:47.862685 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8877c683-7eb7-43f8-8569-d1e635e21fa9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85dfef6a910547da9706d294e7d40fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:03:47.863289 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8877c683-7eb7-43f8-8569-d1e635e21fa9 service glance] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:03:47.865808 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8877c683-7eb7-43f8-8569-d1e635e21fa9 service glance] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:03:47.865808 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8877c683-7eb7-43f8-8569-d1e635e21fa9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:03:47.873937 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8877c683-7eb7-43f8-8569-d1e635e21fa9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:03:47.875379 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8877c683-7eb7-43f8-8569-d1e635e21fa9 service glance] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:03:47.885070 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1184/2393] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:03:47 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:03:53.916467 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d9d45d-138f-4a1c-afc3-fdb243083f26 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:03:53.916979 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d9d45d-138f-4a1c-afc3-fdb243083f26 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:03:53.917070 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d9d45d-138f-4a1c-afc3-fdb243083f26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:03:53.937644 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-28d9d45d-138f-4a1c-afc3-fdb243083f26 None None] MFA Rules not processed for user `8af33ff52d894cc0b8ea6aec00934e8e`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:03:53.938884 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-28d9d45d-138f-4a1c-afc3-fdb243083f26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:03:53.988657 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:03:53.997145 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1210/2394] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:03:53 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:03:57.880440 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:DELETE=4,keystone:SELECT=60,keystone:INSERT=3 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:04:00.518818 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1d0634-c10c-407f-b0b9-b6954dca0746 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:04:00.519444 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1d0634-c10c-407f-b0b9-b6954dca0746 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:04:00.519444 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1d0634-c10c-407f-b0b9-b6954dca0746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:04:00.540408 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-1f1d0634-c10c-407f-b0b9-b6954dca0746 None None] MFA Rules not processed for user `886cb8649faf4bbdb7e290915b6c275d`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:04:00.541662 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-1f1d0634-c10c-407f-b0b9-b6954dca0746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:04:00.596090 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1185/2395] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:04:00 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:04:10.589297 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=25 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:04:13.703167 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d9d45d-138f-4a1c-afc3-fdb243083f26 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:04:13.724796 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b41546-bde4-4a44-83a0-25af1c3c3092 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:04:13.725448 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b41546-bde4-4a44-83a0-25af1c3c3092 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:04:13.725448 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b41546-bde4-4a44-83a0-25af1c3c3092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:04:13.744434 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-a9b41546-bde4-4a44-83a0-25af1c3c3092 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:04:13.745659 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-a9b41546-bde4-4a44-83a0-25af1c3c3092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:04:13.769068 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d9d45d-138f-4a1c-afc3-fdb243083f26 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:04:13.774272 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3768a2ca-a2a6-43d4-b109-cf264766dbe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:04:13.774905 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3768a2ca-a2a6-43d4-b109-cf264766dbe5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:04:13.775186 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3768a2ca-a2a6-43d4-b109-cf264766dbe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:04:13.775462 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3768a2ca-a2a6-43d4-b109-cf264766dbe5 admin admin] PATH_INFO: `/v3/users/03dc67e539d64f2db029eadc9968fa4c` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:04:13.776798 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3768a2ca-a2a6-43d4-b109-cf264766dbe5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=03dc67e539d64f2db029eadc9968fa4c)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:04:13.778735 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3768a2ca-a2a6-43d4-b109-cf264766dbe5 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:04:13.805123 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1186/2396] 10.222.0.84 () {58 vars in 1016 bytes} [Thu Aug 18 22:04:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 22:04:13.827181 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b41546-bde4-4a44-83a0-25af1c3c3092 None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:04:13.828730 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-a9b41546-bde4-4a44-83a0-25af1c3c3092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:04:13.903461 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b41546-bde4-4a44-83a0-25af1c3c3092 None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:04:13.909945 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e7ca63-a330-43e1-8f9c-563b5c1c43e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a39cd50340184779ac589bbcb7cac9aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:04:13.910563 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e7ca63-a330-43e1-8f9c-563b5c1c43e5 service nova] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:04:13.910845 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e7ca63-a330-43e1-8f9c-563b5c1c43e5 service nova] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:04:13.911158 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e7ca63-a330-43e1-8f9c-563b5c1c43e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:04:13.919765 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e7ca63-a330-43e1-8f9c-563b5c1c43e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:04:13.921510 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e7ca63-a330-43e1-8f9c-563b5c1c43e5 service nova] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:04:13.924066 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-3768a2ca-a2a6-43d4-b109-cf264766dbe5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03dc67e539d64f2db029eadc9968fa4c'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:04:13.931401 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-3768a2ca-a2a6-43d4-b109-cf264766dbe5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03dc67e539d64f2db029eadc9968fa4c'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:04:13.932297 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1187/2397] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:04:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 22:04:13.932521 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-3768a2ca-a2a6-43d4-b109-cf264766dbe5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03dc67e539d64f2db029eadc9968fa4c'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:04:13.945851 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-3768a2ca-a2a6-43d4-b109-cf264766dbe5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03dc67e539d64f2db029eadc9968fa4c'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:04:14.029363 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-3768a2ca-a2a6-43d4-b109-cf264766dbe5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03dc67e539d64f2db029eadc9968fa4c'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:04:14.037161 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1211/2398] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 18 22:04:13 2022] DELETE /identity/v3/users/03dc67e539d64f2db029eadc9968fa4c => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:04:14.041653 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7a20af-9d5b-4e9f-89cd-69323f0ad439 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:04:14.041945 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7a20af-9d5b-4e9f-89cd-69323f0ad439 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:04:14.042224 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7a20af-9d5b-4e9f-89cd-69323f0ad439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:04:14.061223 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-dc7a20af-9d5b-4e9f-89cd-69323f0ad439 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:04:14.062427 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-dc7a20af-9d5b-4e9f-89cd-69323f0ad439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:04:14.123697 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1188/2399] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:04:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:04:14.134114 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3768a2ca-a2a6-43d4-b109-cf264766dbe5 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:04:14.135544 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-3768a2ca-a2a6-43d4-b109-cf264766dbe5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:04:14.193885 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3768a2ca-a2a6-43d4-b109-cf264766dbe5 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:04:14.197642 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf36931-2be7-4535-9f26-d9debe0358e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a937971ad1a4b0c8697c764f214d446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:04:14.198249 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf36931-2be7-4535-9f26-d9debe0358e5 service neutron] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:04:14.198532 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf36931-2be7-4535-9f26-d9debe0358e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:04:14.198833 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf36931-2be7-4535-9f26-d9debe0358e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:04:14.208495 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf36931-2be7-4535-9f26-d9debe0358e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:04:14.209964 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf36931-2be7-4535-9f26-d9debe0358e5 service neutron] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:04:14.219433 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1212/2400] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:04:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:04:14.622747 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7a20af-9d5b-4e9f-89cd-69323f0ad439 None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:04:14.624467 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-dc7a20af-9d5b-4e9f-89cd-69323f0ad439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:04:14.644788 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7a20af-9d5b-4e9f-89cd-69323f0ad439 None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:04:14.652489 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b14e4da-44cc-47e8-bc6a-372f4ea9ce64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:04:14.653561 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b14e4da-44cc-47e8-bc6a-372f4ea9ce64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:04:14.654053 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b14e4da-44cc-47e8-bc6a-372f4ea9ce64 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:04:14.654542 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b14e4da-44cc-47e8-bc6a-372f4ea9ce64 admin admin] PATH_INFO: `/v3/projects/5699621d24d04983af6741a8b6155111` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:04:14.657425 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b14e4da-44cc-47e8-bc6a-372f4ea9ce64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5699621d24d04983af6741a8b6155111)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:04:14.659130 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b14e4da-44cc-47e8-bc6a-372f4ea9ce64 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:04:14.684209 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:04:14.794099 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-9b14e4da-44cc-47e8-bc6a-372f4ea9ce64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5699621d24d04983af6741a8b6155111', 'request_id': 'req-9b14e4da-44cc-47e8-bc6a-372f4ea9ce64'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:04:14.799515 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-9b14e4da-44cc-47e8-bc6a-372f4ea9ce64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5699621d24d04983af6741a8b6155111', 'request_id': 'req-9b14e4da-44cc-47e8-bc6a-372f4ea9ce64'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:04:14.866408 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-9b14e4da-44cc-47e8-bc6a-372f4ea9ce64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5699621d24d04983af6741a8b6155111', 'request_id': 'req-9b14e4da-44cc-47e8-bc6a-372f4ea9ce64'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:04:14.878240 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-9b14e4da-44cc-47e8-bc6a-372f4ea9ce64 admin admin] The token cache is being invalidate because project 5699621d24d04983af6741a8b6155111 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88096) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 22:04:14.878527 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-9b14e4da-44cc-47e8-bc6a-372f4ea9ce64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:04:14.879168 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-9b14e4da-44cc-47e8-bc6a-372f4ea9ce64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:04:14.880660 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1189/2401] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 18 22:04:14 2022] DELETE /identity/v3/projects/5699621d24d04983af6741a8b6155111 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:04:17.125622 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1875578-25f5-47e3-952d-c191fb3929a9 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:04:17.126200 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1875578-25f5-47e3-952d-c191fb3929a9 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:04:17.126200 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1875578-25f5-47e3-952d-c191fb3929a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:04:17.146861 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-d1875578-25f5-47e3-952d-c191fb3929a9 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:04:17.148070 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-d1875578-25f5-47e3-952d-c191fb3929a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:04:17.165081 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:04:17.207805 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1213/2402] 10.222.0.84 () {58 vars in 1016 bytes} [Thu Aug 18 22:04:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:04:17.228702 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b14e4da-44cc-47e8-bc6a-372f4ea9ce64 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:04:17.230227 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-9b14e4da-44cc-47e8-bc6a-372f4ea9ce64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:04:17.308733 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b14e4da-44cc-47e8-bc6a-372f4ea9ce64 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:04:17.314321 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe54ad5-5b05-4e19-9d89-edce70be2c4f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a39cd50340184779ac589bbcb7cac9aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:04:17.315440 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe54ad5-5b05-4e19-9d89-edce70be2c4f service nova] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:04:17.315715 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe54ad5-5b05-4e19-9d89-edce70be2c4f service nova] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:04:17.315991 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe54ad5-5b05-4e19-9d89-edce70be2c4f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:04:17.324809 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe54ad5-5b05-4e19-9d89-edce70be2c4f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:04:17.326389 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe54ad5-5b05-4e19-9d89-edce70be2c4f service nova] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:04:17.337309 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1190/2403] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:04:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:04:21.061739 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2be95fd-a19d-4cd4-9504-be08c13d7d11 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:04:21.062320 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2be95fd-a19d-4cd4-9504-be08c13d7d11 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:04:21.062419 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2be95fd-a19d-4cd4-9504-be08c13d7d11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:04:21.083465 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-b2be95fd-a19d-4cd4-9504-be08c13d7d11 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:04:21.084708 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-b2be95fd-a19d-4cd4-9504-be08c13d7d11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:04:21.092680 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1214/2404] 10.222.0.84 () {58 vars in 1016 bytes} [Thu Aug 18 22:04:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:04:21.122797 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe54ad5-5b05-4e19-9d89-edce70be2c4f service nova] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:04:21.122797 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-dbe54ad5-5b05-4e19-9d89-edce70be2c4f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:04:21.135886 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe54ad5-5b05-4e19-9d89-edce70be2c4f service nova] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:04:21.141476 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998591f7-e37b-49ac-9733-1c6da857722b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a39cd50340184779ac589bbcb7cac9aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:04:21.142094 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998591f7-e37b-49ac-9733-1c6da857722b service nova] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:04:21.142378 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998591f7-e37b-49ac-9733-1c6da857722b service nova] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:04:21.142649 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998591f7-e37b-49ac-9733-1c6da857722b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:04:21.151649 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998591f7-e37b-49ac-9733-1c6da857722b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:04:21.153309 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998591f7-e37b-49ac-9733-1c6da857722b service nova] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:04:21.166898 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1191/2405] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:04:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:04:26.358820 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3989dd4-e63f-4971-85a1-ddb0b3faa445 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:04:26.359312 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3989dd4-e63f-4971-85a1-ddb0b3faa445 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:04:26.359408 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3989dd4-e63f-4971-85a1-ddb0b3faa445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:04:26.379494 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-b3989dd4-e63f-4971-85a1-ddb0b3faa445 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:04:26.381008 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-b3989dd4-e63f-4971-85a1-ddb0b3faa445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:04:26.392694 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1215/2406] 10.222.0.84 () {58 vars in 1016 bytes} [Thu Aug 18 22:04:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:04:26.419136 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998591f7-e37b-49ac-9733-1c6da857722b service nova] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:04:26.431646 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998591f7-e37b-49ac-9733-1c6da857722b service nova] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:04:26.438505 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41171c20-17e6-49a9-8fbb-0c86912288ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a39cd50340184779ac589bbcb7cac9aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:04:26.439384 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41171c20-17e6-49a9-8fbb-0c86912288ed service nova] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:04:26.448790 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41171c20-17e6-49a9-8fbb-0c86912288ed service nova] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:04:26.448790 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41171c20-17e6-49a9-8fbb-0c86912288ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:04:26.451233 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41171c20-17e6-49a9-8fbb-0c86912288ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:04:26.453098 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41171c20-17e6-49a9-8fbb-0c86912288ed service nova] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:04:26.477371 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1192/2407] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:04:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:04:30.650624 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846d932a-d672-4c03-8280-e8b97b558e91 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:04:30.653361 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846d932a-d672-4c03-8280-e8b97b558e91 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:04:30.653361 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846d932a-d672-4c03-8280-e8b97b558e91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:04:30.672917 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-846d932a-d672-4c03-8280-e8b97b558e91 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:04:30.674126 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-846d932a-d672-4c03-8280-e8b97b558e91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:04:30.682899 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1216/2408] 10.222.0.84 () {58 vars in 1016 bytes} [Thu Aug 18 22:04:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:04:30.704721 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41171c20-17e6-49a9-8fbb-0c86912288ed service nova] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:04:30.718397 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41171c20-17e6-49a9-8fbb-0c86912288ed service nova] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:04:30.728461 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d198bf0-f35f-4105-9885-8d9e83c49164 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a39cd50340184779ac589bbcb7cac9aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:04:30.729125 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d198bf0-f35f-4105-9885-8d9e83c49164 service nova] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:04:30.729409 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d198bf0-f35f-4105-9885-8d9e83c49164 service nova] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:04:30.729684 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d198bf0-f35f-4105-9885-8d9e83c49164 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:04:30.738530 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d198bf0-f35f-4105-9885-8d9e83c49164 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:04:30.740946 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d198bf0-f35f-4105-9885-8d9e83c49164 service nova] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:04:30.751349 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1193/2409] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:04:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:04:31.813359 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c81616d-2072-40d6-9d67-e26bcbeaeae2 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:04:31.813824 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c81616d-2072-40d6-9d67-e26bcbeaeae2 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:04:31.813942 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c81616d-2072-40d6-9d67-e26bcbeaeae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:04:31.833618 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-3c81616d-2072-40d6-9d67-e26bcbeaeae2 None None] MFA Rules not processed for user `9c13345ad7e8464fa2f06e013d0ad058`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:04:31.836963 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-3c81616d-2072-40d6-9d67-e26bcbeaeae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:04:31.889063 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1217/2410] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:04:31 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:04:40.746732 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:DELETE=7,keystone:SELECT=67,keystone:INSERT=1 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:04:41.882441 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=51 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:04:47.310454 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e6db0d-27ea-4282-9eea-d0cdd62b9bed None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:04:47.310957 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e6db0d-27ea-4282-9eea-d0cdd62b9bed None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:04:47.311054 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e6db0d-27ea-4282-9eea-d0cdd62b9bed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:04:47.330310 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-b7e6db0d-27ea-4282-9eea-d0cdd62b9bed None None] MFA Rules not processed for user `4ca7e9098815480f89b2a9a8a222ae5e`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:04:47.331554 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-b7e6db0d-27ea-4282-9eea-d0cdd62b9bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:04:47.390856 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1194/2411] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:04:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:04:57.382511 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=25 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:05:06.793846 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c81616d-2072-40d6-9d67-e26bcbeaeae2 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:05:06.795133 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-3c81616d-2072-40d6-9d67-e26bcbeaeae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:05:06.813693 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c81616d-2072-40d6-9d67-e26bcbeaeae2 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:05:06.818321 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe48ce39-2ea7-4fd8-8f00-8a311e1653a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:05:06.818959 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe48ce39-2ea7-4fd8-8f00-8a311e1653a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:05:06.819239 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe48ce39-2ea7-4fd8-8f00-8a311e1653a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:05:06.819514 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe48ce39-2ea7-4fd8-8f00-8a311e1653a8 admin admin] PATH_INFO: `/v3/users/8af33ff52d894cc0b8ea6aec00934e8e` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:05:06.820694 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe48ce39-2ea7-4fd8-8f00-8a311e1653a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8af33ff52d894cc0b8ea6aec00934e8e)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:05:06.822624 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe48ce39-2ea7-4fd8-8f00-8a311e1653a8 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:05:07.015795 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-fe48ce39-2ea7-4fd8-8f00-8a311e1653a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8af33ff52d894cc0b8ea6aec00934e8e'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:05:07.024190 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-fe48ce39-2ea7-4fd8-8f00-8a311e1653a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8af33ff52d894cc0b8ea6aec00934e8e'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:05:07.024901 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-fe48ce39-2ea7-4fd8-8f00-8a311e1653a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8af33ff52d894cc0b8ea6aec00934e8e'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:05:07.038026 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-fe48ce39-2ea7-4fd8-8f00-8a311e1653a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8af33ff52d894cc0b8ea6aec00934e8e'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:05:07.087012 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-fe48ce39-2ea7-4fd8-8f00-8a311e1653a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8af33ff52d894cc0b8ea6aec00934e8e'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:05:07.098347 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1218/2412] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 18 22:05:06 2022] DELETE /identity/v3/users/8af33ff52d894cc0b8ea6aec00934e8e => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:05:07.421711 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e6db0d-27ea-4282-9eea-d0cdd62b9bed None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:05:07.434718 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e6db0d-27ea-4282-9eea-d0cdd62b9bed None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:05:07.525090 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f7bacd-b0d3-4b50-8cab-a4070b1ff656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:05:07.526205 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f7bacd-b0d3-4b50-8cab-a4070b1ff656 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:05:07.526675 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f7bacd-b0d3-4b50-8cab-a4070b1ff656 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:05:07.527108 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f7bacd-b0d3-4b50-8cab-a4070b1ff656 admin admin] PATH_INFO: `/v3/projects/5097a40f10e24ef1bd555ef0d802af11` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:05:07.529033 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f7bacd-b0d3-4b50-8cab-a4070b1ff656 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5097a40f10e24ef1bd555ef0d802af11)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:05:07.532615 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f7bacd-b0d3-4b50-8cab-a4070b1ff656 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:05:07.658410 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-30f7bacd-b0d3-4b50-8cab-a4070b1ff656 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5097a40f10e24ef1bd555ef0d802af11', 'request_id': 'req-30f7bacd-b0d3-4b50-8cab-a4070b1ff656'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:05:07.665348 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-30f7bacd-b0d3-4b50-8cab-a4070b1ff656 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5097a40f10e24ef1bd555ef0d802af11', 'request_id': 'req-30f7bacd-b0d3-4b50-8cab-a4070b1ff656'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:05:07.723556 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-30f7bacd-b0d3-4b50-8cab-a4070b1ff656 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5097a40f10e24ef1bd555ef0d802af11', 'request_id': 'req-30f7bacd-b0d3-4b50-8cab-a4070b1ff656'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:05:07.735331 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-30f7bacd-b0d3-4b50-8cab-a4070b1ff656 admin admin] The token cache is being invalidate because project 5097a40f10e24ef1bd555ef0d802af11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88096) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 22:05:07.735620 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-30f7bacd-b0d3-4b50-8cab-a4070b1ff656 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:05:07.736279 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-30f7bacd-b0d3-4b50-8cab-a4070b1ff656 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:05:07.737801 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1195/2413] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 18 22:05:07 2022] DELETE /identity/v3/projects/5097a40f10e24ef1bd555ef0d802af11 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:05:07.742762 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4120b18-00a2-44f9-9a80-b2d37af06ddb None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:05:07.743126 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4120b18-00a2-44f9-9a80-b2d37af06ddb None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:05:07.743522 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4120b18-00a2-44f9-9a80-b2d37af06ddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:05:07.763922 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-f4120b18-00a2-44f9-9a80-b2d37af06ddb None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:05:07.765176 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-f4120b18-00a2-44f9-9a80-b2d37af06ddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:05:07.827415 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1219/2414] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:05:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 22:05:07.835903 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefc99fa-4882-4e72-af95-f4de71ae92bc None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:05:07.836188 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefc99fa-4882-4e72-af95-f4de71ae92bc None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:05:07.836463 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefc99fa-4882-4e72-af95-f4de71ae92bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:05:07.857130 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-eefc99fa-4882-4e72-af95-f4de71ae92bc None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:05:07.858345 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-eefc99fa-4882-4e72-af95-f4de71ae92bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:05:07.867336 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1196/2415] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:05:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:05:07.871571 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4120b18-00a2-44f9-9a80-b2d37af06ddb None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:05:07.881349 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4120b18-00a2-44f9-9a80-b2d37af06ddb None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:05:07.886427 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c4386b-005f-41f4-a555-eb425711df57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:05:07.887029 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c4386b-005f-41f4-a555-eb425711df57 admin admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:05:07.887306 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c4386b-005f-41f4-a555-eb425711df57 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:05:07.887578 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c4386b-005f-41f4-a555-eb425711df57 admin admin] PATH_INFO: `/v3/domains` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:05:07.888244 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c4386b-005f-41f4-a555-eb425711df57 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 22:05:07.888540 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c4386b-005f-41f4-a555-eb425711df57 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:05:07.890172 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c4386b-005f-41f4-a555-eb425711df57 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:05:07.902366 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1220/2416] 10.222.0.27 () {58 vars in 1153 bytes} [Thu Aug 18 22:05:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 22:05:07.906628 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefc99fa-4882-4e72-af95-f4de71ae92bc None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:05:07.917389 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefc99fa-4882-4e72-af95-f4de71ae92bc None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:05:07.922094 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669a257f-4365-46a7-a336-5b53f93f3815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:05:07.922702 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669a257f-4365-46a7-a336-5b53f93f3815 admin admin] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:05:07.922997 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669a257f-4365-46a7-a336-5b53f93f3815 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:05:07.923256 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669a257f-4365-46a7-a336-5b53f93f3815 admin admin] PATH_INFO: `/v3/projects` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:05:07.923891 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669a257f-4365-46a7-a336-5b53f93f3815 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:05:07.925806 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669a257f-4365-46a7-a336-5b53f93f3815 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:05:08.045866 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1197/2417] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 18 22:05:07 2022] POST /identity/v3/projects => generated 397 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 22:05:08.050262 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c4386b-005f-41f4-a555-eb425711df57 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:05:08.061186 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c4386b-005f-41f4-a555-eb425711df57 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:05:08.119587 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12f4ecd-2fec-4f24-a24a-63dbaad8b836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:05:08.120199 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12f4ecd-2fec-4f24-a24a-63dbaad8b836 admin admin] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:05:08.120475 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12f4ecd-2fec-4f24-a24a-63dbaad8b836 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:05:08.120847 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12f4ecd-2fec-4f24-a24a-63dbaad8b836 admin admin] PATH_INFO: `/v3/users` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:05:08.121479 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12f4ecd-2fec-4f24-a24a-63dbaad8b836 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:05:08.123400 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12f4ecd-2fec-4f24-a24a-63dbaad8b836 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:05:08.132447 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:05:08.247558 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1221/2418] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 18 22:05:08 2022] POST /identity/v3/users => generated 299 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 22:05:08.251646 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669a257f-4365-46a7-a336-5b53f93f3815 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:05:08.263182 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669a257f-4365-46a7-a336-5b53f93f3815 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:05:08.269369 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1712482-1b07-4d45-ae11-29cc32038d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:05:08.269980 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1712482-1b07-4d45-ae11-29cc32038d86 admin admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:05:08.270258 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1712482-1b07-4d45-ae11-29cc32038d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:05:08.270516 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1712482-1b07-4d45-ae11-29cc32038d86 admin admin] PATH_INFO: `/v3/roles` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:05:08.271159 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1712482-1b07-4d45-ae11-29cc32038d86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:05:08.272883 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1712482-1b07-4d45-ae11-29cc32038d86 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:05:08.286087 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1198/2419] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:05:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:05:08.291166 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12f4ecd-2fec-4f24-a24a-63dbaad8b836 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:05:08.302639 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12f4ecd-2fec-4f24-a24a-63dbaad8b836 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:05:08.307447 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd79954d-05b0-4862-87f7-990c08c2f25d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:05:08.308165 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd79954d-05b0-4862-87f7-990c08c2f25d admin admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:05:08.308452 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd79954d-05b0-4862-87f7-990c08c2f25d admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:05:08.308835 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd79954d-05b0-4862-87f7-990c08c2f25d admin admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:05:08.309507 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd79954d-05b0-4862-87f7-990c08c2f25d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:05:08.311110 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd79954d-05b0-4862-87f7-990c08c2f25d admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:05:08.323350 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1222/2420] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:05:08 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:05:08.327533 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1712482-1b07-4d45-ae11-29cc32038d86 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:05:08.338407 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1712482-1b07-4d45-ae11-29cc32038d86 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:05:08.343044 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8748d007-227d-46a3-aa8b-98be03934cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:05:08.343727 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8748d007-227d-46a3-aa8b-98be03934cbf admin admin] REQUEST_METHOD: `PUT` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:05:08.344006 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8748d007-227d-46a3-aa8b-98be03934cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:05:08.344279 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8748d007-227d-46a3-aa8b-98be03934cbf admin admin] PATH_INFO: `/v3/projects/f09d1067a1214efc9762506d6c6c1f4b/users/6fa14c99296244ebad8a7ce8422b2623/roles/de8f2438056f4af9879423f8a59e0e0b` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:05:08.358653 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8748d007-227d-46a3-aa8b-98be03934cbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=f09d1067a1214efc9762506d6c6c1f4b, user_id=6fa14c99296244ebad8a7ce8422b2623, role_id=de8f2438056f4af9879423f8a59e0e0b)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:05:08.363170 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8748d007-227d-46a3-aa8b-98be03934cbf admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:05:08.460835 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1199/2421] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 18 22:05:08 2022] PUT /identity/v3/projects/f09d1067a1214efc9762506d6c6c1f4b/users/6fa14c99296244ebad8a7ce8422b2623/roles/de8f2438056f4af9879423f8a59e0e0b => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:05:08.529481 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4844b137-8d24-4097-830c-3f373611936e None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:05:08.529700 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4844b137-8d24-4097-830c-3f373611936e None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:05:08.529945 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4844b137-8d24-4097-830c-3f373611936e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:05:08.556691 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-4844b137-8d24-4097-830c-3f373611936e None None] MFA Rules not processed for user `6fa14c99296244ebad8a7ce8422b2623`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:05:08.557898 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-4844b137-8d24-4097-830c-3f373611936e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:05:08.621481 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1223/2422] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:05:08 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:05:08.633617 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8748d007-227d-46a3-aa8b-98be03934cbf admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:05:08.635233 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-8748d007-227d-46a3-aa8b-98be03934cbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:05:08.668783 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:05:08.698926 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8748d007-227d-46a3-aa8b-98be03934cbf admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:05:08.704929 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bebd22-12e6-4242-b9f7-cc864652f225 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22b6a7c36f8a4795a75271b8079821c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:05:08.705588 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bebd22-12e6-4242-b9f7-cc864652f225 service cinder] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:05:08.705868 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bebd22-12e6-4242-b9f7-cc864652f225 service cinder] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:05:08.706140 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bebd22-12e6-4242-b9f7-cc864652f225 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:05:08.715943 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bebd22-12e6-4242-b9f7-cc864652f225 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:05:08.718421 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bebd22-12e6-4242-b9f7-cc864652f225 service cinder] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:05:08.727126 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1200/2423] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:05:08 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:05:14.646096 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4844b137-8d24-4097-830c-3f373611936e None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:05:14.712722 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4844b137-8d24-4097-830c-3f373611936e None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:05:14.717468 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b363a697-b07a-4c45-a768-5da8356394cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:05:14.718229 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b363a697-b07a-4c45-a768-5da8356394cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:05:14.718518 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b363a697-b07a-4c45-a768-5da8356394cc admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:05:14.718795 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b363a697-b07a-4c45-a768-5da8356394cc admin admin] PATH_INFO: `/v3/users/6fa14c99296244ebad8a7ce8422b2623` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:05:14.719919 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b363a697-b07a-4c45-a768-5da8356394cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=6fa14c99296244ebad8a7ce8422b2623)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:05:14.721916 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b363a697-b07a-4c45-a768-5da8356394cc admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:05:14.910215 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-b363a697-b07a-4c45-a768-5da8356394cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6fa14c99296244ebad8a7ce8422b2623'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:05:14.917439 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-b363a697-b07a-4c45-a768-5da8356394cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6fa14c99296244ebad8a7ce8422b2623'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:05:14.918129 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-b363a697-b07a-4c45-a768-5da8356394cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6fa14c99296244ebad8a7ce8422b2623'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:05:14.929130 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:INSERT=3,keystone:SELECT=89,keystone:DELETE=8 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:05:14.931468 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-b363a697-b07a-4c45-a768-5da8356394cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6fa14c99296244ebad8a7ce8422b2623'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:05:14.994800 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-b363a697-b07a-4c45-a768-5da8356394cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6fa14c99296244ebad8a7ce8422b2623'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:05:15.001237 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1224/2424] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 18 22:05:14 2022] DELETE /identity/v3/users/6fa14c99296244ebad8a7ce8422b2623 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:05:15.005856 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51df3110-b71d-4c30-8c4f-90ada583a549 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:05:15.006350 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51df3110-b71d-4c30-8c4f-90ada583a549 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:05:15.006464 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51df3110-b71d-4c30-8c4f-90ada583a549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:05:15.027026 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-51df3110-b71d-4c30-8c4f-90ada583a549 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:05:15.028176 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-51df3110-b71d-4c30-8c4f-90ada583a549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:05:15.089410 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1201/2425] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:05:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 22:05:15.099106 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b363a697-b07a-4c45-a768-5da8356394cc admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:05:15.100674 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-b363a697-b07a-4c45-a768-5da8356394cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:05:15.161255 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b363a697-b07a-4c45-a768-5da8356394cc admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:05:15.165925 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e54c33-b8d4-4e56-9194-94339508a707 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a937971ad1a4b0c8697c764f214d446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:05:15.166390 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e54c33-b8d4-4e56-9194-94339508a707 service neutron] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:05:15.166748 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e54c33-b8d4-4e56-9194-94339508a707 service neutron] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:05:15.167106 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e54c33-b8d4-4e56-9194-94339508a707 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:05:15.180719 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e54c33-b8d4-4e56-9194-94339508a707 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:05:15.182259 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e54c33-b8d4-4e56-9194-94339508a707 service neutron] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:05:15.192391 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1225/2426] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:05:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:05:15.799958 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51df3110-b71d-4c30-8c4f-90ada583a549 None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:05:15.801714 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-51df3110-b71d-4c30-8c4f-90ada583a549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:05:15.830930 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51df3110-b71d-4c30-8c4f-90ada583a549 None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:05:15.839278 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459e4f11-6f1c-4493-bb1a-12f8695488d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:05:15.840348 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459e4f11-6f1c-4493-bb1a-12f8695488d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:05:15.840837 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459e4f11-6f1c-4493-bb1a-12f8695488d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:05:15.841319 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459e4f11-6f1c-4493-bb1a-12f8695488d8 admin admin] PATH_INFO: `/v3/projects/f09d1067a1214efc9762506d6c6c1f4b` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:05:15.843045 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459e4f11-6f1c-4493-bb1a-12f8695488d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f09d1067a1214efc9762506d6c6c1f4b)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:05:15.846228 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459e4f11-6f1c-4493-bb1a-12f8695488d8 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:05:15.980313 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-459e4f11-6f1c-4493-bb1a-12f8695488d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f09d1067a1214efc9762506d6c6c1f4b', 'request_id': 'req-459e4f11-6f1c-4493-bb1a-12f8695488d8'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:05:15.985802 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-459e4f11-6f1c-4493-bb1a-12f8695488d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f09d1067a1214efc9762506d6c6c1f4b', 'request_id': 'req-459e4f11-6f1c-4493-bb1a-12f8695488d8'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:05:16.052158 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-459e4f11-6f1c-4493-bb1a-12f8695488d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f09d1067a1214efc9762506d6c6c1f4b', 'request_id': 'req-459e4f11-6f1c-4493-bb1a-12f8695488d8'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:05:16.064563 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-459e4f11-6f1c-4493-bb1a-12f8695488d8 admin admin] The token cache is being invalidate because project f09d1067a1214efc9762506d6c6c1f4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88096) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 22:05:16.064874 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-459e4f11-6f1c-4493-bb1a-12f8695488d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:05:16.065515 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-459e4f11-6f1c-4493-bb1a-12f8695488d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:05:16.066992 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1202/2427] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 18 22:05:15 2022] DELETE /identity/v3/projects/f09d1067a1214efc9762506d6c6c1f4b => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:05:17.561724 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e54c33-b8d4-4e56-9194-94339508a707 service neutron] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:05:17.563753 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-79e54c33-b8d4-4e56-9194-94339508a707 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:05:17.578933 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e54c33-b8d4-4e56-9194-94339508a707 service neutron] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:05:17.638729 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7876b2c-1ebd-4316-9fa9-791aef40990b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:05:17.639362 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7876b2c-1ebd-4316-9fa9-791aef40990b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:05:17.639671 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7876b2c-1ebd-4316-9fa9-791aef40990b admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:05:17.639948 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7876b2c-1ebd-4316-9fa9-791aef40990b admin admin] PATH_INFO: `/v3/users/886cb8649faf4bbdb7e290915b6c275d` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:05:17.641114 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7876b2c-1ebd-4316-9fa9-791aef40990b admin admin] RBAC: Authorizing `identity:delete_user(user_id=886cb8649faf4bbdb7e290915b6c275d)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:05:17.643398 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7876b2c-1ebd-4316-9fa9-791aef40990b admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:05:17.802749 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-d7876b2c-1ebd-4316-9fa9-791aef40990b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '886cb8649faf4bbdb7e290915b6c275d'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:05:17.809771 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-d7876b2c-1ebd-4316-9fa9-791aef40990b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '886cb8649faf4bbdb7e290915b6c275d'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:05:17.810454 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-d7876b2c-1ebd-4316-9fa9-791aef40990b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '886cb8649faf4bbdb7e290915b6c275d'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:05:17.823124 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-d7876b2c-1ebd-4316-9fa9-791aef40990b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '886cb8649faf4bbdb7e290915b6c275d'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:05:17.899714 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-d7876b2c-1ebd-4316-9fa9-791aef40990b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '886cb8649faf4bbdb7e290915b6c275d'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:05:17.906296 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1226/2428] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 18 22:05:17 2022] DELETE /identity/v3/users/886cb8649faf4bbdb7e290915b6c275d => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:05:18.156496 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459e4f11-6f1c-4493-bb1a-12f8695488d8 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:05:18.159776 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-459e4f11-6f1c-4493-bb1a-12f8695488d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:05:18.173630 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459e4f11-6f1c-4493-bb1a-12f8695488d8 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:05:18.223566 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:05:18.233271 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22382c6f-08cc-4c3b-8499-e47774a0884d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:05:18.233893 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22382c6f-08cc-4c3b-8499-e47774a0884d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:05:18.234170 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22382c6f-08cc-4c3b-8499-e47774a0884d admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:05:18.234459 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22382c6f-08cc-4c3b-8499-e47774a0884d admin admin] PATH_INFO: `/v3/projects/bc871498a7ce438f8e3346fedb2f6c1d` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:05:18.240794 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22382c6f-08cc-4c3b-8499-e47774a0884d admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc871498a7ce438f8e3346fedb2f6c1d)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:05:18.243171 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22382c6f-08cc-4c3b-8499-e47774a0884d admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:05:18.334780 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-22382c6f-08cc-4c3b-8499-e47774a0884d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc871498a7ce438f8e3346fedb2f6c1d', 'request_id': 'req-22382c6f-08cc-4c3b-8499-e47774a0884d'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:05:18.340741 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-22382c6f-08cc-4c3b-8499-e47774a0884d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc871498a7ce438f8e3346fedb2f6c1d', 'request_id': 'req-22382c6f-08cc-4c3b-8499-e47774a0884d'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:05:18.402828 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-22382c6f-08cc-4c3b-8499-e47774a0884d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc871498a7ce438f8e3346fedb2f6c1d', 'request_id': 'req-22382c6f-08cc-4c3b-8499-e47774a0884d'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:05:18.414613 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-22382c6f-08cc-4c3b-8499-e47774a0884d admin admin] The token cache is being invalidate because project bc871498a7ce438f8e3346fedb2f6c1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88096) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 22:05:18.414897 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-22382c6f-08cc-4c3b-8499-e47774a0884d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:05:18.415521 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-22382c6f-08cc-4c3b-8499-e47774a0884d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:05:18.417023 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1203/2429] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 18 22:05:18 2022] DELETE /identity/v3/projects/bc871498a7ce438f8e3346fedb2f6c1d => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:05:18.422085 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c7bb3c-2dd8-421d-9133-70189030029c None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:05:18.422373 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c7bb3c-2dd8-421d-9133-70189030029c None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:05:18.422677 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c7bb3c-2dd8-421d-9133-70189030029c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:05:18.442183 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-e3c7bb3c-2dd8-421d-9133-70189030029c None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:05:18.443465 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-e3c7bb3c-2dd8-421d-9133-70189030029c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:05:18.447816 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:05:18.503826 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1227/2430] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:05:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:05:18.512261 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3ada5f-48e8-496a-a8dd-d671170a651d None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:05:18.512546 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3ada5f-48e8-496a-a8dd-d671170a651d None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:05:18.512851 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3ada5f-48e8-496a-a8dd-d671170a651d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:05:18.533116 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-ac3ada5f-48e8-496a-a8dd-d671170a651d None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:05:18.534322 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-ac3ada5f-48e8-496a-a8dd-d671170a651d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:05:18.542258 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1204/2431] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:05:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:05:18.546422 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c7bb3c-2dd8-421d-9133-70189030029c None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:05:18.556189 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c7bb3c-2dd8-421d-9133-70189030029c None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:05:18.561064 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f5f25e-a2ed-41c8-9d91-53ec60abf976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:05:18.561660 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f5f25e-a2ed-41c8-9d91-53ec60abf976 admin admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:05:18.561939 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f5f25e-a2ed-41c8-9d91-53ec60abf976 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:05:18.562490 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f5f25e-a2ed-41c8-9d91-53ec60abf976 admin admin] PATH_INFO: `/v3/domains` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:05:18.562841 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f5f25e-a2ed-41c8-9d91-53ec60abf976 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 22:05:18.563140 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f5f25e-a2ed-41c8-9d91-53ec60abf976 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:05:18.564751 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f5f25e-a2ed-41c8-9d91-53ec60abf976 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:05:18.576766 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1228/2432] 10.222.0.27 () {58 vars in 1153 bytes} [Thu Aug 18 22:05:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 22:05:18.581006 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3ada5f-48e8-496a-a8dd-d671170a651d None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:05:18.591042 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3ada5f-48e8-496a-a8dd-d671170a651d None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:05:18.595848 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a828b714-377a-471f-bd2c-7e04f7ecf3f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:05:18.596443 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a828b714-377a-471f-bd2c-7e04f7ecf3f3 admin admin] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:05:18.596756 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a828b714-377a-471f-bd2c-7e04f7ecf3f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:05:18.597029 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a828b714-377a-471f-bd2c-7e04f7ecf3f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:05:18.597643 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a828b714-377a-471f-bd2c-7e04f7ecf3f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:05:18.599571 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a828b714-377a-471f-bd2c-7e04f7ecf3f3 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:05:18.675949 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1205/2433] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 18 22:05:18 2022] POST /identity/v3/projects => generated 385 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 22:05:18.680133 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f5f25e-a2ed-41c8-9d91-53ec60abf976 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:05:18.690152 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f5f25e-a2ed-41c8-9d91-53ec60abf976 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:05:18.746046 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a7ceed-5bc8-4d85-af94-8619265d93b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:05:18.746647 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a7ceed-5bc8-4d85-af94-8619265d93b4 admin admin] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:05:18.746925 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a7ceed-5bc8-4d85-af94-8619265d93b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:05:18.747199 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a7ceed-5bc8-4d85-af94-8619265d93b4 admin admin] PATH_INFO: `/v3/users` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:05:18.747852 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a7ceed-5bc8-4d85-af94-8619265d93b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:05:18.749802 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a7ceed-5bc8-4d85-af94-8619265d93b4 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:05:18.820420 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1229/2434] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 18 22:05:18 2022] POST /identity/v3/users => generated 293 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 22:05:18.824665 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a828b714-377a-471f-bd2c-7e04f7ecf3f3 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:05:18.835611 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a828b714-377a-471f-bd2c-7e04f7ecf3f3 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:05:18.841061 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3af822-3ff7-4771-acfb-b828f1e47e4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:05:18.841687 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3af822-3ff7-4771-acfb-b828f1e47e4b admin admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:05:18.841965 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3af822-3ff7-4771-acfb-b828f1e47e4b admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:05:18.842232 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3af822-3ff7-4771-acfb-b828f1e47e4b admin admin] PATH_INFO: `/v3/roles` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:05:18.842867 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3af822-3ff7-4771-acfb-b828f1e47e4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:05:18.844514 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3af822-3ff7-4771-acfb-b828f1e47e4b admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:05:18.854770 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1206/2435] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:05:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:05:18.858652 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a7ceed-5bc8-4d85-af94-8619265d93b4 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:05:18.868894 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a7ceed-5bc8-4d85-af94-8619265d93b4 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:05:18.873493 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59badde-c8ee-4786-81e9-5af582737cf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:05:18.874083 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59badde-c8ee-4786-81e9-5af582737cf6 admin admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:05:18.874365 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59badde-c8ee-4786-81e9-5af582737cf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:05:18.874640 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59badde-c8ee-4786-81e9-5af582737cf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:05:18.875277 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59badde-c8ee-4786-81e9-5af582737cf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:05:18.876927 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59badde-c8ee-4786-81e9-5af582737cf6 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:05:18.889173 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1230/2436] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:05:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:05:18.893632 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3af822-3ff7-4771-acfb-b828f1e47e4b admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:05:18.904080 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3af822-3ff7-4771-acfb-b828f1e47e4b admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:05:18.908716 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994fda73-6005-462b-8a6d-01dc4c191d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:05:18.909359 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994fda73-6005-462b-8a6d-01dc4c191d37 admin admin] REQUEST_METHOD: `PUT` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:05:18.909645 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994fda73-6005-462b-8a6d-01dc4c191d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:05:18.909920 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994fda73-6005-462b-8a6d-01dc4c191d37 admin admin] PATH_INFO: `/v3/projects/92e499e16c0a4b7aa9ebf6af26dd29a7/users/43f6494dccba42f4a3c3608be0733374/roles/de8f2438056f4af9879423f8a59e0e0b` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:05:18.925321 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994fda73-6005-462b-8a6d-01dc4c191d37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92e499e16c0a4b7aa9ebf6af26dd29a7, user_id=43f6494dccba42f4a3c3608be0733374, role_id=de8f2438056f4af9879423f8a59e0e0b)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:05:18.928036 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994fda73-6005-462b-8a6d-01dc4c191d37 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:05:18.992029 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1207/2437] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 18 22:05:18 2022] PUT /identity/v3/projects/92e499e16c0a4b7aa9ebf6af26dd29a7/users/43f6494dccba42f4a3c3608be0733374/roles/de8f2438056f4af9879423f8a59e0e0b => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:05:19.002628 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a5790b-bc8c-4607-9cb4-0b729478a6b2 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:05:19.002999 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a5790b-bc8c-4607-9cb4-0b729478a6b2 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:05:19.003341 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a5790b-bc8c-4607-9cb4-0b729478a6b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:05:19.031379 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-e3a5790b-bc8c-4607-9cb4-0b729478a6b2 None None] MFA Rules not processed for user `43f6494dccba42f4a3c3608be0733374`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:05:19.032668 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-e3a5790b-bc8c-4607-9cb4-0b729478a6b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:05:19.094501 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1231/2438] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:05:19 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:05:19.099069 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994fda73-6005-462b-8a6d-01dc4c191d37 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:05:19.160092 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994fda73-6005-462b-8a6d-01dc4c191d37 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:05:19.164894 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bbcdb5-a3e9-45f6-9cb0-7acadf2e39f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:05:19.165495 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bbcdb5-a3e9-45f6-9cb0-7acadf2e39f4 admin admin] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:05:19.165771 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bbcdb5-a3e9-45f6-9cb0-7acadf2e39f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:05:19.166043 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bbcdb5-a3e9-45f6-9cb0-7acadf2e39f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:05:19.166656 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bbcdb5-a3e9-45f6-9cb0-7acadf2e39f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:05:19.168525 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bbcdb5-a3e9-45f6-9cb0-7acadf2e39f4 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:05:19.242921 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1208/2439] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 18 22:05:19 2022] POST /identity/v3/projects => generated 385 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 22:05:19.246966 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a5790b-bc8c-4607-9cb4-0b729478a6b2 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:05:19.253608 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:05:19.258946 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a5790b-bc8c-4607-9cb4-0b729478a6b2 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:05:19.317950 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3a8b08-0d7c-4bf5-8a63-268485822bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:05:19.322761 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3a8b08-0d7c-4bf5-8a63-268485822bce admin admin] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:05:19.322761 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3a8b08-0d7c-4bf5-8a63-268485822bce admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:05:19.322761 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3a8b08-0d7c-4bf5-8a63-268485822bce admin admin] PATH_INFO: `/v3/users` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:05:19.322761 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3a8b08-0d7c-4bf5-8a63-268485822bce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:05:19.322761 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3a8b08-0d7c-4bf5-8a63-268485822bce admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:05:19.385621 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1232/2440] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 18 22:05:19 2022] POST /identity/v3/users => generated 299 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 22:05:19.389619 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bbcdb5-a3e9-45f6-9cb0-7acadf2e39f4 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:05:19.396740 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:05:19.400794 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bbcdb5-a3e9-45f6-9cb0-7acadf2e39f4 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:05:19.405518 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459aebb8-d362-4640-a7c0-2ed8ae8f9bf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:05:19.406109 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459aebb8-d362-4640-a7c0-2ed8ae8f9bf2 admin admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:05:19.406385 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459aebb8-d362-4640-a7c0-2ed8ae8f9bf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:05:19.406653 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459aebb8-d362-4640-a7c0-2ed8ae8f9bf2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:05:19.407285 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459aebb8-d362-4640-a7c0-2ed8ae8f9bf2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:05:19.408898 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459aebb8-d362-4640-a7c0-2ed8ae8f9bf2 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:05:19.419814 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1209/2441] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:05:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 22:05:19.424023 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3a8b08-0d7c-4bf5-8a63-268485822bce admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:05:19.434788 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3a8b08-0d7c-4bf5-8a63-268485822bce admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:05:19.439483 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb3cb23-628b-4b20-b0c5-db447ec2bf52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:05:19.440122 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb3cb23-628b-4b20-b0c5-db447ec2bf52 admin admin] REQUEST_METHOD: `PUT` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:05:19.440404 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb3cb23-628b-4b20-b0c5-db447ec2bf52 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:05:19.440716 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb3cb23-628b-4b20-b0c5-db447ec2bf52 admin admin] PATH_INFO: `/v3/projects/7a1f95af59e6450489653692b98857a9/users/bab3235f825e479998c20d056746da16/roles/0833202e2a3d47d1b6b3af57006641b1` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:05:19.455231 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb3cb23-628b-4b20-b0c5-db447ec2bf52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a1f95af59e6450489653692b98857a9, user_id=bab3235f825e479998c20d056746da16, role_id=0833202e2a3d47d1b6b3af57006641b1)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:05:19.457993 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb3cb23-628b-4b20-b0c5-db447ec2bf52 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:05:19.571864 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1233/2442] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 18 22:05:19 2022] PUT /identity/v3/projects/7a1f95af59e6450489653692b98857a9/users/bab3235f825e479998c20d056746da16/roles/0833202e2a3d47d1b6b3af57006641b1 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:05:19.575791 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459aebb8-d362-4640-a7c0-2ed8ae8f9bf2 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:05:19.585794 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459aebb8-d362-4640-a7c0-2ed8ae8f9bf2 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:05:19.644794 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c536670-afb1-4cb4-80c4-d189616ddbb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:05:19.645433 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c536670-afb1-4cb4-80c4-d189616ddbb5 admin admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:05:19.645716 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c536670-afb1-4cb4-80c4-d189616ddbb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:05:19.646044 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c536670-afb1-4cb4-80c4-d189616ddbb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:05:19.646688 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c536670-afb1-4cb4-80c4-d189616ddbb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:05:19.648919 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c536670-afb1-4cb4-80c4-d189616ddbb5 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:05:19.658696 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1210/2443] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:05:19 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:05:19.663736 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb3cb23-628b-4b20-b0c5-db447ec2bf52 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:05:19.674729 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb3cb23-628b-4b20-b0c5-db447ec2bf52 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:05:19.679771 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9db2080-886e-41dd-bb82-01d88fcd09ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:05:19.680417 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9db2080-886e-41dd-bb82-01d88fcd09ce admin admin] REQUEST_METHOD: `PUT` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:05:19.680732 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9db2080-886e-41dd-bb82-01d88fcd09ce admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:05:19.681012 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9db2080-886e-41dd-bb82-01d88fcd09ce admin admin] PATH_INFO: `/v3/projects/7a1f95af59e6450489653692b98857a9/users/bab3235f825e479998c20d056746da16/roles/0833202e2a3d47d1b6b3af57006641b1` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:05:19.683018 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9db2080-886e-41dd-bb82-01d88fcd09ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a1f95af59e6450489653692b98857a9, user_id=bab3235f825e479998c20d056746da16, role_id=0833202e2a3d47d1b6b3af57006641b1)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:05:19.685740 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9db2080-886e-41dd-bb82-01d88fcd09ce admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:05:19.696126 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1234/2444] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 18 22:05:19 2022] PUT /identity/v3/projects/7a1f95af59e6450489653692b98857a9/users/bab3235f825e479998c20d056746da16/roles/0833202e2a3d47d1b6b3af57006641b1 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:05:19.707803 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfed5f4-1ff1-429d-9fa7-4f35e096a11b None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:05:19.708089 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfed5f4-1ff1-429d-9fa7-4f35e096a11b None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:05:19.708365 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfed5f4-1ff1-429d-9fa7-4f35e096a11b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:05:19.736812 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-6dfed5f4-1ff1-429d-9fa7-4f35e096a11b None None] MFA Rules not processed for user `bab3235f825e479998c20d056746da16`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:05:19.738006 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-6dfed5f4-1ff1-429d-9fa7-4f35e096a11b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:05:19.806317 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1211/2445] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:05:19 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:05:19.817536 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9db2080-886e-41dd-bb82-01d88fcd09ce admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:05:19.819265 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-e9db2080-886e-41dd-bb82-01d88fcd09ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:05:19.876274 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9db2080-886e-41dd-bb82-01d88fcd09ce admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:05:19.879955 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4e82de-1e1c-48d3-b39f-7efab99f4528 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22b6a7c36f8a4795a75271b8079821c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:05:19.880576 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4e82de-1e1c-48d3-b39f-7efab99f4528 service cinder] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:05:19.880866 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4e82de-1e1c-48d3-b39f-7efab99f4528 service cinder] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:05:19.881141 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4e82de-1e1c-48d3-b39f-7efab99f4528 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:05:19.890359 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4e82de-1e1c-48d3-b39f-7efab99f4528 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:05:19.891804 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4e82de-1e1c-48d3-b39f-7efab99f4528 service cinder] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:05:19.902464 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1235/2446] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:05:19 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:05:19.930741 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfed5f4-1ff1-429d-9fa7-4f35e096a11b None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:05:19.992898 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfed5f4-1ff1-429d-9fa7-4f35e096a11b None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:05:19.997795 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461e53d4-dbc2-490e-a588-ed97c08a6c82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:05:19.998427 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461e53d4-dbc2-490e-a588-ed97c08a6c82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:05:20.014080 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461e53d4-dbc2-490e-a588-ed97c08a6c82 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:05:20.014080 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461e53d4-dbc2-490e-a588-ed97c08a6c82 admin admin] PATH_INFO: `/v3/users/43f6494dccba42f4a3c3608be0733374` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:05:20.014080 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461e53d4-dbc2-490e-a588-ed97c08a6c82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43f6494dccba42f4a3c3608be0733374)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:05:20.014080 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461e53d4-dbc2-490e-a588-ed97c08a6c82 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:05:20.018049 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:05:20.154790 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-461e53d4-dbc2-490e-a588-ed97c08a6c82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43f6494dccba42f4a3c3608be0733374'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:05:20.161606 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-461e53d4-dbc2-490e-a588-ed97c08a6c82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43f6494dccba42f4a3c3608be0733374'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:05:20.162334 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-461e53d4-dbc2-490e-a588-ed97c08a6c82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43f6494dccba42f4a3c3608be0733374'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:05:20.162959 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-461e53d4-dbc2-490e-a588-ed97c08a6c82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43f6494dccba42f4a3c3608be0733374'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:05:20.175427 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-461e53d4-dbc2-490e-a588-ed97c08a6c82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43f6494dccba42f4a3c3608be0733374'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:05:20.265641 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1212/2447] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 18 22:05:19 2022] DELETE /identity/v3/users/43f6494dccba42f4a3c3608be0733374 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 22:05:20.270464 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a372f7-f545-4c42-898a-cdbc7bc28704 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:05:20.270754 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a372f7-f545-4c42-898a-cdbc7bc28704 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:05:20.271033 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a372f7-f545-4c42-898a-cdbc7bc28704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:05:20.290929 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-e3a372f7-f545-4c42-898a-cdbc7bc28704 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:05:20.292142 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-e3a372f7-f545-4c42-898a-cdbc7bc28704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:05:20.342418 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:05:20.350377 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1236/2448] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:05:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 22:05:20.360287 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461e53d4-dbc2-490e-a588-ed97c08a6c82 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:05:20.361713 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-461e53d4-dbc2-490e-a588-ed97c08a6c82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:05:20.419528 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461e53d4-dbc2-490e-a588-ed97c08a6c82 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:05:20.423216 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6b7405-281d-48d3-bab5-b2794527fb62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a937971ad1a4b0c8697c764f214d446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:05:20.423822 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6b7405-281d-48d3-bab5-b2794527fb62 service neutron] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:05:20.424103 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6b7405-281d-48d3-bab5-b2794527fb62 service neutron] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:05:20.424376 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6b7405-281d-48d3-bab5-b2794527fb62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:05:20.433729 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6b7405-281d-48d3-bab5-b2794527fb62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:05:20.435157 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6b7405-281d-48d3-bab5-b2794527fb62 service neutron] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:05:20.445110 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1213/2449] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:05:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:05:20.844722 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a372f7-f545-4c42-898a-cdbc7bc28704 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:05:20.846542 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-e3a372f7-f545-4c42-898a-cdbc7bc28704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:05:20.860710 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a372f7-f545-4c42-898a-cdbc7bc28704 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:05:20.865572 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23610078-175a-464b-81c2-7cda8cd3698b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:05:20.866859 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23610078-175a-464b-81c2-7cda8cd3698b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:05:20.867150 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23610078-175a-464b-81c2-7cda8cd3698b admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:05:20.868759 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23610078-175a-464b-81c2-7cda8cd3698b admin admin] PATH_INFO: `/v3/projects/92e499e16c0a4b7aa9ebf6af26dd29a7` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:05:20.868759 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23610078-175a-464b-81c2-7cda8cd3698b admin admin] RBAC: Authorizing `identity:delete_project(project_id=92e499e16c0a4b7aa9ebf6af26dd29a7)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:05:20.870531 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23610078-175a-464b-81c2-7cda8cd3698b admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:05:21.005005 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-23610078-175a-464b-81c2-7cda8cd3698b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92e499e16c0a4b7aa9ebf6af26dd29a7', 'request_id': 'req-23610078-175a-464b-81c2-7cda8cd3698b'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:05:21.014964 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-23610078-175a-464b-81c2-7cda8cd3698b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92e499e16c0a4b7aa9ebf6af26dd29a7', 'request_id': 'req-23610078-175a-464b-81c2-7cda8cd3698b'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:05:21.083569 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-23610078-175a-464b-81c2-7cda8cd3698b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92e499e16c0a4b7aa9ebf6af26dd29a7', 'request_id': 'req-23610078-175a-464b-81c2-7cda8cd3698b'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:05:21.096391 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-23610078-175a-464b-81c2-7cda8cd3698b admin admin] The token cache is being invalidate because project 92e499e16c0a4b7aa9ebf6af26dd29a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88097) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 22:05:21.096930 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-23610078-175a-464b-81c2-7cda8cd3698b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:05:21.097992 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-23610078-175a-464b-81c2-7cda8cd3698b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:05:21.101200 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1237/2450] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 18 22:05:20 2022] DELETE /identity/v3/projects/92e499e16c0a4b7aa9ebf6af26dd29a7 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:05:21.105920 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6b7405-281d-48d3-bab5-b2794527fb62 service neutron] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:05:21.120354 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6b7405-281d-48d3-bab5-b2794527fb62 service neutron] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:05:21.185716 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f2229e-8d71-452e-a928-38c3736b2215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:05:21.186631 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f2229e-8d71-452e-a928-38c3736b2215 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:05:21.186631 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f2229e-8d71-452e-a928-38c3736b2215 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:05:21.186877 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f2229e-8d71-452e-a928-38c3736b2215 admin admin] PATH_INFO: `/v3/users/bab3235f825e479998c20d056746da16` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:05:21.188019 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f2229e-8d71-452e-a928-38c3736b2215 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bab3235f825e479998c20d056746da16)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:05:21.189964 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f2229e-8d71-452e-a928-38c3736b2215 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:05:21.404114 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:05:21.410390 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-33f2229e-8d71-452e-a928-38c3736b2215 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bab3235f825e479998c20d056746da16'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:05:21.418578 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-33f2229e-8d71-452e-a928-38c3736b2215 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bab3235f825e479998c20d056746da16'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:05:21.419252 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-33f2229e-8d71-452e-a928-38c3736b2215 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bab3235f825e479998c20d056746da16'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:05:21.420107 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-33f2229e-8d71-452e-a928-38c3736b2215 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bab3235f825e479998c20d056746da16'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:05:21.432517 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-33f2229e-8d71-452e-a928-38c3736b2215 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bab3235f825e479998c20d056746da16'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:05:21.521899 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1214/2451] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 18 22:05:21 2022] DELETE /identity/v3/users/bab3235f825e479998c20d056746da16 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:05:21.988012 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23610078-175a-464b-81c2-7cda8cd3698b admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:05:21.989878 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-23610078-175a-464b-81c2-7cda8cd3698b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:05:22.003734 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23610078-175a-464b-81c2-7cda8cd3698b admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:05:22.061584 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e49a630-f38c-48b2-9639-6e12badcdc53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:05:22.062128 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e49a630-f38c-48b2-9639-6e12badcdc53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:05:22.062405 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e49a630-f38c-48b2-9639-6e12badcdc53 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:05:22.062677 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e49a630-f38c-48b2-9639-6e12badcdc53 admin admin] PATH_INFO: `/v3/projects/7a1f95af59e6450489653692b98857a9` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:05:22.063765 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e49a630-f38c-48b2-9639-6e12badcdc53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a1f95af59e6450489653692b98857a9)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:05:22.065726 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e49a630-f38c-48b2-9639-6e12badcdc53 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:05:22.174063 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-0e49a630-f38c-48b2-9639-6e12badcdc53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a1f95af59e6450489653692b98857a9', 'request_id': 'req-0e49a630-f38c-48b2-9639-6e12badcdc53'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:05:22.180238 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-0e49a630-f38c-48b2-9639-6e12badcdc53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a1f95af59e6450489653692b98857a9', 'request_id': 'req-0e49a630-f38c-48b2-9639-6e12badcdc53'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:05:22.248411 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-0e49a630-f38c-48b2-9639-6e12badcdc53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a1f95af59e6450489653692b98857a9', 'request_id': 'req-0e49a630-f38c-48b2-9639-6e12badcdc53'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:05:22.260364 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-0e49a630-f38c-48b2-9639-6e12badcdc53 admin admin] The token cache is being invalidate because project 7a1f95af59e6450489653692b98857a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88097) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 22:05:22.260680 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-0e49a630-f38c-48b2-9639-6e12badcdc53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:05:22.261581 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-0e49a630-f38c-48b2-9639-6e12badcdc53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:05:22.263133 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1238/2452] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 18 22:05:21 2022] DELETE /identity/v3/projects/7a1f95af59e6450489653692b98857a9 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:05:22.269386 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb56383-e976-4f42-90d4-d45e2d1b197a None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:05:22.269941 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb56383-e976-4f42-90d4-d45e2d1b197a None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:05:22.269941 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb56383-e976-4f42-90d4-d45e2d1b197a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:05:22.289937 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-5fb56383-e976-4f42-90d4-d45e2d1b197a None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:05:22.291137 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-5fb56383-e976-4f42-90d4-d45e2d1b197a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:05:22.350425 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1215/2453] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:05:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:05:22.357966 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622497d2-edd6-438d-b551-9f38a8594274 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:05:22.358254 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622497d2-edd6-438d-b551-9f38a8594274 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:05:22.358533 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622497d2-edd6-438d-b551-9f38a8594274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:05:22.379167 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-622497d2-edd6-438d-b551-9f38a8594274 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:05:22.380388 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-622497d2-edd6-438d-b551-9f38a8594274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:05:22.388774 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1239/2454] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:05:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:05:22.393350 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb56383-e976-4f42-90d4-d45e2d1b197a None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:05:22.403456 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb56383-e976-4f42-90d4-d45e2d1b197a None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:05:22.407995 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424eb928-1f7c-4073-a8e0-31ca01db6c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:05:22.408618 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424eb928-1f7c-4073-a8e0-31ca01db6c9c admin admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:05:22.408903 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424eb928-1f7c-4073-a8e0-31ca01db6c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:05:22.409175 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424eb928-1f7c-4073-a8e0-31ca01db6c9c admin admin] PATH_INFO: `/v3/domains` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:05:22.409814 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424eb928-1f7c-4073-a8e0-31ca01db6c9c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 22:05:22.410114 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424eb928-1f7c-4073-a8e0-31ca01db6c9c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:05:22.411706 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424eb928-1f7c-4073-a8e0-31ca01db6c9c admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:05:22.423148 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1216/2455] 10.222.0.27 () {58 vars in 1153 bytes} [Thu Aug 18 22:05:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 22:05:22.427390 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622497d2-edd6-438d-b551-9f38a8594274 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:05:22.436477 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622497d2-edd6-438d-b551-9f38a8594274 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:05:22.441098 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dc32b6-3b56-42f4-a278-3df7a1edad56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:05:22.441702 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dc32b6-3b56-42f4-a278-3df7a1edad56 admin admin] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:05:22.441978 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dc32b6-3b56-42f4-a278-3df7a1edad56 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:05:22.442255 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dc32b6-3b56-42f4-a278-3df7a1edad56 admin admin] PATH_INFO: `/v3/projects` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:05:22.442863 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dc32b6-3b56-42f4-a278-3df7a1edad56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:05:22.444787 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dc32b6-3b56-42f4-a278-3df7a1edad56 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:05:22.449944 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:05:22.534945 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1240/2456] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 18 22:05:22 2022] POST /identity/v3/projects => generated 371 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 22:05:22.539258 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424eb928-1f7c-4073-a8e0-31ca01db6c9c admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:05:22.549289 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424eb928-1f7c-4073-a8e0-31ca01db6c9c admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:05:22.605387 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3765ee88-7f38-4f81-b80a-1d9a1955ca29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:05:22.605917 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3765ee88-7f38-4f81-b80a-1d9a1955ca29 admin admin] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:05:22.606201 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3765ee88-7f38-4f81-b80a-1d9a1955ca29 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:05:22.606474 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3765ee88-7f38-4f81-b80a-1d9a1955ca29 admin admin] PATH_INFO: `/v3/users` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:05:22.607103 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3765ee88-7f38-4f81-b80a-1d9a1955ca29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:05:22.609037 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3765ee88-7f38-4f81-b80a-1d9a1955ca29 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:05:22.711190 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1217/2457] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 18 22:05:22 2022] POST /identity/v3/users => generated 286 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 22:05:22.715280 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dc32b6-3b56-42f4-a278-3df7a1edad56 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:05:22.725569 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dc32b6-3b56-42f4-a278-3df7a1edad56 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:05:22.730222 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223930bb-60fb-4e9d-b264-97ae68df22cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:05:22.730802 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223930bb-60fb-4e9d-b264-97ae68df22cb admin admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:05:22.731079 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223930bb-60fb-4e9d-b264-97ae68df22cb admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:05:22.731351 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223930bb-60fb-4e9d-b264-97ae68df22cb admin admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:05:22.732007 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223930bb-60fb-4e9d-b264-97ae68df22cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:05:22.733618 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223930bb-60fb-4e9d-b264-97ae68df22cb admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:05:22.743310 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1241/2458] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:05:22 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:05:22.748068 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3765ee88-7f38-4f81-b80a-1d9a1955ca29 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:05:22.757843 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3765ee88-7f38-4f81-b80a-1d9a1955ca29 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:05:22.763164 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b03df81-3f1c-4508-9f2c-7ad431b71376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:05:22.763753 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b03df81-3f1c-4508-9f2c-7ad431b71376 admin admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:05:22.764029 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b03df81-3f1c-4508-9f2c-7ad431b71376 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:05:22.764295 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b03df81-3f1c-4508-9f2c-7ad431b71376 admin admin] PATH_INFO: `/v3/roles` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:05:22.764961 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b03df81-3f1c-4508-9f2c-7ad431b71376 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:05:22.766522 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b03df81-3f1c-4508-9f2c-7ad431b71376 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:05:22.777211 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1218/2459] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:05:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:05:22.781239 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223930bb-60fb-4e9d-b264-97ae68df22cb admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:05:22.791030 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223930bb-60fb-4e9d-b264-97ae68df22cb admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:05:22.795680 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47d16c1-4fb3-4038-841b-d98cb515db3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:05:22.801140 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47d16c1-4fb3-4038-841b-d98cb515db3e admin admin] REQUEST_METHOD: `PUT` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:05:22.801140 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47d16c1-4fb3-4038-841b-d98cb515db3e admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:05:22.801140 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47d16c1-4fb3-4038-841b-d98cb515db3e admin admin] PATH_INFO: `/v3/projects/c24d1cf0adb448479bfd31657764f360/users/46489c2d71334e06a60069c02d83e4c3/roles/de8f2438056f4af9879423f8a59e0e0b` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:05:22.811506 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47d16c1-4fb3-4038-841b-d98cb515db3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c24d1cf0adb448479bfd31657764f360, user_id=46489c2d71334e06a60069c02d83e4c3, role_id=de8f2438056f4af9879423f8a59e0e0b)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:05:22.814179 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47d16c1-4fb3-4038-841b-d98cb515db3e admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:05:22.903435 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1242/2460] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 18 22:05:22 2022] PUT /identity/v3/projects/c24d1cf0adb448479bfd31657764f360/users/46489c2d71334e06a60069c02d83e4c3/roles/de8f2438056f4af9879423f8a59e0e0b => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:05:22.908603 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743fc699-a256-4f97-832f-acc9e1cfdf00 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:05:22.908900 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743fc699-a256-4f97-832f-acc9e1cfdf00 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:05:22.909171 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743fc699-a256-4f97-832f-acc9e1cfdf00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:05:22.928046 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-743fc699-a256-4f97-832f-acc9e1cfdf00 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:05:22.929290 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-743fc699-a256-4f97-832f-acc9e1cfdf00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:05:22.947032 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:05:22.990401 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1219/2461] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:05:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:05:23.000721 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47d16c1-4fb3-4038-841b-d98cb515db3e admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:05:23.002441 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-e47d16c1-4fb3-4038-841b-d98cb515db3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:05:23.059972 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47d16c1-4fb3-4038-841b-d98cb515db3e admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:05:23.064122 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c454d1-67cf-4a01-8f68-d31c06339b27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a937971ad1a4b0c8697c764f214d446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:05:23.064828 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c454d1-67cf-4a01-8f68-d31c06339b27 service neutron] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:05:23.065110 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c454d1-67cf-4a01-8f68-d31c06339b27 service neutron] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:05:23.065383 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c454d1-67cf-4a01-8f68-d31c06339b27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:05:23.075373 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c454d1-67cf-4a01-8f68-d31c06339b27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:05:23.076858 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c454d1-67cf-4a01-8f68-d31c06339b27 service neutron] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:05:23.086959 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1243/2462] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:05:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:05:24.307060 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6f9abd-c334-433e-a0cc-57acbb17f85c None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:05:24.307578 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6f9abd-c334-433e-a0cc-57acbb17f85c None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:05:24.307695 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6f9abd-c334-433e-a0cc-57acbb17f85c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:05:24.337433 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-bc6f9abd-c334-433e-a0cc-57acbb17f85c None None] MFA Rules not processed for user `46489c2d71334e06a60069c02d83e4c3`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:05:24.339259 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-bc6f9abd-c334-433e-a0cc-57acbb17f85c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:05:24.405817 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1220/2463] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:05:24 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:05:24.410470 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c454d1-67cf-4a01-8f68-d31c06339b27 service neutron] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:05:24.422080 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c454d1-67cf-4a01-8f68-d31c06339b27 service neutron] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:05:24.426713 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0c9322-2c0a-405b-b256-ada906f2ff45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:05:24.427306 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0c9322-2c0a-405b-b256-ada906f2ff45 admin admin] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:05:24.427583 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0c9322-2c0a-405b-b256-ada906f2ff45 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:05:24.427854 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0c9322-2c0a-405b-b256-ada906f2ff45 admin admin] PATH_INFO: `/v3/projects` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:05:24.428468 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0c9322-2c0a-405b-b256-ada906f2ff45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:05:24.430425 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0c9322-2c0a-405b-b256-ada906f2ff45 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:05:24.495277 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1244/2464] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 18 22:05:24 2022] POST /identity/v3/projects => generated 371 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 22:05:24.499316 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6f9abd-c334-433e-a0cc-57acbb17f85c None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:05:24.510141 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6f9abd-c334-433e-a0cc-57acbb17f85c None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:05:24.566421 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac498798-d6dc-4efe-b871-70a87c0bebc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:05:24.566945 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac498798-d6dc-4efe-b871-70a87c0bebc9 admin admin] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:05:24.567220 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac498798-d6dc-4efe-b871-70a87c0bebc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:05:24.567486 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac498798-d6dc-4efe-b871-70a87c0bebc9 admin admin] PATH_INFO: `/v3/users` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:05:24.568110 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac498798-d6dc-4efe-b871-70a87c0bebc9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:05:24.570024 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac498798-d6dc-4efe-b871-70a87c0bebc9 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:05:24.652019 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1221/2465] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 18 22:05:24 2022] POST /identity/v3/users => generated 292 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 22:05:24.656467 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0c9322-2c0a-405b-b256-ada906f2ff45 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:05:24.666851 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0c9322-2c0a-405b-b256-ada906f2ff45 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:05:24.673299 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bd1117-0ac5-48e9-bed3-db874047f5db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:05:24.674092 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bd1117-0ac5-48e9-bed3-db874047f5db admin admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:05:24.674375 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bd1117-0ac5-48e9-bed3-db874047f5db admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:05:24.674653 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bd1117-0ac5-48e9-bed3-db874047f5db admin admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:05:24.675298 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bd1117-0ac5-48e9-bed3-db874047f5db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:05:24.676975 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bd1117-0ac5-48e9-bed3-db874047f5db admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:05:24.688337 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1245/2466] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:05:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:05:24.699034 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac498798-d6dc-4efe-b871-70a87c0bebc9 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:05:24.709351 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac498798-d6dc-4efe-b871-70a87c0bebc9 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:05:24.714820 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21e313c-3741-4ccc-9ff0-c3f1199ca2fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:05:24.715468 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21e313c-3741-4ccc-9ff0-c3f1199ca2fb admin admin] REQUEST_METHOD: `PUT` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:05:24.715752 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21e313c-3741-4ccc-9ff0-c3f1199ca2fb admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:05:24.716028 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21e313c-3741-4ccc-9ff0-c3f1199ca2fb admin admin] PATH_INFO: `/v3/projects/b36508fa22274e97988656e2a70deefc/users/c07d80ddc305481c83457f87093dbe63/roles/0833202e2a3d47d1b6b3af57006641b1` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:05:24.730741 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21e313c-3741-4ccc-9ff0-c3f1199ca2fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=b36508fa22274e97988656e2a70deefc, user_id=c07d80ddc305481c83457f87093dbe63, role_id=0833202e2a3d47d1b6b3af57006641b1)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:05:24.733451 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21e313c-3741-4ccc-9ff0-c3f1199ca2fb admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:05:24.829815 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1222/2467] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 18 22:05:24 2022] PUT /identity/v3/projects/b36508fa22274e97988656e2a70deefc/users/c07d80ddc305481c83457f87093dbe63/roles/0833202e2a3d47d1b6b3af57006641b1 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:05:24.833613 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bd1117-0ac5-48e9-bed3-db874047f5db admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:05:24.844222 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bd1117-0ac5-48e9-bed3-db874047f5db admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:05:24.900521 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15316bc-f707-4f4d-8f99-40d37b57c799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:05:24.901179 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15316bc-f707-4f4d-8f99-40d37b57c799 admin admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:05:24.901464 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15316bc-f707-4f4d-8f99-40d37b57c799 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:05:24.901730 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15316bc-f707-4f4d-8f99-40d37b57c799 admin admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:05:24.902377 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15316bc-f707-4f4d-8f99-40d37b57c799 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:05:24.903996 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15316bc-f707-4f4d-8f99-40d37b57c799 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:05:24.913568 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1246/2468] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:05:24 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:05:24.917718 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21e313c-3741-4ccc-9ff0-c3f1199ca2fb admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:05:24.928024 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21e313c-3741-4ccc-9ff0-c3f1199ca2fb admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:05:24.933130 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642c3680-e0e9-4a62-a7e7-99c8b955fd31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:05:24.934017 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642c3680-e0e9-4a62-a7e7-99c8b955fd31 admin admin] REQUEST_METHOD: `PUT` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:05:24.934295 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642c3680-e0e9-4a62-a7e7-99c8b955fd31 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:05:24.934564 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642c3680-e0e9-4a62-a7e7-99c8b955fd31 admin admin] PATH_INFO: `/v3/projects/b36508fa22274e97988656e2a70deefc/users/c07d80ddc305481c83457f87093dbe63/roles/0833202e2a3d47d1b6b3af57006641b1` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:05:24.936698 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642c3680-e0e9-4a62-a7e7-99c8b955fd31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b36508fa22274e97988656e2a70deefc, user_id=c07d80ddc305481c83457f87093dbe63, role_id=0833202e2a3d47d1b6b3af57006641b1)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:05:24.939717 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642c3680-e0e9-4a62-a7e7-99c8b955fd31 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:05:24.951441 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1223/2469] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 18 22:05:24 2022] PUT /identity/v3/projects/b36508fa22274e97988656e2a70deefc/users/c07d80ddc305481c83457f87093dbe63/roles/0833202e2a3d47d1b6b3af57006641b1 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:05:26.094276 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e53e79b-a598-42b5-9048-66a21e2b5977 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:05:26.094802 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e53e79b-a598-42b5-9048-66a21e2b5977 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:05:26.094802 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e53e79b-a598-42b5-9048-66a21e2b5977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:05:26.128794 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-3e53e79b-a598-42b5-9048-66a21e2b5977 None None] MFA Rules not processed for user `c07d80ddc305481c83457f87093dbe63`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:05:26.129756 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-3e53e79b-a598-42b5-9048-66a21e2b5977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:05:26.133831 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:05:26.200823 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1247/2470] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:05:26 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:05:26.211346 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687dd39a-954e-4a9e-84b2-80dea4c02105 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:05:26.211845 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687dd39a-954e-4a9e-84b2-80dea4c02105 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:05:26.212033 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687dd39a-954e-4a9e-84b2-80dea4c02105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:05:26.225078 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:05:26.235953 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-687dd39a-954e-4a9e-84b2-80dea4c02105 None None] MFA Rules not processed for user `46489c2d71334e06a60069c02d83e4c3`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:05:26.237174 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-687dd39a-954e-4a9e-84b2-80dea4c02105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:05:26.292251 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1224/2471] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:05:26 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:05:26.304835 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e53e79b-a598-42b5-9048-66a21e2b5977 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:05:26.306240 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-3e53e79b-a598-42b5-9048-66a21e2b5977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:05:26.379383 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e53e79b-a598-42b5-9048-66a21e2b5977 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:05:26.385189 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e60865-50ec-4805-b002-04e7ceab6dd1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a39cd50340184779ac589bbcb7cac9aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:05:26.386484 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e60865-50ec-4805-b002-04e7ceab6dd1 service nova] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:05:26.386769 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e60865-50ec-4805-b002-04e7ceab6dd1 service nova] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:05:26.387048 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e60865-50ec-4805-b002-04e7ceab6dd1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:05:26.396455 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e60865-50ec-4805-b002-04e7ceab6dd1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:05:26.398077 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e60865-50ec-4805-b002-04e7ceab6dd1 service nova] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:05:26.406980 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1248/2472] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:05:26 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:05:26.439729 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687dd39a-954e-4a9e-84b2-80dea4c02105 None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:05:26.441703 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-687dd39a-954e-4a9e-84b2-80dea4c02105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:05:26.498396 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687dd39a-954e-4a9e-84b2-80dea4c02105 None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:05:26.501976 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef664791-8e7a-4ee2-9a58-0ad8d5dab6a8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85dfef6a910547da9706d294e7d40fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:05:26.502575 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef664791-8e7a-4ee2-9a58-0ad8d5dab6a8 service glance] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:05:26.502850 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef664791-8e7a-4ee2-9a58-0ad8d5dab6a8 service glance] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:05:26.503117 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef664791-8e7a-4ee2-9a58-0ad8d5dab6a8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:05:26.504850 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-ef664791-8e7a-4ee2-9a58-0ad8d5dab6a8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:05:26.518430 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef664791-8e7a-4ee2-9a58-0ad8d5dab6a8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:05:26.519829 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef664791-8e7a-4ee2-9a58-0ad8d5dab6a8 service glance] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:05:26.530933 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1225/2473] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:05:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:05:27.141940 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e60865-50ec-4805-b002-04e7ceab6dd1 service nova] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:05:27.200475 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e60865-50ec-4805-b002-04e7ceab6dd1 service nova] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:05:27.204230 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d6d20d-a69f-419e-ace2-01d7e250fa36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a937971ad1a4b0c8697c764f214d446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:05:27.204858 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d6d20d-a69f-419e-ace2-01d7e250fa36 service neutron] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:05:27.205200 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d6d20d-a69f-419e-ace2-01d7e250fa36 service neutron] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:05:27.205545 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d6d20d-a69f-419e-ace2-01d7e250fa36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:05:27.207646 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-17d6d20d-a69f-419e-ace2-01d7e250fa36 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:05:27.222325 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d6d20d-a69f-419e-ace2-01d7e250fa36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:05:27.223793 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d6d20d-a69f-419e-ace2-01d7e250fa36 service neutron] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:05:27.236172 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1249/2474] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:05:27 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:05:36.525727 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=49 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:05:37.230955 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=87 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:05:42.470292 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef664791-8e7a-4ee2-9a58-0ad8d5dab6a8 service glance] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:05:42.471738 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-ef664791-8e7a-4ee2-9a58-0ad8d5dab6a8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:05:42.530014 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef664791-8e7a-4ee2-9a58-0ad8d5dab6a8 service glance] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:05:42.533617 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd49b0c8-424c-4b4d-98a9-456954f24c1d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22b6a7c36f8a4795a75271b8079821c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:05:42.534217 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd49b0c8-424c-4b4d-98a9-456954f24c1d service cinder] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:05:42.534493 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd49b0c8-424c-4b4d-98a9-456954f24c1d service cinder] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:05:42.534762 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd49b0c8-424c-4b4d-98a9-456954f24c1d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:05:42.544050 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd49b0c8-424c-4b4d-98a9-456954f24c1d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:05:42.545447 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd49b0c8-424c-4b4d-98a9-456954f24c1d service cinder] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:05:42.555085 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1226/2475] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:05:42 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:05:42.755925 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d6d20d-a69f-419e-ace2-01d7e250fa36 service neutron] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:05:42.768778 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d6d20d-a69f-419e-ace2-01d7e250fa36 service neutron] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:05:42.775356 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7261aeb6-5a86-4a3c-9171-6e23a45d6199 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a39cd50340184779ac589bbcb7cac9aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:05:42.775960 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7261aeb6-5a86-4a3c-9171-6e23a45d6199 service nova] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:05:42.776241 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7261aeb6-5a86-4a3c-9171-6e23a45d6199 service nova] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:05:42.777076 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7261aeb6-5a86-4a3c-9171-6e23a45d6199 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:05:42.778828 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-7261aeb6-5a86-4a3c-9171-6e23a45d6199 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:05:42.841275 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7261aeb6-5a86-4a3c-9171-6e23a45d6199 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:05:42.843247 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7261aeb6-5a86-4a3c-9171-6e23a45d6199 service nova] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:05:42.852606 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1250/2476] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:05:42 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:05:43.175965 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd49b0c8-424c-4b4d-98a9-456954f24c1d service cinder] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:05:43.177534 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-fd49b0c8-424c-4b4d-98a9-456954f24c1d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:05:43.194489 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd49b0c8-424c-4b4d-98a9-456954f24c1d service cinder] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:05:43.201237 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8ee6de-c488-4aea-a90a-b018de686683 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a39cd50340184779ac589bbcb7cac9aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:05:43.203043 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8ee6de-c488-4aea-a90a-b018de686683 service nova] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:05:43.203043 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8ee6de-c488-4aea-a90a-b018de686683 service nova] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:05:43.203043 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8ee6de-c488-4aea-a90a-b018de686683 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:05:43.204193 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-9f8ee6de-c488-4aea-a90a-b018de686683 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:05:43.270468 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8ee6de-c488-4aea-a90a-b018de686683 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:05:43.272093 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8ee6de-c488-4aea-a90a-b018de686683 service nova] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:05:43.282536 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1227/2477] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:05:43 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:05:52.848068 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=28 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:05:53.278033 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=54 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:05:54.084993 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5323e912-8a2c-4251-bbf9-2e51d01aa11d None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:05:54.085822 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5323e912-8a2c-4251-bbf9-2e51d01aa11d None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:05:54.086100 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5323e912-8a2c-4251-bbf9-2e51d01aa11d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:05:54.107511 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-5323e912-8a2c-4251-bbf9-2e51d01aa11d None None] MFA Rules not processed for user `f079aa6ed5594a4982172b51b93ac54f`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:05:54.108907 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-5323e912-8a2c-4251-bbf9-2e51d01aa11d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:05:54.176586 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1251/2478] 10.222.0.27 () {58 vars in 1009 bytes} [Thu Aug 18 22:05:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:05:54.331257 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8ee6de-c488-4aea-a90a-b018de686683 service nova] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:05:54.333087 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-9f8ee6de-c488-4aea-a90a-b018de686683 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:05:54.404528 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8ee6de-c488-4aea-a90a-b018de686683 service nova] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:05:54.409972 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb38525a-ea13-45ea-8553-d8408357a44f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae59e6dca304c949942ae769acedc74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:05:54.410589 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb38525a-ea13-45ea-8553-d8408357a44f service swift] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:05:54.410892 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb38525a-ea13-45ea-8553-d8408357a44f service swift] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:05:54.411164 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb38525a-ea13-45ea-8553-d8408357a44f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:05:54.419732 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb38525a-ea13-45ea-8553-d8408357a44f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:05:54.421366 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb38525a-ea13-45ea-8553-d8408357a44f service swift] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:05:54.429607 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1228/2479] 10.222.0.27 () {60 vars in 1384 bytes} [Thu Aug 18 22:05:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 18 22:06:02.859634 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5323e912-8a2c-4251-bbf9-2e51d01aa11d None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:02.879834 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5323e912-8a2c-4251-bbf9-2e51d01aa11d None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:02.892005 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51c0f94-023d-4a30-88d5-05d8405dad12 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a39cd50340184779ac589bbcb7cac9aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:02.893161 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51c0f94-023d-4a30-88d5-05d8405dad12 service nova] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:02.894968 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51c0f94-023d-4a30-88d5-05d8405dad12 service nova] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:02.899723 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51c0f94-023d-4a30-88d5-05d8405dad12 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:02.905458 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-d51c0f94-023d-4a30-88d5-05d8405dad12 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:06:02.930738 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51c0f94-023d-4a30-88d5-05d8405dad12 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:02.932822 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51c0f94-023d-4a30-88d5-05d8405dad12 service nova] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:02.947187 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1252/2480] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:06:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:06:04.520293 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=32 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:06:05.828900 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb38525a-ea13-45ea-8553-d8408357a44f service swift] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:05.830380 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-fb38525a-ea13-45ea-8553-d8408357a44f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:06:05.842926 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb38525a-ea13-45ea-8553-d8408357a44f service swift] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:05.846545 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64015232-067e-4450-9c09-73d6375eb42d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a937971ad1a4b0c8697c764f214d446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:05.847780 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64015232-067e-4450-9c09-73d6375eb42d service neutron] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:05.848062 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64015232-067e-4450-9c09-73d6375eb42d service neutron] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:05.848358 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64015232-067e-4450-9c09-73d6375eb42d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:05.850150 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-64015232-067e-4450-9c09-73d6375eb42d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:06:05.860713 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64015232-067e-4450-9c09-73d6375eb42d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:05.862223 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64015232-067e-4450-9c09-73d6375eb42d service neutron] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:05.871919 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1229/2481] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:06:05 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:06:06.463405 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51c0f94-023d-4a30-88d5-05d8405dad12 service nova] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:06.464969 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-d51c0f94-023d-4a30-88d5-05d8405dad12 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:06:06.538131 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51c0f94-023d-4a30-88d5-05d8405dad12 service nova] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:06.543343 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c161453-a9a4-4b18-8ccd-95702bf46538 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b44c0cf2d8b34f3e81c59d19eedbdfcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:06.543949 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c161453-a9a4-4b18-8ccd-95702bf46538 service placement] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:06.544252 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c161453-a9a4-4b18-8ccd-95702bf46538 service placement] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:06.544551 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c161453-a9a4-4b18-8ccd-95702bf46538 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:06.546287 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-6c161453-a9a4-4b18-8ccd-95702bf46538 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:06:06.558059 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c161453-a9a4-4b18-8ccd-95702bf46538 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:06.559636 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c161453-a9a4-4b18-8ccd-95702bf46538 service placement] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:06.570072 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1253/2482] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:06:06 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:06:07.194899 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64015232-067e-4450-9c09-73d6375eb42d service neutron] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:07.208556 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64015232-067e-4450-9c09-73d6375eb42d service neutron] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:07.214483 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17de0c0-a992-43a5-9212-148b5661d42d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b44c0cf2d8b34f3e81c59d19eedbdfcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:07.215147 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17de0c0-a992-43a5-9212-148b5661d42d service placement] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:07.215456 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17de0c0-a992-43a5-9212-148b5661d42d service placement] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:07.215731 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17de0c0-a992-43a5-9212-148b5661d42d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:07.217689 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-e17de0c0-a992-43a5-9212-148b5661d42d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:06:07.232001 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17de0c0-a992-43a5-9212-148b5661d42d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:07.233668 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17de0c0-a992-43a5-9212-148b5661d42d service placement] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:07.245346 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1230/2483] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:06:07 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:06:07.337202 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c161453-a9a4-4b18-8ccd-95702bf46538 service placement] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:07.402826 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c161453-a9a4-4b18-8ccd-95702bf46538 service placement] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:07.407388 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b33cc7-7b79-4198-b190-9db828afb32a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:07.408011 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b33cc7-7b79-4198-b190-9db828afb32a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:07.408292 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b33cc7-7b79-4198-b190-9db828afb32a admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:07.408566 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b33cc7-7b79-4198-b190-9db828afb32a admin admin] PATH_INFO: `/v3/users/46489c2d71334e06a60069c02d83e4c3` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:07.410526 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b33cc7-7b79-4198-b190-9db828afb32a admin admin] RBAC: Authorizing `identity:delete_user(user_id=46489c2d71334e06a60069c02d83e4c3)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:07.412456 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b33cc7-7b79-4198-b190-9db828afb32a admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:07.435413 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:06:07.629488 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-62b33cc7-7b79-4198-b190-9db828afb32a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46489c2d71334e06a60069c02d83e4c3'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:07.636753 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-62b33cc7-7b79-4198-b190-9db828afb32a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46489c2d71334e06a60069c02d83e4c3'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:07.637438 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-62b33cc7-7b79-4198-b190-9db828afb32a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46489c2d71334e06a60069c02d83e4c3'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:07.650132 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-62b33cc7-7b79-4198-b190-9db828afb32a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46489c2d71334e06a60069c02d83e4c3'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:07.709141 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-62b33cc7-7b79-4198-b190-9db828afb32a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46489c2d71334e06a60069c02d83e4c3'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:07.715664 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1254/2484] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 18 22:06:07 2022] DELETE /identity/v3/users/46489c2d71334e06a60069c02d83e4c3 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:06:07.945594 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17de0c0-a992-43a5-9212-148b5661d42d service placement] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:07.957316 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17de0c0-a992-43a5-9212-148b5661d42d service placement] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:08.015703 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6009a6f6-56ba-4afc-bd2e-ef1e8c363745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:08.016601 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6009a6f6-56ba-4afc-bd2e-ef1e8c363745 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:08.016882 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6009a6f6-56ba-4afc-bd2e-ef1e8c363745 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:08.017152 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6009a6f6-56ba-4afc-bd2e-ef1e8c363745 admin admin] PATH_INFO: `/v3/projects/c24d1cf0adb448479bfd31657764f360` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:08.018258 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6009a6f6-56ba-4afc-bd2e-ef1e8c363745 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c24d1cf0adb448479bfd31657764f360)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:08.020900 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6009a6f6-56ba-4afc-bd2e-ef1e8c363745 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:08.167242 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-6009a6f6-56ba-4afc-bd2e-ef1e8c363745 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c24d1cf0adb448479bfd31657764f360', 'request_id': 'req-6009a6f6-56ba-4afc-bd2e-ef1e8c363745'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:08.173890 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-6009a6f6-56ba-4afc-bd2e-ef1e8c363745 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c24d1cf0adb448479bfd31657764f360', 'request_id': 'req-6009a6f6-56ba-4afc-bd2e-ef1e8c363745'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:08.240481 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-6009a6f6-56ba-4afc-bd2e-ef1e8c363745 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c24d1cf0adb448479bfd31657764f360', 'request_id': 'req-6009a6f6-56ba-4afc-bd2e-ef1e8c363745'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:08.252538 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-6009a6f6-56ba-4afc-bd2e-ef1e8c363745 admin admin] The token cache is being invalidate because project c24d1cf0adb448479bfd31657764f360 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88096) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 22:06:08.252908 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-6009a6f6-56ba-4afc-bd2e-ef1e8c363745 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:08.253747 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-6009a6f6-56ba-4afc-bd2e-ef1e8c363745 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:08.255351 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1231/2485] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 18 22:06:07 2022] DELETE /identity/v3/projects/c24d1cf0adb448479bfd31657764f360 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:06:08.259364 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b33cc7-7b79-4198-b190-9db828afb32a admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:08.261119 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-62b33cc7-7b79-4198-b190-9db828afb32a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:06:08.276310 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b33cc7-7b79-4198-b190-9db828afb32a admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:08.335248 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cf56f9-9277-415a-8d02-3d88a14be8a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:08.335892 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cf56f9-9277-415a-8d02-3d88a14be8a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:08.336154 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cf56f9-9277-415a-8d02-3d88a14be8a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:08.336434 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cf56f9-9277-415a-8d02-3d88a14be8a3 admin admin] PATH_INFO: `/v3/users/c07d80ddc305481c83457f87093dbe63` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:08.337618 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cf56f9-9277-415a-8d02-3d88a14be8a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c07d80ddc305481c83457f87093dbe63)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:08.339648 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cf56f9-9277-415a-8d02-3d88a14be8a3 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:08.569124 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-08cf56f9-9277-415a-8d02-3d88a14be8a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c07d80ddc305481c83457f87093dbe63'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:08.576173 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-08cf56f9-9277-415a-8d02-3d88a14be8a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c07d80ddc305481c83457f87093dbe63'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:08.576952 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-08cf56f9-9277-415a-8d02-3d88a14be8a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c07d80ddc305481c83457f87093dbe63'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:08.589650 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-08cf56f9-9277-415a-8d02-3d88a14be8a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c07d80ddc305481c83457f87093dbe63'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:08.646523 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-08cf56f9-9277-415a-8d02-3d88a14be8a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c07d80ddc305481c83457f87093dbe63'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:08.658200 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1255/2486] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 18 22:06:08 2022] DELETE /identity/v3/users/c07d80ddc305481c83457f87093dbe63 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:06:09.012776 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6009a6f6-56ba-4afc-bd2e-ef1e8c363745 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:09.013324 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-6009a6f6-56ba-4afc-bd2e-ef1e8c363745 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:06:09.027728 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6009a6f6-56ba-4afc-bd2e-ef1e8c363745 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:09.098384 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442b9e64-228b-4e1f-b8f8-2648e7361955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:09.099104 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442b9e64-228b-4e1f-b8f8-2648e7361955 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:09.099392 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442b9e64-228b-4e1f-b8f8-2648e7361955 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:09.099653 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442b9e64-228b-4e1f-b8f8-2648e7361955 admin admin] PATH_INFO: `/v3/projects/b36508fa22274e97988656e2a70deefc` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:09.100814 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442b9e64-228b-4e1f-b8f8-2648e7361955 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b36508fa22274e97988656e2a70deefc)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:09.103094 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442b9e64-228b-4e1f-b8f8-2648e7361955 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:09.110378 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:06:09.215465 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-442b9e64-228b-4e1f-b8f8-2648e7361955 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b36508fa22274e97988656e2a70deefc', 'request_id': 'req-442b9e64-228b-4e1f-b8f8-2648e7361955'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:09.221150 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-442b9e64-228b-4e1f-b8f8-2648e7361955 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b36508fa22274e97988656e2a70deefc', 'request_id': 'req-442b9e64-228b-4e1f-b8f8-2648e7361955'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:09.332703 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-442b9e64-228b-4e1f-b8f8-2648e7361955 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b36508fa22274e97988656e2a70deefc', 'request_id': 'req-442b9e64-228b-4e1f-b8f8-2648e7361955'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:09.343987 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-442b9e64-228b-4e1f-b8f8-2648e7361955 admin admin] The token cache is being invalidate because project b36508fa22274e97988656e2a70deefc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88096) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 22:06:09.344291 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-442b9e64-228b-4e1f-b8f8-2648e7361955 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:09.345457 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-442b9e64-228b-4e1f-b8f8-2648e7361955 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:09.347167 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1232/2487] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 18 22:06:09 2022] DELETE /identity/v3/projects/b36508fa22274e97988656e2a70deefc => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:06:09.352050 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2516e9-366b-41b4-aaa8-152c22356276 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:09.352932 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2516e9-366b-41b4-aaa8-152c22356276 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:09.353269 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2516e9-366b-41b4-aaa8-152c22356276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:09.374237 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-ba2516e9-366b-41b4-aaa8-152c22356276 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:06:09.375471 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-ba2516e9-366b-41b4-aaa8-152c22356276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:06:09.389621 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:06:09.437750 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1256/2488] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:06:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:06:09.446507 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830340f9-4a6b-43ef-bebb-881bbf07d20c None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:09.446798 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830340f9-4a6b-43ef-bebb-881bbf07d20c None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:09.447077 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830340f9-4a6b-43ef-bebb-881bbf07d20c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:09.466841 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-830340f9-4a6b-43ef-bebb-881bbf07d20c None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:06:09.468054 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-830340f9-4a6b-43ef-bebb-881bbf07d20c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:06:09.477117 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1233/2489] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:06:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:06:09.481487 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2516e9-366b-41b4-aaa8-152c22356276 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:09.492518 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2516e9-366b-41b4-aaa8-152c22356276 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:09.497871 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d76c2a-9397-4181-86a1-54f7d89ee24c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:09.500678 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d76c2a-9397-4181-86a1-54f7d89ee24c admin admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:09.500678 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d76c2a-9397-4181-86a1-54f7d89ee24c admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:09.500678 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d76c2a-9397-4181-86a1-54f7d89ee24c admin admin] PATH_INFO: `/v3/domains` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:09.500678 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d76c2a-9397-4181-86a1-54f7d89ee24c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 22:06:09.500678 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d76c2a-9397-4181-86a1-54f7d89ee24c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:09.502308 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d76c2a-9397-4181-86a1-54f7d89ee24c admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:09.520976 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1257/2490] 10.222.0.27 () {58 vars in 1153 bytes} [Thu Aug 18 22:06:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 22:06:09.523698 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830340f9-4a6b-43ef-bebb-881bbf07d20c None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:09.538067 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830340f9-4a6b-43ef-bebb-881bbf07d20c None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:09.544707 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e7527a-71f2-4b4c-a780-b1a65564c427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:09.547174 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e7527a-71f2-4b4c-a780-b1a65564c427 admin admin] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:09.547174 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e7527a-71f2-4b4c-a780-b1a65564c427 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:09.547174 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e7527a-71f2-4b4c-a780-b1a65564c427 admin admin] PATH_INFO: `/v3/projects` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:09.547174 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e7527a-71f2-4b4c-a780-b1a65564c427 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:09.549018 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e7527a-71f2-4b4c-a780-b1a65564c427 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:09.608698 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d76c2a-9397-4181-86a1-54f7d89ee24c admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:09.610437 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-a2d76c2a-9397-4181-86a1-54f7d89ee24c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:06:09.672838 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d76c2a-9397-4181-86a1-54f7d89ee24c admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:09.674215 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1234/2491] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 18 22:06:09 2022] POST /identity/v3/projects => generated 383 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 22:06:09.675725 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e7527a-71f2-4b4c-a780-b1a65564c427 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:09.677551 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-c0e7527a-71f2-4b4c-a780-b1a65564c427 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:06:09.735191 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f5dcd7-139f-4312-8ae0-88c5b358a018 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a937971ad1a4b0c8697c764f214d446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:09.736360 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f5dcd7-139f-4312-8ae0-88c5b358a018 service neutron] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:09.736695 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f5dcd7-139f-4312-8ae0-88c5b358a018 service neutron] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:09.736994 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f5dcd7-139f-4312-8ae0-88c5b358a018 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:09.739837 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-a0f5dcd7-139f-4312-8ae0-88c5b358a018 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:06:09.760740 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e7527a-71f2-4b4c-a780-b1a65564c427 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:09.766879 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2622f490-9b2a-4340-973a-cd01052b5eee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a39cd50340184779ac589bbcb7cac9aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:09.767497 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2622f490-9b2a-4340-973a-cd01052b5eee service nova] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:09.767777 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2622f490-9b2a-4340-973a-cd01052b5eee service nova] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:09.768053 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2622f490-9b2a-4340-973a-cd01052b5eee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:09.770431 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-2622f490-9b2a-4340-973a-cd01052b5eee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:06:09.786294 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2622f490-9b2a-4340-973a-cd01052b5eee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:09.788451 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2622f490-9b2a-4340-973a-cd01052b5eee service nova] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:09.804575 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1235/2492] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:06:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:06:09.805088 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2622f490-9b2a-4340-973a-cd01052b5eee service nova] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:09.823308 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f5dcd7-139f-4312-8ae0-88c5b358a018 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:09.827439 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f5dcd7-139f-4312-8ae0-88c5b358a018 service neutron] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:09.837332 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1258/2493] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:06:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 22:06:09.863601 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:06:09.875707 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2622f490-9b2a-4340-973a-cd01052b5eee service nova] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:09.883215 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a61c4d-8104-408b-9825-5c203c9217af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:09.884988 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a61c4d-8104-408b-9825-5c203c9217af admin admin] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:09.884988 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a61c4d-8104-408b-9825-5c203c9217af admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:09.884988 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a61c4d-8104-408b-9825-5c203c9217af admin admin] PATH_INFO: `/v3/users` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:09.885411 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a61c4d-8104-408b-9825-5c203c9217af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:09.888412 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a61c4d-8104-408b-9825-5c203c9217af admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:09.984751 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1236/2494] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 18 22:06:09 2022] POST /identity/v3/users => generated 292 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 22:06:09.989138 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f5dcd7-139f-4312-8ae0-88c5b358a018 service neutron] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:10.000137 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f5dcd7-139f-4312-8ae0-88c5b358a018 service neutron] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:10.009304 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd1a80f-7207-47f5-bf3c-7014a517fa72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:10.009916 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd1a80f-7207-47f5-bf3c-7014a517fa72 admin admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:10.011057 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd1a80f-7207-47f5-bf3c-7014a517fa72 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:10.011057 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd1a80f-7207-47f5-bf3c-7014a517fa72 admin admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:10.011057 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd1a80f-7207-47f5-bf3c-7014a517fa72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:10.012797 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd1a80f-7207-47f5-bf3c-7014a517fa72 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:10.027140 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1259/2495] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:06:09 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 22:06:10.028853 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a61c4d-8104-408b-9825-5c203c9217af admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:10.042239 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a61c4d-8104-408b-9825-5c203c9217af admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:10.064302 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b99fbd7-ef23-4df4-bf9f-02b539658653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:10.065052 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b99fbd7-ef23-4df4-bf9f-02b539658653 admin admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:10.065515 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b99fbd7-ef23-4df4-bf9f-02b539658653 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:10.065970 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b99fbd7-ef23-4df4-bf9f-02b539658653 admin admin] PATH_INFO: `/v3/roles` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:10.066687 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b99fbd7-ef23-4df4-bf9f-02b539658653 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:10.068299 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b99fbd7-ef23-4df4-bf9f-02b539658653 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:10.083183 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1237/2496] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:06:10 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:06:10.083976 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd1a80f-7207-47f5-bf3c-7014a517fa72 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:10.089606 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:06:10.095314 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd1a80f-7207-47f5-bf3c-7014a517fa72 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:10.101223 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b4d5e3-caf8-4469-8fa7-ec54e7c4cbff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:10.111956 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b4d5e3-caf8-4469-8fa7-ec54e7c4cbff admin admin] REQUEST_METHOD: `PUT` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:10.112998 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b4d5e3-caf8-4469-8fa7-ec54e7c4cbff admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:10.113521 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b4d5e3-caf8-4469-8fa7-ec54e7c4cbff admin admin] PATH_INFO: `/v3/projects/d491bb1a4450401d95eb49ddfdcc1dc7/users/b7829dafb84f40818dd507b62527a17b/roles/de8f2438056f4af9879423f8a59e0e0b` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:10.132393 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b4d5e3-caf8-4469-8fa7-ec54e7c4cbff admin admin] RBAC: Authorizing `identity:create_grant(project_id=d491bb1a4450401d95eb49ddfdcc1dc7, user_id=b7829dafb84f40818dd507b62527a17b, role_id=de8f2438056f4af9879423f8a59e0e0b)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:10.135249 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b4d5e3-caf8-4469-8fa7-ec54e7c4cbff admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:10.218116 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1260/2497] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 18 22:06:10 2022] PUT /identity/v3/projects/d491bb1a4450401d95eb49ddfdcc1dc7/users/b7829dafb84f40818dd507b62527a17b/roles/de8f2438056f4af9879423f8a59e0e0b => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:06:10.229139 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece449a7-db76-4716-ab59-cffdcd1405b4 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:10.229526 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece449a7-db76-4716-ab59-cffdcd1405b4 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:10.229868 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece449a7-db76-4716-ab59-cffdcd1405b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:10.258962 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-ece449a7-db76-4716-ab59-cffdcd1405b4 None None] MFA Rules not processed for user `b7829dafb84f40818dd507b62527a17b`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:06:10.260283 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-ece449a7-db76-4716-ab59-cffdcd1405b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:06:10.330240 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1238/2498] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:06:10 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:06:10.340129 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b4d5e3-caf8-4469-8fa7-ec54e7c4cbff admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:10.341927 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-09b4d5e3-caf8-4469-8fa7-ec54e7c4cbff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:06:10.405591 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b4d5e3-caf8-4469-8fa7-ec54e7c4cbff admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:10.409560 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194bbed2-8290-4a5c-96cc-f60d2d407b76 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22b6a7c36f8a4795a75271b8079821c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:10.410231 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194bbed2-8290-4a5c-96cc-f60d2d407b76 service cinder] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:10.410554 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194bbed2-8290-4a5c-96cc-f60d2d407b76 service cinder] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:10.410800 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194bbed2-8290-4a5c-96cc-f60d2d407b76 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:10.419717 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194bbed2-8290-4a5c-96cc-f60d2d407b76 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:10.421262 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194bbed2-8290-4a5c-96cc-f60d2d407b76 service cinder] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:10.431948 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1261/2499] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:06:10 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:06:10.452244 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece449a7-db76-4716-ab59-cffdcd1405b4 None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:10.537756 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece449a7-db76-4716-ab59-cffdcd1405b4 None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:10.543381 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51098857-9a8c-4ed7-9e04-0a0a1deef2b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:10.544066 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51098857-9a8c-4ed7-9e04-0a0a1deef2b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:10.544313 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51098857-9a8c-4ed7-9e04-0a0a1deef2b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:10.544607 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51098857-9a8c-4ed7-9e04-0a0a1deef2b7 admin admin] PATH_INFO: `/v3/users/b7829dafb84f40818dd507b62527a17b` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:10.545780 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51098857-9a8c-4ed7-9e04-0a0a1deef2b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7829dafb84f40818dd507b62527a17b)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:10.549191 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51098857-9a8c-4ed7-9e04-0a0a1deef2b7 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:10.751532 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-51098857-9a8c-4ed7-9e04-0a0a1deef2b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7829dafb84f40818dd507b62527a17b'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:10.759839 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-51098857-9a8c-4ed7-9e04-0a0a1deef2b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7829dafb84f40818dd507b62527a17b'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:10.760634 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-51098857-9a8c-4ed7-9e04-0a0a1deef2b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7829dafb84f40818dd507b62527a17b'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:10.766357 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-51098857-9a8c-4ed7-9e04-0a0a1deef2b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7829dafb84f40818dd507b62527a17b'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:10.767061 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:06:10.775579 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-51098857-9a8c-4ed7-9e04-0a0a1deef2b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7829dafb84f40818dd507b62527a17b'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:10.807561 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194bbed2-8290-4a5c-96cc-f60d2d407b76 service cinder] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:10.809074 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-194bbed2-8290-4a5c-96cc-f60d2d407b76 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:06:10.867143 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194bbed2-8290-4a5c-96cc-f60d2d407b76 service cinder] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:10.870778 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efa3cf6-8d96-4aea-ab47-f8c96a4349b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a937971ad1a4b0c8697c764f214d446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:10.871374 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efa3cf6-8d96-4aea-ab47-f8c96a4349b3 service neutron] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:10.871654 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efa3cf6-8d96-4aea-ab47-f8c96a4349b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:10.871927 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efa3cf6-8d96-4aea-ab47-f8c96a4349b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:10.873702 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-4efa3cf6-8d96-4aea-ab47-f8c96a4349b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:06:10.883650 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efa3cf6-8d96-4aea-ab47-f8c96a4349b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:10.885166 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efa3cf6-8d96-4aea-ab47-f8c96a4349b3 service neutron] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:10.894081 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1262/2500] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:06:10 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 22:06:10.904068 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1239/2501] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 18 22:06:10 2022] DELETE /identity/v3/users/b7829dafb84f40818dd507b62527a17b => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:06:10.908279 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d21df0-3e35-4296-bc0c-2a1794d93b6a None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:10.908571 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d21df0-3e35-4296-bc0c-2a1794d93b6a None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:10.909038 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d21df0-3e35-4296-bc0c-2a1794d93b6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:10.928121 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-71d21df0-3e35-4296-bc0c-2a1794d93b6a None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:06:10.929438 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-71d21df0-3e35-4296-bc0c-2a1794d93b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:06:11.031133 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1263/2502] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:06:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 22:06:11.038529 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51098857-9a8c-4ed7-9e04-0a0a1deef2b7 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:11.040202 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-51098857-9a8c-4ed7-9e04-0a0a1deef2b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:06:11.109351 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51098857-9a8c-4ed7-9e04-0a0a1deef2b7 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:11.114944 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d0d701-32e6-4ccb-b0ce-a3261f233c78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a937971ad1a4b0c8697c764f214d446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:11.115647 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d0d701-32e6-4ccb-b0ce-a3261f233c78 service neutron] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:11.115936 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d0d701-32e6-4ccb-b0ce-a3261f233c78 service neutron] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:11.116212 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d0d701-32e6-4ccb-b0ce-a3261f233c78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:11.126954 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d0d701-32e6-4ccb-b0ce-a3261f233c78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:11.129094 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d0d701-32e6-4ccb-b0ce-a3261f233c78 service neutron] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:11.141401 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1240/2503] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:06:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 22:06:11.294751 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0172e05d-9c0f-4eae-99e8-983da6efa18d None None] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:11.295445 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0172e05d-9c0f-4eae-99e8-983da6efa18d None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:11.295445 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0172e05d-9c0f-4eae-99e8-983da6efa18d None None] PATH_INFO: `/` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:11.296819 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1264/2504] 10.222.0.27 () {54 vars in 921 bytes} [Thu Aug 18 22:06:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 22:06:11.303739 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1e8bee-639e-4d98-a3f8-7322c9df3d6e None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:11.304035 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1e8bee-639e-4d98-a3f8-7322c9df3d6e None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:11.304313 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1e8bee-639e-4d98-a3f8-7322c9df3d6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:11.324871 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-0f1e8bee-639e-4d98-a3f8-7322c9df3d6e None None] MFA Rules not processed for user `a39cd50340184779ac589bbcb7cac9aa`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:06:11.326438 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-0f1e8bee-639e-4d98-a3f8-7322c9df3d6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:06:11.402976 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1241/2505] 10.222.0.27 () {58 vars in 1018 bytes} [Thu Aug 18 22:06:11 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:06:11.417060 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0172e05d-9c0f-4eae-99e8-983da6efa18d None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:11.419066 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-0172e05d-9c0f-4eae-99e8-983da6efa18d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:06:11.453997 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:06:11.491426 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0172e05d-9c0f-4eae-99e8-983da6efa18d None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:11.496765 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d6ade2-5a2c-47ac-8fa7-d917fe90b5e8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85dfef6a910547da9706d294e7d40fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:11.496765 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d6ade2-5a2c-47ac-8fa7-d917fe90b5e8 service glance] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:11.496998 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d6ade2-5a2c-47ac-8fa7-d917fe90b5e8 service glance] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:11.497365 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d6ade2-5a2c-47ac-8fa7-d917fe90b5e8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:11.510004 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d6ade2-5a2c-47ac-8fa7-d917fe90b5e8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:11.511642 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d6ade2-5a2c-47ac-8fa7-d917fe90b5e8 service glance] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:11.526839 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1265/2506] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:06:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:06:11.649538 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1e8bee-639e-4d98-a3f8-7322c9df3d6e None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:11.649538 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-0f1e8bee-639e-4d98-a3f8-7322c9df3d6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:06:11.662378 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1e8bee-639e-4d98-a3f8-7322c9df3d6e None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:11.667419 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa27678-aac9-41ca-9ed0-a7fc4932b1fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:11.668100 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa27678-aac9-41ca-9ed0-a7fc4932b1fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:11.668345 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa27678-aac9-41ca-9ed0-a7fc4932b1fa admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:11.668672 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa27678-aac9-41ca-9ed0-a7fc4932b1fa admin admin] PATH_INFO: `/v3/projects/d491bb1a4450401d95eb49ddfdcc1dc7` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:11.670865 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa27678-aac9-41ca-9ed0-a7fc4932b1fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=d491bb1a4450401d95eb49ddfdcc1dc7)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:11.672843 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa27678-aac9-41ca-9ed0-a7fc4932b1fa admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:11.769139 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be98aa22-f1ce-4a12-8787-3e17763ce7fc None None] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:11.769426 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be98aa22-f1ce-4a12-8787-3e17763ce7fc None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:11.769781 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be98aa22-f1ce-4a12-8787-3e17763ce7fc None None] PATH_INFO: `/` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:11.771138 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1266/2507] 10.222.0.27 () {54 vars in 921 bytes} [Thu Aug 18 22:06:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 22:06:11.775919 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c33223d-169c-4803-b63f-05094384030e None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:11.776203 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c33223d-169c-4803-b63f-05094384030e None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:11.776471 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c33223d-169c-4803-b63f-05094384030e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:11.796905 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-6c33223d-169c-4803-b63f-05094384030e None None] MFA Rules not processed for user `6a937971ad1a4b0c8697c764f214d446`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:06:11.798124 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-6c33223d-169c-4803-b63f-05094384030e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:06:11.811053 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-1aa27678-aac9-41ca-9ed0-a7fc4932b1fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd491bb1a4450401d95eb49ddfdcc1dc7', 'request_id': 'req-1aa27678-aac9-41ca-9ed0-a7fc4932b1fa'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:11.818872 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-1aa27678-aac9-41ca-9ed0-a7fc4932b1fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd491bb1a4450401d95eb49ddfdcc1dc7', 'request_id': 'req-1aa27678-aac9-41ca-9ed0-a7fc4932b1fa'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:11.854011 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1267/2508] 10.222.0.27 () {58 vars in 1018 bytes} [Thu Aug 18 22:06:11 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 22:06:11.868350 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c33223d-169c-4803-b63f-05094384030e None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:11.877173 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c33223d-169c-4803-b63f-05094384030e None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:11.881947 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5e6815-932e-42f6-96dd-bd21f86084ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a937971ad1a4b0c8697c764f214d446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:11.882561 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5e6815-932e-42f6-96dd-bd21f86084ac service neutron] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:11.882850 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5e6815-932e-42f6-96dd-bd21f86084ac service neutron] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:11.883127 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5e6815-932e-42f6-96dd-bd21f86084ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:11.886153 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-1aa27678-aac9-41ca-9ed0-a7fc4932b1fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd491bb1a4450401d95eb49ddfdcc1dc7', 'request_id': 'req-1aa27678-aac9-41ca-9ed0-a7fc4932b1fa'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:11.889490 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:06:11.901058 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-1aa27678-aac9-41ca-9ed0-a7fc4932b1fa admin admin] The token cache is being invalidate because project d491bb1a4450401d95eb49ddfdcc1dc7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88096) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 22:06:11.901393 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-1aa27678-aac9-41ca-9ed0-a7fc4932b1fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:11.902096 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-1aa27678-aac9-41ca-9ed0-a7fc4932b1fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:11.902328 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5e6815-932e-42f6-96dd-bd21f86084ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:11.906591 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5e6815-932e-42f6-96dd-bd21f86084ac service neutron] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:11.907723 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1242/2509] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 18 22:06:11 2022] DELETE /identity/v3/projects/d491bb1a4450401d95eb49ddfdcc1dc7 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:06:11.909840 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8a3e9f-624c-4e44-a88b-a8b105cbf874 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:11.914618 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8a3e9f-624c-4e44-a88b-a8b105cbf874 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:11.914618 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8a3e9f-624c-4e44-a88b-a8b105cbf874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:11.923815 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1268/2510] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:06:11 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 22:06:11.934893 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-aa8a3e9f-624c-4e44-a88b-a8b105cbf874 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:06:11.936630 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-aa8a3e9f-624c-4e44-a88b-a8b105cbf874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:06:12.040265 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b314ce67-a990-4976-8c9c-f8e3ec487ae4 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:12.040559 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b314ce67-a990-4976-8c9c-f8e3ec487ae4 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:12.046273 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b314ce67-a990-4976-8c9c-f8e3ec487ae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:12.047483 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1243/2511] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:06:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:06:12.050253 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b644105e-d1c8-4d13-ae16-81cac5eefb4f None None] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:12.050867 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b644105e-d1c8-4d13-ae16-81cac5eefb4f None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:12.051388 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b644105e-d1c8-4d13-ae16-81cac5eefb4f None None] PATH_INFO: `/` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:12.053998 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1244/2512] 10.222.0.27 () {54 vars in 921 bytes} [Thu Aug 18 22:06:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 22:06:12.059975 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd88f32-d219-4db8-b2aa-2e25ce5a6e62 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:12.060258 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd88f32-d219-4db8-b2aa-2e25ce5a6e62 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:12.060537 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd88f32-d219-4db8-b2aa-2e25ce5a6e62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:12.066969 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-b314ce67-a990-4976-8c9c-f8e3ec487ae4 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:06:12.068182 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-b314ce67-a990-4976-8c9c-f8e3ec487ae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:06:12.078794 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1269/2513] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:06:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:06:12.086072 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b314ce67-a990-4976-8c9c-f8e3ec487ae4 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:12.088544 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-0cd88f32-d219-4db8-b2aa-2e25ce5a6e62 None None] MFA Rules not processed for user `a39cd50340184779ac589bbcb7cac9aa`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:06:12.090662 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-0cd88f32-d219-4db8-b2aa-2e25ce5a6e62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:06:12.100817 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b314ce67-a990-4976-8c9c-f8e3ec487ae4 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:12.107427 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cfdc50-820e-4b1f-bbfe-f2b20fe583ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:12.108041 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cfdc50-820e-4b1f-bbfe-f2b20fe583ca admin admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:12.108320 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cfdc50-820e-4b1f-bbfe-f2b20fe583ca admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:12.108637 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cfdc50-820e-4b1f-bbfe-f2b20fe583ca admin admin] PATH_INFO: `/v3/domains` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:12.109349 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cfdc50-820e-4b1f-bbfe-f2b20fe583ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 22:06:12.109656 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cfdc50-820e-4b1f-bbfe-f2b20fe583ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:12.115342 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cfdc50-820e-4b1f-bbfe-f2b20fe583ca admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:12.124756 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1270/2514] 10.222.0.27 () {58 vars in 1153 bytes} [Thu Aug 18 22:06:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 22:06:12.129180 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cfdc50-820e-4b1f-bbfe-f2b20fe583ca admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:12.139986 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cfdc50-820e-4b1f-bbfe-f2b20fe583ca admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:12.147078 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6fd1d3-8d5c-4c35-9f89-e85d41cd24f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:12.147688 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6fd1d3-8d5c-4c35-9f89-e85d41cd24f9 admin admin] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:12.147971 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6fd1d3-8d5c-4c35-9f89-e85d41cd24f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:12.148248 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6fd1d3-8d5c-4c35-9f89-e85d41cd24f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:12.148921 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6fd1d3-8d5c-4c35-9f89-e85d41cd24f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:12.150847 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6fd1d3-8d5c-4c35-9f89-e85d41cd24f9 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:12.175994 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1245/2515] 10.222.0.27 () {58 vars in 1018 bytes} [Thu Aug 18 22:06:12 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:06:12.187169 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd88f32-d219-4db8-b2aa-2e25ce5a6e62 None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:12.188675 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-0cd88f32-d219-4db8-b2aa-2e25ce5a6e62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:06:12.201216 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd88f32-d219-4db8-b2aa-2e25ce5a6e62 None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:12.210571 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ee1c13-95c6-41b9-a36f-14bed489f156 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a937971ad1a4b0c8697c764f214d446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:12.210571 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ee1c13-95c6-41b9-a36f-14bed489f156 service neutron] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:12.210571 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ee1c13-95c6-41b9-a36f-14bed489f156 service neutron] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:12.210571 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ee1c13-95c6-41b9-a36f-14bed489f156 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:12.217740 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ee1c13-95c6-41b9-a36f-14bed489f156 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:12.219260 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ee1c13-95c6-41b9-a36f-14bed489f156 service neutron] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:12.232563 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1246/2516] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:06:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 22:06:12.282457 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1271/2517] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 18 22:06:12 2022] POST /identity/v3/projects => generated 385 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 22:06:12.289563 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ee1c13-95c6-41b9-a36f-14bed489f156 service neutron] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:12.298561 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ee1c13-95c6-41b9-a36f-14bed489f156 service neutron] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:12.358235 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6fd1d3-8d5c-4c35-9f89-e85d41cd24f9 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:12.360962 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-3a6fd1d3-8d5c-4c35-9f89-e85d41cd24f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:06:12.390490 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df538af-4fd8-41e5-9491-e38354123ebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:12.392340 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df538af-4fd8-41e5-9491-e38354123ebc admin admin] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:12.393736 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df538af-4fd8-41e5-9491-e38354123ebc admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:12.394181 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df538af-4fd8-41e5-9491-e38354123ebc admin admin] PATH_INFO: `/v3/users` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:12.395894 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df538af-4fd8-41e5-9491-e38354123ebc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:12.399092 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df538af-4fd8-41e5-9491-e38354123ebc admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:12.457568 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6fd1d3-8d5c-4c35-9f89-e85d41cd24f9 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:12.463302 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d970fb-f9ea-4a81-9787-5043178e9a92 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b44c0cf2d8b34f3e81c59d19eedbdfcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:12.463916 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d970fb-f9ea-4a81-9787-5043178e9a92 service placement] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:12.464232 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d970fb-f9ea-4a81-9787-5043178e9a92 service placement] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:12.464511 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d970fb-f9ea-4a81-9787-5043178e9a92 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:12.466314 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-98d970fb-f9ea-4a81-9787-5043178e9a92 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:06:12.480864 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1247/2518] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 18 22:06:12 2022] POST /identity/v3/users => generated 293 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 22:06:12.485188 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df538af-4fd8-41e5-9491-e38354123ebc admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:12.486064 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d970fb-f9ea-4a81-9787-5043178e9a92 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:12.489378 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d970fb-f9ea-4a81-9787-5043178e9a92 service placement] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:12.494079 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:06:12.500057 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df538af-4fd8-41e5-9491-e38354123ebc admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:12.501044 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1272/2519] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:06:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 22:06:12.521503 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0671b3-9ccb-421e-b8f8-83dcf12c9427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:12.522183 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0671b3-9ccb-421e-b8f8-83dcf12c9427 admin admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:12.524059 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0671b3-9ccb-421e-b8f8-83dcf12c9427 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:12.524059 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0671b3-9ccb-421e-b8f8-83dcf12c9427 admin admin] PATH_INFO: `/v3/roles` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:12.524059 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0671b3-9ccb-421e-b8f8-83dcf12c9427 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:12.526587 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0671b3-9ccb-421e-b8f8-83dcf12c9427 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:12.543892 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1248/2520] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:06:12 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 22:06:12.545156 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d970fb-f9ea-4a81-9787-5043178e9a92 service placement] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:12.560824 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d970fb-f9ea-4a81-9787-5043178e9a92 service placement] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:12.567367 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a852e52-e5b1-41d8-a45e-4584d5481a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:12.567996 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a852e52-e5b1-41d8-a45e-4584d5481a9d admin admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:12.569086 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a852e52-e5b1-41d8-a45e-4584d5481a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:12.569086 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a852e52-e5b1-41d8-a45e-4584d5481a9d admin admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:12.569304 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a852e52-e5b1-41d8-a45e-4584d5481a9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:12.571408 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a852e52-e5b1-41d8-a45e-4584d5481a9d admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:12.583553 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:06:12.592027 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1273/2521] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:06:12 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:06:12.593083 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0671b3-9ccb-421e-b8f8-83dcf12c9427 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:12.604659 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0671b3-9ccb-421e-b8f8-83dcf12c9427 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:12.609494 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ede5e34-da0b-433b-890d-2e4c3fd523ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:12.610188 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ede5e34-da0b-433b-890d-2e4c3fd523ed admin admin] REQUEST_METHOD: `PUT` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:12.610702 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ede5e34-da0b-433b-890d-2e4c3fd523ed admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:12.611207 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ede5e34-da0b-433b-890d-2e4c3fd523ed admin admin] PATH_INFO: `/v3/projects/e42c68a4847f4c48948cb9dc99f5e890/users/4f4bfe0462ab4ed2b34cee5925248044/roles/de8f2438056f4af9879423f8a59e0e0b` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:12.628621 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ede5e34-da0b-433b-890d-2e4c3fd523ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=e42c68a4847f4c48948cb9dc99f5e890, user_id=4f4bfe0462ab4ed2b34cee5925248044, role_id=de8f2438056f4af9879423f8a59e0e0b)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:12.631428 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ede5e34-da0b-433b-890d-2e4c3fd523ed admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:12.716175 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1249/2522] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 18 22:06:12 2022] PUT /identity/v3/projects/e42c68a4847f4c48948cb9dc99f5e890/users/4f4bfe0462ab4ed2b34cee5925248044/roles/de8f2438056f4af9879423f8a59e0e0b => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:06:12.733770 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7d6d8c-c453-493f-b237-c960ad0ce7c3 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:12.733770 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7d6d8c-c453-493f-b237-c960ad0ce7c3 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:12.733770 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7d6d8c-c453-493f-b237-c960ad0ce7c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:12.759978 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-fb7d6d8c-c453-493f-b237-c960ad0ce7c3 None None] MFA Rules not processed for user `4f4bfe0462ab4ed2b34cee5925248044`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:06:12.761514 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-fb7d6d8c-c453-493f-b237-c960ad0ce7c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:06:12.855384 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1274/2523] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:06:12 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:06:12.864079 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ede5e34-da0b-433b-890d-2e4c3fd523ed admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:12.865849 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-7ede5e34-da0b-433b-890d-2e4c3fd523ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:06:12.959199 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ede5e34-da0b-433b-890d-2e4c3fd523ed admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:12.963900 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3336e24d-bd14-4758-9bab-769ea44209f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22b6a7c36f8a4795a75271b8079821c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:12.964573 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3336e24d-bd14-4758-9bab-769ea44209f9 service cinder] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:12.964881 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3336e24d-bd14-4758-9bab-769ea44209f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:12.965154 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3336e24d-bd14-4758-9bab-769ea44209f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:12.976484 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3336e24d-bd14-4758-9bab-769ea44209f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:12.977992 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3336e24d-bd14-4758-9bab-769ea44209f9 service cinder] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:12.992361 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1250/2524] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:06:12 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 22:06:14.337759 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7d6d8c-c453-493f-b237-c960ad0ce7c3 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:14.339741 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-fb7d6d8c-c453-493f-b237-c960ad0ce7c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:06:14.411117 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7d6d8c-c453-493f-b237-c960ad0ce7c3 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:14.416354 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8febbdd-7d03-429b-84b2-5bbbbbe7fc74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:14.417021 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8febbdd-7d03-429b-84b2-5bbbbbe7fc74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:14.417304 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8febbdd-7d03-429b-84b2-5bbbbbe7fc74 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:14.417584 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8febbdd-7d03-429b-84b2-5bbbbbe7fc74 admin admin] PATH_INFO: `/v3/users/4ca7e9098815480f89b2a9a8a222ae5e` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:14.418814 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8febbdd-7d03-429b-84b2-5bbbbbe7fc74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ca7e9098815480f89b2a9a8a222ae5e)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:14.420839 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8febbdd-7d03-429b-84b2-5bbbbbe7fc74 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:14.613463 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-e8febbdd-7d03-429b-84b2-5bbbbbe7fc74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ca7e9098815480f89b2a9a8a222ae5e'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:14.620541 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-e8febbdd-7d03-429b-84b2-5bbbbbe7fc74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ca7e9098815480f89b2a9a8a222ae5e'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:14.621295 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-e8febbdd-7d03-429b-84b2-5bbbbbe7fc74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ca7e9098815480f89b2a9a8a222ae5e'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:14.634049 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-e8febbdd-7d03-429b-84b2-5bbbbbe7fc74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ca7e9098815480f89b2a9a8a222ae5e'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:14.695859 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-e8febbdd-7d03-429b-84b2-5bbbbbe7fc74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ca7e9098815480f89b2a9a8a222ae5e'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:14.710804 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1275/2525] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 18 22:06:14 2022] DELETE /identity/v3/users/4ca7e9098815480f89b2a9a8a222ae5e => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:06:15.043327 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3336e24d-bd14-4758-9bab-769ea44209f9 service cinder] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:15.055653 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3336e24d-bd14-4758-9bab-769ea44209f9 service cinder] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:15.122699 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f67e9cd-409f-4835-ba79-283369bb6474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:15.122699 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f67e9cd-409f-4835-ba79-283369bb6474 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:15.122699 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f67e9cd-409f-4835-ba79-283369bb6474 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:15.122934 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f67e9cd-409f-4835-ba79-283369bb6474 admin admin] PATH_INFO: `/v3/projects/68be025940154d63992a4805f1be8b64` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:15.124041 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f67e9cd-409f-4835-ba79-283369bb6474 admin admin] RBAC: Authorizing `identity:delete_project(project_id=68be025940154d63992a4805f1be8b64)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:15.126044 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f67e9cd-409f-4835-ba79-283369bb6474 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:15.151600 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539174e2-6e6e-4878-9c99-d5f856a9685a None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:15.151891 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539174e2-6e6e-4878-9c99-d5f856a9685a None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:15.152169 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539174e2-6e6e-4878-9c99-d5f856a9685a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:15.173542 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-539174e2-6e6e-4878-9c99-d5f856a9685a None None] MFA Rules not processed for user `f079aa6ed5594a4982172b51b93ac54f`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:06:15.175112 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-539174e2-6e6e-4878-9c99-d5f856a9685a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:06:15.179456 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:06:15.231384 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1276/2526] 10.222.0.27 () {58 vars in 1009 bytes} [Thu Aug 18 22:06:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 22:06:15.245352 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539174e2-6e6e-4878-9c99-d5f856a9685a None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:15.246702 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-539174e2-6e6e-4878-9c99-d5f856a9685a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:06:15.275928 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-0f67e9cd-409f-4835-ba79-283369bb6474 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68be025940154d63992a4805f1be8b64', 'request_id': 'req-0f67e9cd-409f-4835-ba79-283369bb6474'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:15.281788 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-0f67e9cd-409f-4835-ba79-283369bb6474 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68be025940154d63992a4805f1be8b64', 'request_id': 'req-0f67e9cd-409f-4835-ba79-283369bb6474'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:15.324741 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539174e2-6e6e-4878-9c99-d5f856a9685a None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:15.365242 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-0f67e9cd-409f-4835-ba79-283369bb6474 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68be025940154d63992a4805f1be8b64', 'request_id': 'req-0f67e9cd-409f-4835-ba79-283369bb6474'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:15.380956 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-0f67e9cd-409f-4835-ba79-283369bb6474 admin admin] The token cache is being invalidate because project 68be025940154d63992a4805f1be8b64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88096) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 22:06:15.380956 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-0f67e9cd-409f-4835-ba79-283369bb6474 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:15.381714 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-0f67e9cd-409f-4835-ba79-283369bb6474 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:15.384635 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1251/2527] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 18 22:06:15 2022] DELETE /identity/v3/projects/68be025940154d63992a4805f1be8b64 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:06:15.388328 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf5d2e1-d7f5-4548-8a4c-9ff9dad9e946 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:15.388661 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf5d2e1-d7f5-4548-8a4c-9ff9dad9e946 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:15.388939 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf5d2e1-d7f5-4548-8a4c-9ff9dad9e946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:15.399203 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:06:15.407882 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d51b7a5-6e40-4323-9dd5-f8f42e1aafc5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae59e6dca304c949942ae769acedc74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:15.408423 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d51b7a5-6e40-4323-9dd5-f8f42e1aafc5 service swift] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:15.409414 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d51b7a5-6e40-4323-9dd5-f8f42e1aafc5 service swift] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:15.409808 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d51b7a5-6e40-4323-9dd5-f8f42e1aafc5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:15.411685 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-7d51b7a5-6e40-4323-9dd5-f8f42e1aafc5 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:06:15.414278 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-ddf5d2e1-d7f5-4548-8a4c-9ff9dad9e946 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:06:15.415561 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-ddf5d2e1-d7f5-4548-8a4c-9ff9dad9e946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:06:15.478857 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d51b7a5-6e40-4323-9dd5-f8f42e1aafc5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:15.480489 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d51b7a5-6e40-4323-9dd5-f8f42e1aafc5 service swift] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:15.484150 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:06:15.489850 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1277/2528] 10.222.0.27 () {60 vars in 1384 bytes} [Thu Aug 18 22:06:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 18 22:06:15.493536 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1252/2529] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:06:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 22:06:15.508232 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5f4d93-4dac-44f8-99de-546841f99c67 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:15.508907 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5f4d93-4dac-44f8-99de-546841f99c67 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:15.508907 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5f4d93-4dac-44f8-99de-546841f99c67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:15.531357 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-0d5f4d93-4dac-44f8-99de-546841f99c67 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:06:15.532627 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-0d5f4d93-4dac-44f8-99de-546841f99c67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:06:15.544739 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1278/2530] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:06:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:06:15.546771 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf5d2e1-d7f5-4548-8a4c-9ff9dad9e946 None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:15.557518 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf5d2e1-d7f5-4548-8a4c-9ff9dad9e946 None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:15.563185 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61619d9-7eb5-4849-8cbc-d08fc1264cdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:15.563802 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61619d9-7eb5-4849-8cbc-d08fc1264cdd admin admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:15.564079 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61619d9-7eb5-4849-8cbc-d08fc1264cdd admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:15.564351 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61619d9-7eb5-4849-8cbc-d08fc1264cdd admin admin] PATH_INFO: `/v3/domains` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:15.565628 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61619d9-7eb5-4849-8cbc-d08fc1264cdd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 22:06:15.569980 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61619d9-7eb5-4849-8cbc-d08fc1264cdd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:15.569980 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61619d9-7eb5-4849-8cbc-d08fc1264cdd admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:15.579790 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1253/2531] 10.222.0.27 () {58 vars in 1153 bytes} [Thu Aug 18 22:06:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 22:06:15.584884 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5f4d93-4dac-44f8-99de-546841f99c67 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:15.595429 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5f4d93-4dac-44f8-99de-546841f99c67 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:15.600658 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c240aec-3bf6-4e26-a2ba-3d6bdd8effcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:15.601273 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c240aec-3bf6-4e26-a2ba-3d6bdd8effcc admin admin] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:15.601661 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c240aec-3bf6-4e26-a2ba-3d6bdd8effcc admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:15.601903 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c240aec-3bf6-4e26-a2ba-3d6bdd8effcc admin admin] PATH_INFO: `/v3/projects` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:15.602434 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c240aec-3bf6-4e26-a2ba-3d6bdd8effcc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:15.604390 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c240aec-3bf6-4e26-a2ba-3d6bdd8effcc admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:15.722626 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61619d9-7eb5-4849-8cbc-d08fc1264cdd admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:15.724057 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1279/2532] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 18 22:06:15 2022] POST /identity/v3/projects => generated 365 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 22:06:15.741563 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61619d9-7eb5-4849-8cbc-d08fc1264cdd admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:15.831547 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecd2a85-b15f-4aff-95fc-2d838e7d465e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:15.832952 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecd2a85-b15f-4aff-95fc-2d838e7d465e admin admin] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:15.833383 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecd2a85-b15f-4aff-95fc-2d838e7d465e admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:15.833923 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecd2a85-b15f-4aff-95fc-2d838e7d465e admin admin] PATH_INFO: `/v3/users` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:15.835368 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecd2a85-b15f-4aff-95fc-2d838e7d465e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:15.838704 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecd2a85-b15f-4aff-95fc-2d838e7d465e admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:15.988742 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1254/2533] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 18 22:06:15 2022] POST /identity/v3/users => generated 283 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 22:06:15.992979 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c240aec-3bf6-4e26-a2ba-3d6bdd8effcc admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:16.007160 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c240aec-3bf6-4e26-a2ba-3d6bdd8effcc admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:16.013894 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0ff379-c001-468d-9286-44f4ffaa4c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:16.014763 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0ff379-c001-468d-9286-44f4ffaa4c37 admin admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:16.015140 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0ff379-c001-468d-9286-44f4ffaa4c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:16.016004 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0ff379-c001-468d-9286-44f4ffaa4c37 admin admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:16.016848 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0ff379-c001-468d-9286-44f4ffaa4c37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:16.019826 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0ff379-c001-468d-9286-44f4ffaa4c37 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:16.031531 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1280/2534] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:06:15 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 22:06:16.036364 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecd2a85-b15f-4aff-95fc-2d838e7d465e admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:16.047483 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecd2a85-b15f-4aff-95fc-2d838e7d465e admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:16.056508 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb398bf-f0a5-4561-8985-51bf951d6eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:16.058118 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb398bf-f0a5-4561-8985-51bf951d6eb4 admin admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:16.058118 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb398bf-f0a5-4561-8985-51bf951d6eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:16.058118 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb398bf-f0a5-4561-8985-51bf951d6eb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:16.059062 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb398bf-f0a5-4561-8985-51bf951d6eb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:16.061174 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb398bf-f0a5-4561-8985-51bf951d6eb4 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:16.074236 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1255/2535] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:06:16 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:06:16.078577 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0ff379-c001-468d-9286-44f4ffaa4c37 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:16.092524 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0ff379-c001-468d-9286-44f4ffaa4c37 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:16.100548 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9cb6d7-9bfd-489c-8f92-d814d3f37b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:16.101424 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9cb6d7-9bfd-489c-8f92-d814d3f37b48 admin admin] REQUEST_METHOD: `PUT` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:16.101709 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9cb6d7-9bfd-489c-8f92-d814d3f37b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:16.101995 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9cb6d7-9bfd-489c-8f92-d814d3f37b48 admin admin] PATH_INFO: `/v3/projects/1957bf785262453783917d9014d898ee/users/2fa9c70aaf2d42858e3eb89c9f2373a8/roles/de8f2438056f4af9879423f8a59e0e0b` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:16.118150 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9cb6d7-9bfd-489c-8f92-d814d3f37b48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1957bf785262453783917d9014d898ee, user_id=2fa9c70aaf2d42858e3eb89c9f2373a8, role_id=de8f2438056f4af9879423f8a59e0e0b)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:16.120895 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9cb6d7-9bfd-489c-8f92-d814d3f37b48 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:16.199781 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1281/2536] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 18 22:06:16 2022] PUT /identity/v3/projects/1957bf785262453783917d9014d898ee/users/2fa9c70aaf2d42858e3eb89c9f2373a8/roles/de8f2438056f4af9879423f8a59e0e0b => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:06:16.211128 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d804c0-1715-4467-91a5-da291d466918 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:16.211417 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d804c0-1715-4467-91a5-da291d466918 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:16.211699 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d804c0-1715-4467-91a5-da291d466918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:16.243724 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-02d804c0-1715-4467-91a5-da291d466918 None None] MFA Rules not processed for user `2fa9c70aaf2d42858e3eb89c9f2373a8`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:06:16.245589 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-02d804c0-1715-4467-91a5-da291d466918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:06:16.315517 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:06:16.325400 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1256/2537] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:06:16 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:06:16.332150 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9cb6d7-9bfd-489c-8f92-d814d3f37b48 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:16.423977 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9cb6d7-9bfd-489c-8f92-d814d3f37b48 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:16.432857 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deb6b1c-b1b5-4b65-8c8b-eadedfb1c72e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:16.433533 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deb6b1c-b1b5-4b65-8c8b-eadedfb1c72e admin admin] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:16.433817 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deb6b1c-b1b5-4b65-8c8b-eadedfb1c72e admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:16.434094 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deb6b1c-b1b5-4b65-8c8b-eadedfb1c72e admin admin] PATH_INFO: `/v3/projects` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:16.435350 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1deb6b1c-b1b5-4b65-8c8b-eadedfb1c72e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:16.442855 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1deb6b1c-b1b5-4b65-8c8b-eadedfb1c72e admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:16.612982 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1282/2538] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 18 22:06:16 2022] POST /identity/v3/projects => generated 365 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 22:06:16.618463 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d804c0-1715-4467-91a5-da291d466918 None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:16.635699 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d804c0-1715-4467-91a5-da291d466918 None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:16.729119 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5bdef5-1e78-4da4-9101-39b45f50523d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:16.729740 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5bdef5-1e78-4da4-9101-39b45f50523d admin admin] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:16.733464 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5bdef5-1e78-4da4-9101-39b45f50523d admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:16.733464 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5bdef5-1e78-4da4-9101-39b45f50523d admin admin] PATH_INFO: `/v3/users` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:16.733464 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5bdef5-1e78-4da4-9101-39b45f50523d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:16.733464 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5bdef5-1e78-4da4-9101-39b45f50523d admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:16.852823 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1257/2539] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 18 22:06:16 2022] POST /identity/v3/users => generated 289 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 22:06:16.854106 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deb6b1c-b1b5-4b65-8c8b-eadedfb1c72e admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:16.865878 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deb6b1c-b1b5-4b65-8c8b-eadedfb1c72e admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:16.870990 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefb2931-9559-4bc8-9c71-5f00fa1e99fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:16.871702 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefb2931-9559-4bc8-9c71-5f00fa1e99fc admin admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:16.872102 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefb2931-9559-4bc8-9c71-5f00fa1e99fc admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:16.872547 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefb2931-9559-4bc8-9c71-5f00fa1e99fc admin admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:16.873314 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefb2931-9559-4bc8-9c71-5f00fa1e99fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:16.875088 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefb2931-9559-4bc8-9c71-5f00fa1e99fc admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:16.887850 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1283/2540] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:06:16 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 22:06:16.892764 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5bdef5-1e78-4da4-9101-39b45f50523d admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:16.904933 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5bdef5-1e78-4da4-9101-39b45f50523d admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:16.910611 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5c788e-fb98-4f5b-92c1-fa46e0334db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:16.911924 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5c788e-fb98-4f5b-92c1-fa46e0334db1 admin admin] REQUEST_METHOD: `PUT` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:16.912311 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5c788e-fb98-4f5b-92c1-fa46e0334db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:16.912736 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5c788e-fb98-4f5b-92c1-fa46e0334db1 admin admin] PATH_INFO: `/v3/projects/175289c00e614bf78dfa6c4bd0b2be6d/users/e6d61b95bd404cd9b1d0cd500513b326/roles/0833202e2a3d47d1b6b3af57006641b1` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:16.941284 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5c788e-fb98-4f5b-92c1-fa46e0334db1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=175289c00e614bf78dfa6c4bd0b2be6d, user_id=e6d61b95bd404cd9b1d0cd500513b326, role_id=0833202e2a3d47d1b6b3af57006641b1)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:16.944313 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5c788e-fb98-4f5b-92c1-fa46e0334db1 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:17.022007 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1258/2541] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 18 22:06:16 2022] PUT /identity/v3/projects/175289c00e614bf78dfa6c4bd0b2be6d/users/e6d61b95bd404cd9b1d0cd500513b326/roles/0833202e2a3d47d1b6b3af57006641b1 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:06:17.026087 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefb2931-9559-4bc8-9c71-5f00fa1e99fc admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:17.038492 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefb2931-9559-4bc8-9c71-5f00fa1e99fc admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:17.153830 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127b97da-3847-48a9-af8b-adf64a428d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:17.155642 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127b97da-3847-48a9-af8b-adf64a428d04 admin admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:17.155982 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127b97da-3847-48a9-af8b-adf64a428d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:17.156434 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127b97da-3847-48a9-af8b-adf64a428d04 admin admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:17.157328 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127b97da-3847-48a9-af8b-adf64a428d04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:17.160666 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127b97da-3847-48a9-af8b-adf64a428d04 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:17.190282 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1284/2542] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:06:17 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 22:06:17.194794 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5c788e-fb98-4f5b-92c1-fa46e0334db1 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:17.206953 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5c788e-fb98-4f5b-92c1-fa46e0334db1 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:17.212432 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64f2545-2318-409f-86db-811763a4f6f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:17.213249 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64f2545-2318-409f-86db-811763a4f6f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:17.213632 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64f2545-2318-409f-86db-811763a4f6f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:17.214010 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64f2545-2318-409f-86db-811763a4f6f6 admin admin] PATH_INFO: `/v3/projects/175289c00e614bf78dfa6c4bd0b2be6d/users/e6d61b95bd404cd9b1d0cd500513b326/roles/0833202e2a3d47d1b6b3af57006641b1` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:17.216099 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64f2545-2318-409f-86db-811763a4f6f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=175289c00e614bf78dfa6c4bd0b2be6d, user_id=e6d61b95bd404cd9b1d0cd500513b326, role_id=0833202e2a3d47d1b6b3af57006641b1)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:17.218912 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64f2545-2318-409f-86db-811763a4f6f6 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:17.233162 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1259/2543] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 18 22:06:17 2022] PUT /identity/v3/projects/175289c00e614bf78dfa6c4bd0b2be6d/users/e6d61b95bd404cd9b1d0cd500513b326/roles/0833202e2a3d47d1b6b3af57006641b1 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 22:06:17.247812 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c5b55b-3542-49ae-8e0e-21828f734d5b None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:17.248108 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c5b55b-3542-49ae-8e0e-21828f734d5b None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:17.248394 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c5b55b-3542-49ae-8e0e-21828f734d5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:17.257536 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:06:17.290817 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-a0c5b55b-3542-49ae-8e0e-21828f734d5b None None] MFA Rules not processed for user `e6d61b95bd404cd9b1d0cd500513b326`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:06:17.290817 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-a0c5b55b-3542-49ae-8e0e-21828f734d5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:06:17.392279 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1285/2544] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:06:17 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:06:17.405315 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64f2545-2318-409f-86db-811763a4f6f6 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:17.407190 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-d64f2545-2318-409f-86db-811763a4f6f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:06:17.484653 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64f2545-2318-409f-86db-811763a4f6f6 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:17.489284 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1219af-bc07-44a5-8397-6ef631d903e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22b6a7c36f8a4795a75271b8079821c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:17.490060 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1219af-bc07-44a5-8397-6ef631d903e1 service cinder] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:17.490789 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1219af-bc07-44a5-8397-6ef631d903e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:17.491163 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1219af-bc07-44a5-8397-6ef631d903e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:17.501822 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1219af-bc07-44a5-8397-6ef631d903e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:17.504173 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1219af-bc07-44a5-8397-6ef631d903e1 service cinder] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:17.516533 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1260/2545] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:06:17 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:06:18.597196 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c5b55b-3542-49ae-8e0e-21828f734d5b None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:18.670678 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c5b55b-3542-49ae-8e0e-21828f734d5b None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:18.675743 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45116d1a-c824-493e-8c95-cab65eb96ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:18.676381 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45116d1a-c824-493e-8c95-cab65eb96ed3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:18.676694 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45116d1a-c824-493e-8c95-cab65eb96ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:18.676974 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45116d1a-c824-493e-8c95-cab65eb96ed3 admin admin] PATH_INFO: `/v3/users/2fa9c70aaf2d42858e3eb89c9f2373a8` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:18.678221 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45116d1a-c824-493e-8c95-cab65eb96ed3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2fa9c70aaf2d42858e3eb89c9f2373a8)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:18.680482 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45116d1a-c824-493e-8c95-cab65eb96ed3 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:18.842054 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-45116d1a-c824-493e-8c95-cab65eb96ed3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2fa9c70aaf2d42858e3eb89c9f2373a8'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:18.850775 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-45116d1a-c824-493e-8c95-cab65eb96ed3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2fa9c70aaf2d42858e3eb89c9f2373a8'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:18.851637 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-45116d1a-c824-493e-8c95-cab65eb96ed3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2fa9c70aaf2d42858e3eb89c9f2373a8'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:18.867320 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-45116d1a-c824-493e-8c95-cab65eb96ed3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2fa9c70aaf2d42858e3eb89c9f2373a8'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:18.957620 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-45116d1a-c824-493e-8c95-cab65eb96ed3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2fa9c70aaf2d42858e3eb89c9f2373a8'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:18.965104 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1286/2546] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 18 22:06:18 2022] DELETE /identity/v3/users/2fa9c70aaf2d42858e3eb89c9f2373a8 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:06:18.969699 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7a3701-c118-43b4-814c-18f315190ed6 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:18.970223 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7a3701-c118-43b4-814c-18f315190ed6 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:18.973475 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7a3701-c118-43b4-814c-18f315190ed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:18.997997 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-cc7a3701-c118-43b4-814c-18f315190ed6 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:06:18.999361 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-cc7a3701-c118-43b4-814c-18f315190ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:06:19.075912 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:06:19.116855 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1261/2547] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:06:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:06:19.124144 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45116d1a-c824-493e-8c95-cab65eb96ed3 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:19.125900 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-45116d1a-c824-493e-8c95-cab65eb96ed3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:06:19.154782 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:06:19.236538 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45116d1a-c824-493e-8c95-cab65eb96ed3 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:19.253858 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffa7248-c499-46a7-83e8-c167b19812c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a937971ad1a4b0c8697c764f214d446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:19.254685 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffa7248-c499-46a7-83e8-c167b19812c8 service neutron] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:19.254949 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffa7248-c499-46a7-83e8-c167b19812c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:19.255225 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffa7248-c499-46a7-83e8-c167b19812c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:19.278071 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffa7248-c499-46a7-83e8-c167b19812c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:19.279598 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffa7248-c499-46a7-83e8-c167b19812c8 service neutron] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:19.296670 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1287/2548] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:06:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:06:19.814655 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7a3701-c118-43b4-814c-18f315190ed6 None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:19.817018 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-cc7a3701-c118-43b4-814c-18f315190ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:06:19.832502 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7a3701-c118-43b4-814c-18f315190ed6 None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:19.837946 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9446e61e-0841-4092-abe9-9256050726e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:19.838811 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9446e61e-0841-4092-abe9-9256050726e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:19.839210 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9446e61e-0841-4092-abe9-9256050726e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:19.839564 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9446e61e-0841-4092-abe9-9256050726e5 admin admin] PATH_INFO: `/v3/projects/1957bf785262453783917d9014d898ee` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:19.840774 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9446e61e-0841-4092-abe9-9256050726e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1957bf785262453783917d9014d898ee)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:19.842971 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9446e61e-0841-4092-abe9-9256050726e5 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:19.966870 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-9446e61e-0841-4092-abe9-9256050726e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1957bf785262453783917d9014d898ee', 'request_id': 'req-9446e61e-0841-4092-abe9-9256050726e5'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:19.976565 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-9446e61e-0841-4092-abe9-9256050726e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1957bf785262453783917d9014d898ee', 'request_id': 'req-9446e61e-0841-4092-abe9-9256050726e5'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:20.043546 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-9446e61e-0841-4092-abe9-9256050726e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1957bf785262453783917d9014d898ee', 'request_id': 'req-9446e61e-0841-4092-abe9-9256050726e5'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:20.058613 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-9446e61e-0841-4092-abe9-9256050726e5 admin admin] The token cache is being invalidate because project 1957bf785262453783917d9014d898ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88096) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 22:06:20.058810 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-9446e61e-0841-4092-abe9-9256050726e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:20.059672 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-9446e61e-0841-4092-abe9-9256050726e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:20.061364 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1262/2549] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 18 22:06:19 2022] DELETE /identity/v3/projects/1957bf785262453783917d9014d898ee => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:06:20.066354 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffa7248-c499-46a7-83e8-c167b19812c8 service neutron] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:20.077472 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffa7248-c499-46a7-83e8-c167b19812c8 service neutron] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:20.145702 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8f997a-97fe-4bd4-8e35-4ddbe52aa42c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:20.146500 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8f997a-97fe-4bd4-8e35-4ddbe52aa42c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:20.146774 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8f997a-97fe-4bd4-8e35-4ddbe52aa42c admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:20.147134 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8f997a-97fe-4bd4-8e35-4ddbe52aa42c admin admin] PATH_INFO: `/v3/users/e6d61b95bd404cd9b1d0cd500513b326` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:20.148548 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8f997a-97fe-4bd4-8e35-4ddbe52aa42c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6d61b95bd404cd9b1d0cd500513b326)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:20.155144 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8f997a-97fe-4bd4-8e35-4ddbe52aa42c admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:20.338922 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-9c8f997a-97fe-4bd4-8e35-4ddbe52aa42c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6d61b95bd404cd9b1d0cd500513b326'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:20.350196 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-9c8f997a-97fe-4bd4-8e35-4ddbe52aa42c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6d61b95bd404cd9b1d0cd500513b326'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:20.351083 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-9c8f997a-97fe-4bd4-8e35-4ddbe52aa42c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6d61b95bd404cd9b1d0cd500513b326'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:20.384574 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-9c8f997a-97fe-4bd4-8e35-4ddbe52aa42c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6d61b95bd404cd9b1d0cd500513b326'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:20.441325 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-9c8f997a-97fe-4bd4-8e35-4ddbe52aa42c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6d61b95bd404cd9b1d0cd500513b326'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:20.448426 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1288/2550] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 18 22:06:20 2022] DELETE /identity/v3/users/e6d61b95bd404cd9b1d0cd500513b326 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:06:20.463390 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9446e61e-0841-4092-abe9-9256050726e5 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:20.465092 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-9446e61e-0841-4092-abe9-9256050726e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:06:20.479049 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9446e61e-0841-4092-abe9-9256050726e5 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:20.546514 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5d9021-1b3c-44f1-9407-9185c1d29925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:20.547154 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5d9021-1b3c-44f1-9407-9185c1d29925 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:20.572836 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5d9021-1b3c-44f1-9407-9185c1d29925 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:20.572836 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5d9021-1b3c-44f1-9407-9185c1d29925 admin admin] PATH_INFO: `/v3/users/4f4bfe0462ab4ed2b34cee5925248044` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:20.572836 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5d9021-1b3c-44f1-9407-9185c1d29925 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f4bfe0462ab4ed2b34cee5925248044)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:20.572836 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5d9021-1b3c-44f1-9407-9185c1d29925 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:21.053365 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-2f5d9021-1b3c-44f1-9407-9185c1d29925 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f4bfe0462ab4ed2b34cee5925248044'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:21.063014 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-2f5d9021-1b3c-44f1-9407-9185c1d29925 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f4bfe0462ab4ed2b34cee5925248044'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:21.073250 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-2f5d9021-1b3c-44f1-9407-9185c1d29925 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f4bfe0462ab4ed2b34cee5925248044'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:21.074328 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-2f5d9021-1b3c-44f1-9407-9185c1d29925 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f4bfe0462ab4ed2b34cee5925248044'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:21.088434 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-2f5d9021-1b3c-44f1-9407-9185c1d29925 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f4bfe0462ab4ed2b34cee5925248044'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:21.092305 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:06:21.184912 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1263/2551] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 18 22:06:20 2022] DELETE /identity/v3/users/4f4bfe0462ab4ed2b34cee5925248044 => generated 0 bytes in 722 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:06:21.190339 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1b4202-5fe5-4a6b-a1a7-c85a79066d07 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:21.190866 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1b4202-5fe5-4a6b-a1a7-c85a79066d07 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:21.191071 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1b4202-5fe5-4a6b-a1a7-c85a79066d07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:21.214402 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5d9021-1b3c-44f1-9407-9185c1d29925 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:21.214932 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-ed1b4202-5fe5-4a6b-a1a7-c85a79066d07 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:06:21.216169 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-2f5d9021-1b3c-44f1-9407-9185c1d29925 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:06:21.216302 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-ed1b4202-5fe5-4a6b-a1a7-c85a79066d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:06:21.264634 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:06:21.322012 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5d9021-1b3c-44f1-9407-9185c1d29925 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:21.326423 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1289/2552] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:06:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:06:21.359164 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04746535-0f32-44e4-9d1b-8254c6ca87aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:21.359164 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04746535-0f32-44e4-9d1b-8254c6ca87aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:21.359164 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04746535-0f32-44e4-9d1b-8254c6ca87aa admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:21.359164 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04746535-0f32-44e4-9d1b-8254c6ca87aa admin admin] PATH_INFO: `/v3/projects/175289c00e614bf78dfa6c4bd0b2be6d` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:21.360239 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04746535-0f32-44e4-9d1b-8254c6ca87aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=175289c00e614bf78dfa6c4bd0b2be6d)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:21.360239 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04746535-0f32-44e4-9d1b-8254c6ca87aa admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:21.360431 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1b4202-5fe5-4a6b-a1a7-c85a79066d07 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:21.360431 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-ed1b4202-5fe5-4a6b-a1a7-c85a79066d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:06:21.410287 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1b4202-5fe5-4a6b-a1a7-c85a79066d07 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:21.414163 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5780c115-8820-49ab-ad24-6f88aa894fab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a937971ad1a4b0c8697c764f214d446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:21.414813 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5780c115-8820-49ab-ad24-6f88aa894fab service neutron] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:21.415066 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5780c115-8820-49ab-ad24-6f88aa894fab service neutron] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:21.415342 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5780c115-8820-49ab-ad24-6f88aa894fab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:21.426818 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5780c115-8820-49ab-ad24-6f88aa894fab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:21.428449 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5780c115-8820-49ab-ad24-6f88aa894fab service neutron] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:21.439409 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1290/2553] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:06:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 22:06:21.468078 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-04746535-0f32-44e4-9d1b-8254c6ca87aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '175289c00e614bf78dfa6c4bd0b2be6d', 'request_id': 'req-04746535-0f32-44e4-9d1b-8254c6ca87aa'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:21.483486 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-04746535-0f32-44e4-9d1b-8254c6ca87aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '175289c00e614bf78dfa6c4bd0b2be6d', 'request_id': 'req-04746535-0f32-44e4-9d1b-8254c6ca87aa'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:21.581026 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-04746535-0f32-44e4-9d1b-8254c6ca87aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '175289c00e614bf78dfa6c4bd0b2be6d', 'request_id': 'req-04746535-0f32-44e4-9d1b-8254c6ca87aa'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:21.620771 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-04746535-0f32-44e4-9d1b-8254c6ca87aa admin admin] The token cache is being invalidate because project 175289c00e614bf78dfa6c4bd0b2be6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88096) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 22:06:21.621051 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-04746535-0f32-44e4-9d1b-8254c6ca87aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:21.621777 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-04746535-0f32-44e4-9d1b-8254c6ca87aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:21.623326 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1264/2554] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 18 22:06:21 2022] DELETE /identity/v3/projects/175289c00e614bf78dfa6c4bd0b2be6d => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 22:06:21.628573 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75524acc-b9b8-4cf2-abab-defc665a889e None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:21.628895 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75524acc-b9b8-4cf2-abab-defc665a889e None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:21.629174 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75524acc-b9b8-4cf2-abab-defc665a889e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:21.681886 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-75524acc-b9b8-4cf2-abab-defc665a889e None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:06:21.683728 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-75524acc-b9b8-4cf2-abab-defc665a889e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:06:21.768330 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1291/2555] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:06:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:06:21.769650 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc81d9a1-e2ee-4d27-abc3-f37d59bc83bf None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:21.769940 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc81d9a1-e2ee-4d27-abc3-f37d59bc83bf None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:21.770213 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc81d9a1-e2ee-4d27-abc3-f37d59bc83bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:21.803113 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-fc81d9a1-e2ee-4d27-abc3-f37d59bc83bf None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:06:21.804697 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-fc81d9a1-e2ee-4d27-abc3-f37d59bc83bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:06:21.828854 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1265/2556] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:06:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 22:06:21.830124 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75524acc-b9b8-4cf2-abab-defc665a889e None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:21.847178 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75524acc-b9b8-4cf2-abab-defc665a889e None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:21.855231 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2718250-e97b-4057-9c54-de88ebd80c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:21.856452 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2718250-e97b-4057-9c54-de88ebd80c4f admin admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:21.857113 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2718250-e97b-4057-9c54-de88ebd80c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:21.858075 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2718250-e97b-4057-9c54-de88ebd80c4f admin admin] PATH_INFO: `/v3/domains` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:21.858748 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2718250-e97b-4057-9c54-de88ebd80c4f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 22:06:21.859064 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2718250-e97b-4057-9c54-de88ebd80c4f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:21.860997 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2718250-e97b-4057-9c54-de88ebd80c4f admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:21.881325 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1292/2557] 10.222.0.27 () {58 vars in 1153 bytes} [Thu Aug 18 22:06:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 22:06:21.887234 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc81d9a1-e2ee-4d27-abc3-f37d59bc83bf None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:21.897595 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc81d9a1-e2ee-4d27-abc3-f37d59bc83bf None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:21.902382 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55302499-4de8-4c39-abda-ca8dff2150c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:21.902994 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55302499-4de8-4c39-abda-ca8dff2150c0 admin admin] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:21.903330 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55302499-4de8-4c39-abda-ca8dff2150c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:21.903599 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55302499-4de8-4c39-abda-ca8dff2150c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:21.904238 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55302499-4de8-4c39-abda-ca8dff2150c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:21.908228 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55302499-4de8-4c39-abda-ca8dff2150c0 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:22.034896 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2718250-e97b-4057-9c54-de88ebd80c4f admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:22.040072 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1266/2558] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 18 22:06:21 2022] POST /identity/v3/projects => generated 401 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 22:06:22.045051 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55302499-4de8-4c39-abda-ca8dff2150c0 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:22.047222 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-c2718250-e97b-4057-9c54-de88ebd80c4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:06:22.064986 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2718250-e97b-4057-9c54-de88ebd80c4f admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:22.164790 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c546ae5a-00c7-4fc0-8e42-714348c1c9d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:22.165600 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c546ae5a-00c7-4fc0-8e42-714348c1c9d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:22.165975 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c546ae5a-00c7-4fc0-8e42-714348c1c9d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:22.166971 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c546ae5a-00c7-4fc0-8e42-714348c1c9d3 admin admin] PATH_INFO: `/v3/projects/e42c68a4847f4c48948cb9dc99f5e890` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:22.168371 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c546ae5a-00c7-4fc0-8e42-714348c1c9d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e42c68a4847f4c48948cb9dc99f5e890)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:22.175517 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c546ae5a-00c7-4fc0-8e42-714348c1c9d3 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:22.183426 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:06:22.197942 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:06:22.202846 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55302499-4de8-4c39-abda-ca8dff2150c0 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:22.211144 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15be90ff-900f-465c-a464-7396a053f131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:22.212478 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15be90ff-900f-465c-a464-7396a053f131 admin admin] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:22.212478 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15be90ff-900f-465c-a464-7396a053f131 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:22.212907 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15be90ff-900f-465c-a464-7396a053f131 admin admin] PATH_INFO: `/v3/users` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:22.213619 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15be90ff-900f-465c-a464-7396a053f131 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:22.215780 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15be90ff-900f-465c-a464-7396a053f131 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:22.323859 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-c546ae5a-00c7-4fc0-8e42-714348c1c9d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e42c68a4847f4c48948cb9dc99f5e890', 'request_id': 'req-c546ae5a-00c7-4fc0-8e42-714348c1c9d3'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:22.330876 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-c546ae5a-00c7-4fc0-8e42-714348c1c9d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e42c68a4847f4c48948cb9dc99f5e890', 'request_id': 'req-c546ae5a-00c7-4fc0-8e42-714348c1c9d3'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:22.346207 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1267/2559] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 18 22:06:22 2022] POST /identity/v3/users => generated 301 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 22:06:22.351820 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15be90ff-900f-465c-a464-7396a053f131 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:22.369134 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15be90ff-900f-465c-a464-7396a053f131 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:22.412215 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-c546ae5a-00c7-4fc0-8e42-714348c1c9d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e42c68a4847f4c48948cb9dc99f5e890', 'request_id': 'req-c546ae5a-00c7-4fc0-8e42-714348c1c9d3'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:22.428044 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-c546ae5a-00c7-4fc0-8e42-714348c1c9d3 admin admin] The token cache is being invalidate because project e42c68a4847f4c48948cb9dc99f5e890 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88097) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 22:06:22.428332 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-c546ae5a-00c7-4fc0-8e42-714348c1c9d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:22.429671 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-c546ae5a-00c7-4fc0-8e42-714348c1c9d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:22.442499 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1293/2560] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 18 22:06:22 2022] DELETE /identity/v3/projects/e42c68a4847f4c48948cb9dc99f5e890 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:06:22.450942 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f9b8e5-b7a3-45d8-80c1-8e5a57203df5 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:22.451155 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f9b8e5-b7a3-45d8-80c1-8e5a57203df5 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:22.451464 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f9b8e5-b7a3-45d8-80c1-8e5a57203df5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:22.451780 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724bd12d-9154-4c65-89d0-0f87d5e412b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:22.452415 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724bd12d-9154-4c65-89d0-0f87d5e412b9 admin admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:22.452882 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724bd12d-9154-4c65-89d0-0f87d5e412b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:22.453313 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724bd12d-9154-4c65-89d0-0f87d5e412b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:22.454063 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724bd12d-9154-4c65-89d0-0f87d5e412b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:22.456578 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724bd12d-9154-4c65-89d0-0f87d5e412b9 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:22.470444 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1268/2561] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:06:22 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:06:22.473968 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-91f9b8e5-b7a3-45d8-80c1-8e5a57203df5 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:06:22.476105 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-91f9b8e5-b7a3-45d8-80c1-8e5a57203df5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:06:22.485570 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724bd12d-9154-4c65-89d0-0f87d5e412b9 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:22.491525 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-724bd12d-9154-4c65-89d0-0f87d5e412b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:06:22.493475 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1294/2562] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:06:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:06:22.494919 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a902c4bf-a27b-4960-aa7b-7dd3b550ec7f None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:22.495207 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a902c4bf-a27b-4960-aa7b-7dd3b550ec7f None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:22.495483 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a902c4bf-a27b-4960-aa7b-7dd3b550ec7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:22.516548 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724bd12d-9154-4c65-89d0-0f87d5e412b9 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:22.525836 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32719345-712d-4977-ae65-6873e8b690e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:22.526889 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32719345-712d-4977-ae65-6873e8b690e7 admin admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:22.527330 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32719345-712d-4977-ae65-6873e8b690e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:22.527601 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32719345-712d-4977-ae65-6873e8b690e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:22.528972 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32719345-712d-4977-ae65-6873e8b690e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:22.531333 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32719345-712d-4977-ae65-6873e8b690e7 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:22.537389 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-a902c4bf-a27b-4960-aa7b-7dd3b550ec7f None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:06:22.538569 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-a902c4bf-a27b-4960-aa7b-7dd3b550ec7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:06:22.553247 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1269/2563] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:06:22 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:06:22.554903 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32719345-712d-4977-ae65-6873e8b690e7 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:22.555923 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1295/2564] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:06:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:06:22.560453 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a902c4bf-a27b-4960-aa7b-7dd3b550ec7f None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:22.568193 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32719345-712d-4977-ae65-6873e8b690e7 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:22.574965 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a902c4bf-a27b-4960-aa7b-7dd3b550ec7f None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:22.577509 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee5474c-8dcd-45c4-b9ed-1b123063b800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:22.585101 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c064ec9-8d00-41ae-935e-0087cf88aeea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:22.585798 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c064ec9-8d00-41ae-935e-0087cf88aeea admin admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:22.586088 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c064ec9-8d00-41ae-935e-0087cf88aeea admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:22.586365 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c064ec9-8d00-41ae-935e-0087cf88aeea admin admin] PATH_INFO: `/v3/domains` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:22.587103 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c064ec9-8d00-41ae-935e-0087cf88aeea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 22:06:22.587482 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c064ec9-8d00-41ae-935e-0087cf88aeea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:22.589181 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee5474c-8dcd-45c4-b9ed-1b123063b800 admin admin] REQUEST_METHOD: `PUT` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:22.589408 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c064ec9-8d00-41ae-935e-0087cf88aeea admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:22.589608 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee5474c-8dcd-45c4-b9ed-1b123063b800 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:22.591520 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee5474c-8dcd-45c4-b9ed-1b123063b800 admin admin] PATH_INFO: `/v3/projects/dd959dcdcaf24ecbb2013934f124353c/users/8a7a161b7dad4fb9a0f1faff7ab5a8ab/roles/de8f2438056f4af9879423f8a59e0e0b` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:22.616920 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1296/2565] 10.222.0.27 () {58 vars in 1153 bytes} [Thu Aug 18 22:06:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 22:06:22.618845 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c064ec9-8d00-41ae-935e-0087cf88aeea admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:22.628802 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee5474c-8dcd-45c4-b9ed-1b123063b800 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd959dcdcaf24ecbb2013934f124353c, user_id=8a7a161b7dad4fb9a0f1faff7ab5a8ab, role_id=de8f2438056f4af9879423f8a59e0e0b)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:22.628802 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee5474c-8dcd-45c4-b9ed-1b123063b800 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:22.633105 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c064ec9-8d00-41ae-935e-0087cf88aeea admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:22.638328 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2408533e-a527-49b4-b45f-566bd0f4ccca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:22.638950 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2408533e-a527-49b4-b45f-566bd0f4ccca admin admin] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:22.644869 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2408533e-a527-49b4-b45f-566bd0f4ccca admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:22.645442 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2408533e-a527-49b4-b45f-566bd0f4ccca admin admin] PATH_INFO: `/v3/projects` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:22.649314 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2408533e-a527-49b4-b45f-566bd0f4ccca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:22.652386 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2408533e-a527-49b4-b45f-566bd0f4ccca admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:22.749928 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1270/2566] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 18 22:06:22 2022] PUT /identity/v3/projects/dd959dcdcaf24ecbb2013934f124353c/users/8a7a161b7dad4fb9a0f1faff7ab5a8ab/roles/de8f2438056f4af9879423f8a59e0e0b => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:06:22.762624 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73b073d-f185-441e-af04-9403caea29db None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:22.762954 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73b073d-f185-441e-af04-9403caea29db None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:22.763208 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73b073d-f185-441e-af04-9403caea29db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:22.798477 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1297/2567] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 18 22:06:22 2022] POST /identity/v3/projects => generated 375 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 22:06:22.800733 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2408533e-a527-49b4-b45f-566bd0f4ccca admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:22.828191 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-c73b073d-f185-441e-af04-9403caea29db None None] MFA Rules not processed for user `8a7a161b7dad4fb9a0f1faff7ab5a8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:06:22.830881 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-c73b073d-f185-441e-af04-9403caea29db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:06:22.944362 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2408533e-a527-49b4-b45f-566bd0f4ccca admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:22.950493 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1a8faf-df11-4038-97f6-43fc731836b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:22.951207 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1a8faf-df11-4038-97f6-43fc731836b8 admin admin] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:22.951571 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1a8faf-df11-4038-97f6-43fc731836b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:22.952031 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1a8faf-df11-4038-97f6-43fc731836b8 admin admin] PATH_INFO: `/v3/users` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:22.953538 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1a8faf-df11-4038-97f6-43fc731836b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:22.958503 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1a8faf-df11-4038-97f6-43fc731836b8 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:22.990170 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1271/2568] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:06:22 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:06:22.997670 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73b073d-f185-441e-af04-9403caea29db None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:23.016542 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73b073d-f185-441e-af04-9403caea29db None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:23.022625 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3386537-8dbc-4ca6-8bc8-48904180f800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:23.022952 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3386537-8dbc-4ca6-8bc8-48904180f800 admin admin] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:23.023206 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3386537-8dbc-4ca6-8bc8-48904180f800 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:23.023478 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3386537-8dbc-4ca6-8bc8-48904180f800 admin admin] PATH_INFO: `/v3/projects` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:23.024108 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3386537-8dbc-4ca6-8bc8-48904180f800 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:23.026167 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3386537-8dbc-4ca6-8bc8-48904180f800 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:23.058500 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1298/2569] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 18 22:06:22 2022] POST /identity/v3/users => generated 288 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 22:06:23.062639 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1a8faf-df11-4038-97f6-43fc731836b8 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:23.074120 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1a8faf-df11-4038-97f6-43fc731836b8 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:23.079549 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09648cfa-2b88-41f9-95e3-8976edca6175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:23.087009 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09648cfa-2b88-41f9-95e3-8976edca6175 admin admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:23.087573 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09648cfa-2b88-41f9-95e3-8976edca6175 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:23.087853 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09648cfa-2b88-41f9-95e3-8976edca6175 admin admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:23.088898 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09648cfa-2b88-41f9-95e3-8976edca6175 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:23.090729 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09648cfa-2b88-41f9-95e3-8976edca6175 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:23.104851 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1299/2570] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:06:23 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 22:06:23.109015 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09648cfa-2b88-41f9-95e3-8976edca6175 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:23.121153 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09648cfa-2b88-41f9-95e3-8976edca6175 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:23.126345 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40752988-2e5f-4bb5-9b5f-38b71e374506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:23.128037 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40752988-2e5f-4bb5-9b5f-38b71e374506 admin admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:23.129089 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40752988-2e5f-4bb5-9b5f-38b71e374506 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:23.130036 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40752988-2e5f-4bb5-9b5f-38b71e374506 admin admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:23.130793 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40752988-2e5f-4bb5-9b5f-38b71e374506 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:23.132763 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40752988-2e5f-4bb5-9b5f-38b71e374506 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:23.154382 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1300/2571] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:06:23 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:06:23.156041 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40752988-2e5f-4bb5-9b5f-38b71e374506 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:23.159685 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1272/2572] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 18 22:06:22 2022] POST /identity/v3/projects => generated 401 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 22:06:23.160872 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3386537-8dbc-4ca6-8bc8-48904180f800 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:23.168722 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40752988-2e5f-4bb5-9b5f-38b71e374506 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:23.180837 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:06:23.185951 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:06:23.241086 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156330c3-2623-4d09-b7f4-bc6e34e258ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:23.241341 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3386537-8dbc-4ca6-8bc8-48904180f800 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:23.241852 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156330c3-2623-4d09-b7f4-bc6e34e258ef admin admin] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:23.241959 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156330c3-2623-4d09-b7f4-bc6e34e258ef admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:23.242250 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156330c3-2623-4d09-b7f4-bc6e34e258ef admin admin] PATH_INFO: `/v3/users` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:23.242836 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156330c3-2623-4d09-b7f4-bc6e34e258ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:23.244780 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156330c3-2623-4d09-b7f4-bc6e34e258ef admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:23.247087 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2885fa1e-47e1-4369-ac58-c92fc068dbe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:23.247946 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2885fa1e-47e1-4369-ac58-c92fc068dbe4 admin admin] REQUEST_METHOD: `PUT` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:23.248626 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2885fa1e-47e1-4369-ac58-c92fc068dbe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:23.249124 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2885fa1e-47e1-4369-ac58-c92fc068dbe4 admin admin] PATH_INFO: `/v3/projects/067e0b79fa194ae0a4fcd62bd3af7b5e/users/8c953996afe44643ac1c094eb5d9c1fe/roles/de8f2438056f4af9879423f8a59e0e0b` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:23.273847 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2885fa1e-47e1-4369-ac58-c92fc068dbe4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=067e0b79fa194ae0a4fcd62bd3af7b5e, user_id=8c953996afe44643ac1c094eb5d9c1fe, role_id=de8f2438056f4af9879423f8a59e0e0b)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:23.278149 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2885fa1e-47e1-4369-ac58-c92fc068dbe4 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:23.427436 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1301/2573] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 18 22:06:23 2022] POST /identity/v3/users => generated 307 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 22:06:23.453583 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156330c3-2623-4d09-b7f4-bc6e34e258ef admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:23.462298 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156330c3-2623-4d09-b7f4-bc6e34e258ef admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:23.467325 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6449520-b467-44fa-8fde-63ce5beb53c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:23.467991 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6449520-b467-44fa-8fde-63ce5beb53c8 admin admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:23.468271 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6449520-b467-44fa-8fde-63ce5beb53c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:23.468564 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6449520-b467-44fa-8fde-63ce5beb53c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:23.469228 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6449520-b467-44fa-8fde-63ce5beb53c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:23.471731 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6449520-b467-44fa-8fde-63ce5beb53c8 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:23.482683 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1302/2574] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:06:23 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 22:06:23.487936 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6449520-b467-44fa-8fde-63ce5beb53c8 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:23.498254 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6449520-b467-44fa-8fde-63ce5beb53c8 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:23.503870 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d226b6dd-136e-4a45-ac01-0e05925e9925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:23.504514 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d226b6dd-136e-4a45-ac01-0e05925e9925 admin admin] REQUEST_METHOD: `PUT` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:23.504835 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d226b6dd-136e-4a45-ac01-0e05925e9925 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:23.505116 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d226b6dd-136e-4a45-ac01-0e05925e9925 admin admin] PATH_INFO: `/v3/projects/dc5703021db84e04b37cbbb955bb5121/users/9fbed4491d08481faac72b6252d334fe/roles/0833202e2a3d47d1b6b3af57006641b1` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:23.520826 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d226b6dd-136e-4a45-ac01-0e05925e9925 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc5703021db84e04b37cbbb955bb5121, user_id=9fbed4491d08481faac72b6252d334fe, role_id=0833202e2a3d47d1b6b3af57006641b1)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:23.523637 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d226b6dd-136e-4a45-ac01-0e05925e9925 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:23.663968 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1273/2575] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 18 22:06:23 2022] PUT /identity/v3/projects/067e0b79fa194ae0a4fcd62bd3af7b5e/users/8c953996afe44643ac1c094eb5d9c1fe/roles/de8f2438056f4af9879423f8a59e0e0b => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:06:23.675909 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006a3426-dc27-4e3e-a9de-1cbfaf518262 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:23.676196 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006a3426-dc27-4e3e-a9de-1cbfaf518262 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:23.676472 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006a3426-dc27-4e3e-a9de-1cbfaf518262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:23.699651 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1303/2576] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 18 22:06:23 2022] PUT /identity/v3/projects/dc5703021db84e04b37cbbb955bb5121/users/9fbed4491d08481faac72b6252d334fe/roles/0833202e2a3d47d1b6b3af57006641b1 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 22:06:23.704978 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d226b6dd-136e-4a45-ac01-0e05925e9925 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:23.706183 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-006a3426-dc27-4e3e-a9de-1cbfaf518262 None None] MFA Rules not processed for user `8c953996afe44643ac1c094eb5d9c1fe`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:06:23.707402 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-006a3426-dc27-4e3e-a9de-1cbfaf518262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:06:23.767395 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d226b6dd-136e-4a45-ac01-0e05925e9925 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:23.772926 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aad3234-c047-4715-be8e-c3e7d49538d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:23.773536 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aad3234-c047-4715-be8e-c3e7d49538d3 admin admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:23.773811 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aad3234-c047-4715-be8e-c3e7d49538d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:23.774083 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aad3234-c047-4715-be8e-c3e7d49538d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:23.774717 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aad3234-c047-4715-be8e-c3e7d49538d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:23.775198 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1274/2577] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:06:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 22:06:23.776502 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aad3234-c047-4715-be8e-c3e7d49538d3 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:23.779281 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006a3426-dc27-4e3e-a9de-1cbfaf518262 None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:23.787392 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1304/2578] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:06:23 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 22:06:23.790351 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006a3426-dc27-4e3e-a9de-1cbfaf518262 None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:23.791289 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aad3234-c047-4715-be8e-c3e7d49538d3 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:23.794996 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b2315d-bd35-4c89-bd2a-0611a80ed1da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:23.795596 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b2315d-bd35-4c89-bd2a-0611a80ed1da admin admin] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:23.795891 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b2315d-bd35-4c89-bd2a-0611a80ed1da admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:23.796156 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b2315d-bd35-4c89-bd2a-0611a80ed1da admin admin] PATH_INFO: `/v3/projects` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:23.796807 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b2315d-bd35-4c89-bd2a-0611a80ed1da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:23.798708 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b2315d-bd35-4c89-bd2a-0611a80ed1da admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:23.801138 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aad3234-c047-4715-be8e-c3e7d49538d3 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:23.805857 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb15c6c9-f9ba-48e0-8aca-36bed81cd758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:23.806489 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb15c6c9-f9ba-48e0-8aca-36bed81cd758 admin admin] REQUEST_METHOD: `PUT` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:23.806762 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb15c6c9-f9ba-48e0-8aca-36bed81cd758 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:23.807031 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb15c6c9-f9ba-48e0-8aca-36bed81cd758 admin admin] PATH_INFO: `/v3/projects/dc5703021db84e04b37cbbb955bb5121/users/9fbed4491d08481faac72b6252d334fe/roles/0833202e2a3d47d1b6b3af57006641b1` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:23.809017 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb15c6c9-f9ba-48e0-8aca-36bed81cd758 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc5703021db84e04b37cbbb955bb5121, user_id=9fbed4491d08481faac72b6252d334fe, role_id=0833202e2a3d47d1b6b3af57006641b1)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:23.811608 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb15c6c9-f9ba-48e0-8aca-36bed81cd758 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:23.822318 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1305/2579] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 18 22:06:23 2022] PUT /identity/v3/projects/dc5703021db84e04b37cbbb955bb5121/users/9fbed4491d08481faac72b6252d334fe/roles/0833202e2a3d47d1b6b3af57006641b1 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 22:06:23.833017 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d091391-926a-46cc-b5ad-86cdb888ad12 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:23.833358 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d091391-926a-46cc-b5ad-86cdb888ad12 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:23.833633 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d091391-926a-46cc-b5ad-86cdb888ad12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:23.863264 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-7d091391-926a-46cc-b5ad-86cdb888ad12 None None] MFA Rules not processed for user `9fbed4491d08481faac72b6252d334fe`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:06:23.864484 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-7d091391-926a-46cc-b5ad-86cdb888ad12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:06:23.903191 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:06:23.905376 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1275/2580] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 18 22:06:23 2022] POST /identity/v3/projects => generated 373 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 22:06:23.911978 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b2315d-bd35-4c89-bd2a-0611a80ed1da admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:23.937879 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1306/2581] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:06:23 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 22:06:23.946305 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d091391-926a-46cc-b5ad-86cdb888ad12 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:23.947777 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-7d091391-926a-46cc-b5ad-86cdb888ad12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:06:23.995335 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b2315d-bd35-4c89-bd2a-0611a80ed1da admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:24.001730 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79d5ffa-cd43-4962-9853-d9ae51ae4c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:24.002938 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79d5ffa-cd43-4962-9853-d9ae51ae4c23 admin admin] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:24.003221 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79d5ffa-cd43-4962-9853-d9ae51ae4c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:24.003503 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79d5ffa-cd43-4962-9853-d9ae51ae4c23 admin admin] PATH_INFO: `/v3/users` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:24.004637 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79d5ffa-cd43-4962-9853-d9ae51ae4c23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:24.006104 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79d5ffa-cd43-4962-9853-d9ae51ae4c23 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:24.014377 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d091391-926a-46cc-b5ad-86cdb888ad12 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:24.017532 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:06:24.068197 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49060888-8872-4fe9-8eaf-4db8db8b1cfa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22b6a7c36f8a4795a75271b8079821c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:24.069156 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49060888-8872-4fe9-8eaf-4db8db8b1cfa service cinder] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:24.069603 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49060888-8872-4fe9-8eaf-4db8db8b1cfa service cinder] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:24.069875 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49060888-8872-4fe9-8eaf-4db8db8b1cfa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:24.096624 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1276/2582] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 18 22:06:23 2022] POST /identity/v3/users => generated 293 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 22:06:24.105922 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79d5ffa-cd43-4962-9853-d9ae51ae4c23 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:24.122023 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79d5ffa-cd43-4962-9853-d9ae51ae4c23 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:24.126770 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71fde26-1ad0-49a9-8224-ee8e36390186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:24.128254 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71fde26-1ad0-49a9-8224-ee8e36390186 admin admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:24.128539 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71fde26-1ad0-49a9-8224-ee8e36390186 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:24.128832 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71fde26-1ad0-49a9-8224-ee8e36390186 admin admin] PATH_INFO: `/v3/roles` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:24.129471 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71fde26-1ad0-49a9-8224-ee8e36390186 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:24.131236 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71fde26-1ad0-49a9-8224-ee8e36390186 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:24.136963 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49060888-8872-4fe9-8eaf-4db8db8b1cfa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:24.138459 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49060888-8872-4fe9-8eaf-4db8db8b1cfa service cinder] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:24.141467 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1277/2583] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:06:24 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 22:06:24.145922 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71fde26-1ad0-49a9-8224-ee8e36390186 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:24.149487 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1307/2584] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:06:23 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 22:06:24.156530 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71fde26-1ad0-49a9-8224-ee8e36390186 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:24.161448 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7f25bc-146d-43dc-8d07-fea304e84afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:24.162094 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7f25bc-146d-43dc-8d07-fea304e84afd admin admin] REQUEST_METHOD: `PUT` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:24.162369 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7f25bc-146d-43dc-8d07-fea304e84afd admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:24.162640 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7f25bc-146d-43dc-8d07-fea304e84afd admin admin] PATH_INFO: `/v3/projects/8a1eb6af8e114d8baec3f4a608851581/users/acbb8052a5a145619b8c437e28293cb1/roles/0833202e2a3d47d1b6b3af57006641b1` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:24.178814 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7f25bc-146d-43dc-8d07-fea304e84afd admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a1eb6af8e114d8baec3f4a608851581, user_id=acbb8052a5a145619b8c437e28293cb1, role_id=0833202e2a3d47d1b6b3af57006641b1)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:24.181429 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7f25bc-146d-43dc-8d07-fea304e84afd admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:24.256031 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1278/2585] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 18 22:06:24 2022] PUT /identity/v3/projects/8a1eb6af8e114d8baec3f4a608851581/users/acbb8052a5a145619b8c437e28293cb1/roles/0833202e2a3d47d1b6b3af57006641b1 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 22:06:24.262851 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49060888-8872-4fe9-8eaf-4db8db8b1cfa service cinder] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:24.274326 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49060888-8872-4fe9-8eaf-4db8db8b1cfa service cinder] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:24.313928 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:06:24.331755 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af109b5a-6d41-4cf6-892c-2e5c8e53f5a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:24.339469 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af109b5a-6d41-4cf6-892c-2e5c8e53f5a7 admin admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:24.339469 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af109b5a-6d41-4cf6-892c-2e5c8e53f5a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:24.339469 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af109b5a-6d41-4cf6-892c-2e5c8e53f5a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:24.339469 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af109b5a-6d41-4cf6-892c-2e5c8e53f5a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:24.339469 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af109b5a-6d41-4cf6-892c-2e5c8e53f5a7 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:24.344567 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1308/2586] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:06:24 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:06:24.349703 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7f25bc-146d-43dc-8d07-fea304e84afd admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:24.360120 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7f25bc-146d-43dc-8d07-fea304e84afd admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:24.365995 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4775dc3-8de9-4355-8c02-55456b56eaad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:24.366657 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4775dc3-8de9-4355-8c02-55456b56eaad admin admin] REQUEST_METHOD: `PUT` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:24.366938 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4775dc3-8de9-4355-8c02-55456b56eaad admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:24.367215 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4775dc3-8de9-4355-8c02-55456b56eaad admin admin] PATH_INFO: `/v3/projects/8a1eb6af8e114d8baec3f4a608851581/users/acbb8052a5a145619b8c437e28293cb1/roles/0833202e2a3d47d1b6b3af57006641b1` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:24.369370 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4775dc3-8de9-4355-8c02-55456b56eaad admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a1eb6af8e114d8baec3f4a608851581, user_id=acbb8052a5a145619b8c437e28293cb1, role_id=0833202e2a3d47d1b6b3af57006641b1)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:24.373805 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4775dc3-8de9-4355-8c02-55456b56eaad admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:24.384200 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1279/2587] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 18 22:06:24 2022] PUT /identity/v3/projects/8a1eb6af8e114d8baec3f4a608851581/users/acbb8052a5a145619b8c437e28293cb1/roles/0833202e2a3d47d1b6b3af57006641b1 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:06:24.386152 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af109b5a-6d41-4cf6-892c-2e5c8e53f5a7 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:24.395259 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e183bc-c1dd-4699-8d69-b6afbfe35cc3 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:24.396966 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e183bc-c1dd-4699-8d69-b6afbfe35cc3 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:24.396966 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e183bc-c1dd-4699-8d69-b6afbfe35cc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:24.426628 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-41e183bc-c1dd-4699-8d69-b6afbfe35cc3 None None] MFA Rules not processed for user `acbb8052a5a145619b8c437e28293cb1`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:06:24.427872 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-41e183bc-c1dd-4699-8d69-b6afbfe35cc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:06:24.445830 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af109b5a-6d41-4cf6-892c-2e5c8e53f5a7 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:24.498274 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0313b0ff-ab8c-48ba-b86f-e9cab489555c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22b6a7c36f8a4795a75271b8079821c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:24.498876 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0313b0ff-ab8c-48ba-b86f-e9cab489555c service cinder] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:24.499156 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1280/2588] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:06:24 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 22:06:24.499299 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0313b0ff-ab8c-48ba-b86f-e9cab489555c service cinder] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:24.499506 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0313b0ff-ab8c-48ba-b86f-e9cab489555c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:24.510209 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e183bc-c1dd-4699-8d69-b6afbfe35cc3 None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:24.511638 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-41e183bc-c1dd-4699-8d69-b6afbfe35cc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:06:24.524510 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e183bc-c1dd-4699-8d69-b6afbfe35cc3 None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:24.528107 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4855cbd7-7b32-4ff9-ae5c-895e92f4bf07 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22b6a7c36f8a4795a75271b8079821c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:24.529108 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4855cbd7-7b32-4ff9-ae5c-895e92f4bf07 service cinder] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:24.529385 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4855cbd7-7b32-4ff9-ae5c-895e92f4bf07 service cinder] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:24.529662 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4855cbd7-7b32-4ff9-ae5c-895e92f4bf07 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:24.557927 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0313b0ff-ab8c-48ba-b86f-e9cab489555c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:24.559395 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0313b0ff-ab8c-48ba-b86f-e9cab489555c service cinder] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:24.569161 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1309/2589] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:06:24 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:06:24.588324 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4855cbd7-7b32-4ff9-ae5c-895e92f4bf07 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:24.589811 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4855cbd7-7b32-4ff9-ae5c-895e92f4bf07 service cinder] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:24.598649 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1281/2590] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:06:24 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 22:06:27.714062 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0313b0ff-ab8c-48ba-b86f-e9cab489555c service cinder] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:27.763364 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:06:27.778490 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0313b0ff-ab8c-48ba-b86f-e9cab489555c service cinder] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:27.783351 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9779b3c2-1f50-4928-95c5-37d41dbc7261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:27.783980 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9779b3c2-1f50-4928-95c5-37d41dbc7261 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:27.784255 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9779b3c2-1f50-4928-95c5-37d41dbc7261 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:27.784528 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9779b3c2-1f50-4928-95c5-37d41dbc7261 admin admin] PATH_INFO: `/v3/users/8c953996afe44643ac1c094eb5d9c1fe` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:27.786244 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9779b3c2-1f50-4928-95c5-37d41dbc7261 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c953996afe44643ac1c094eb5d9c1fe)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:27.787680 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9779b3c2-1f50-4928-95c5-37d41dbc7261 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:27.954354 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-9779b3c2-1f50-4928-95c5-37d41dbc7261 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c953996afe44643ac1c094eb5d9c1fe'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:27.962744 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-9779b3c2-1f50-4928-95c5-37d41dbc7261 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c953996afe44643ac1c094eb5d9c1fe'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:27.963455 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-9779b3c2-1f50-4928-95c5-37d41dbc7261 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c953996afe44643ac1c094eb5d9c1fe'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:27.976412 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-9779b3c2-1f50-4928-95c5-37d41dbc7261 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c953996afe44643ac1c094eb5d9c1fe'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:28.034493 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-9779b3c2-1f50-4928-95c5-37d41dbc7261 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c953996afe44643ac1c094eb5d9c1fe'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:28.041243 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1310/2591] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 18 22:06:27 2022] DELETE /identity/v3/users/8c953996afe44643ac1c094eb5d9c1fe => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:06:28.045870 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7da1269-fb22-4afa-b01b-90cf40d28c54 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:28.046356 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7da1269-fb22-4afa-b01b-90cf40d28c54 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:28.046484 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7da1269-fb22-4afa-b01b-90cf40d28c54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:28.066363 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-d7da1269-fb22-4afa-b01b-90cf40d28c54 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:06:28.067600 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-d7da1269-fb22-4afa-b01b-90cf40d28c54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:06:28.094925 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:06:28.129684 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1282/2592] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:06:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 22:06:28.139705 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9779b3c2-1f50-4928-95c5-37d41dbc7261 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:28.141453 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-9779b3c2-1f50-4928-95c5-37d41dbc7261 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:06:28.202156 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9779b3c2-1f50-4928-95c5-37d41dbc7261 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:28.206018 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b88662-34ab-4103-a601-48a9e1f9345d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a937971ad1a4b0c8697c764f214d446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:28.206756 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b88662-34ab-4103-a601-48a9e1f9345d service neutron] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:28.207020 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b88662-34ab-4103-a601-48a9e1f9345d service neutron] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:28.207613 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b88662-34ab-4103-a601-48a9e1f9345d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:28.219930 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b88662-34ab-4103-a601-48a9e1f9345d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:28.222002 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b88662-34ab-4103-a601-48a9e1f9345d service neutron] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:28.234254 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1311/2593] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:06:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:06:28.681957 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7da1269-fb22-4afa-b01b-90cf40d28c54 None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:28.690366 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-d7da1269-fb22-4afa-b01b-90cf40d28c54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:06:28.697898 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7da1269-fb22-4afa-b01b-90cf40d28c54 None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:28.706545 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d746d4d8-1e29-41c5-a9f3-45098f03b078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:28.707181 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d746d4d8-1e29-41c5-a9f3-45098f03b078 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:28.707606 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d746d4d8-1e29-41c5-a9f3-45098f03b078 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:28.708054 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d746d4d8-1e29-41c5-a9f3-45098f03b078 admin admin] PATH_INFO: `/v3/projects/067e0b79fa194ae0a4fcd62bd3af7b5e` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:28.709642 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d746d4d8-1e29-41c5-a9f3-45098f03b078 admin admin] RBAC: Authorizing `identity:delete_project(project_id=067e0b79fa194ae0a4fcd62bd3af7b5e)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:28.712527 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d746d4d8-1e29-41c5-a9f3-45098f03b078 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:29.577800 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-d746d4d8-1e29-41c5-a9f3-45098f03b078 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '067e0b79fa194ae0a4fcd62bd3af7b5e', 'request_id': 'req-d746d4d8-1e29-41c5-a9f3-45098f03b078'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:29.584115 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-d746d4d8-1e29-41c5-a9f3-45098f03b078 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '067e0b79fa194ae0a4fcd62bd3af7b5e', 'request_id': 'req-d746d4d8-1e29-41c5-a9f3-45098f03b078'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:29.668539 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-d746d4d8-1e29-41c5-a9f3-45098f03b078 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '067e0b79fa194ae0a4fcd62bd3af7b5e', 'request_id': 'req-d746d4d8-1e29-41c5-a9f3-45098f03b078'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:29.681753 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-d746d4d8-1e29-41c5-a9f3-45098f03b078 admin admin] The token cache is being invalidate because project 067e0b79fa194ae0a4fcd62bd3af7b5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88096) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 22:06:29.682044 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-d746d4d8-1e29-41c5-a9f3-45098f03b078 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:29.682691 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-d746d4d8-1e29-41c5-a9f3-45098f03b078 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:29.684186 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1283/2594] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 18 22:06:28 2022] DELETE /identity/v3/projects/067e0b79fa194ae0a4fcd62bd3af7b5e => generated 0 bytes in 1003 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:06:29.688371 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b88662-34ab-4103-a601-48a9e1f9345d service neutron] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:29.699140 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b88662-34ab-4103-a601-48a9e1f9345d service neutron] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:29.770830 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640f2ca8-a11e-454a-b9ed-3cdaa7e829df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:29.771480 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640f2ca8-a11e-454a-b9ed-3cdaa7e829df admin admin] REQUEST_METHOD: `DELETE` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:29.771766 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640f2ca8-a11e-454a-b9ed-3cdaa7e829df admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:29.772044 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640f2ca8-a11e-454a-b9ed-3cdaa7e829df admin admin] PATH_INFO: `/v3/users/acbb8052a5a145619b8c437e28293cb1` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:29.773213 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640f2ca8-a11e-454a-b9ed-3cdaa7e829df admin admin] RBAC: Authorizing `identity:delete_user(user_id=acbb8052a5a145619b8c437e28293cb1)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:29.775221 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640f2ca8-a11e-454a-b9ed-3cdaa7e829df admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:29.791122 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d746d4d8-1e29-41c5-a9f3-45098f03b078 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:29.791565 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:06:29.792850 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-d746d4d8-1e29-41c5-a9f3-45098f03b078 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:06:29.809079 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d746d4d8-1e29-41c5-a9f3-45098f03b078 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:29.813992 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13e3071-a13a-4dfc-8878-894bfab23fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:29.815433 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13e3071-a13a-4dfc-8878-894bfab23fbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:29.815719 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13e3071-a13a-4dfc-8878-894bfab23fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:29.820327 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13e3071-a13a-4dfc-8878-894bfab23fbb admin admin] PATH_INFO: `/v3/users/8a7a161b7dad4fb9a0f1faff7ab5a8ab` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:29.820327 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13e3071-a13a-4dfc-8878-894bfab23fbb admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a7a161b7dad4fb9a0f1faff7ab5a8ab)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:29.820327 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13e3071-a13a-4dfc-8878-894bfab23fbb admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:29.988348 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-640f2ca8-a11e-454a-b9ed-3cdaa7e829df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'acbb8052a5a145619b8c437e28293cb1'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:29.995535 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-640f2ca8-a11e-454a-b9ed-3cdaa7e829df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'acbb8052a5a145619b8c437e28293cb1'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:29.997225 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-640f2ca8-a11e-454a-b9ed-3cdaa7e829df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'acbb8052a5a145619b8c437e28293cb1'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:30.015570 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-d13e3071-a13a-4dfc-8878-894bfab23fbb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a7a161b7dad4fb9a0f1faff7ab5a8ab'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:30.015765 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-640f2ca8-a11e-454a-b9ed-3cdaa7e829df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'acbb8052a5a145619b8c437e28293cb1'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:30.023948 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-d13e3071-a13a-4dfc-8878-894bfab23fbb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a7a161b7dad4fb9a0f1faff7ab5a8ab'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:30.024735 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-d13e3071-a13a-4dfc-8878-894bfab23fbb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a7a161b7dad4fb9a0f1faff7ab5a8ab'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:30.025402 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-d13e3071-a13a-4dfc-8878-894bfab23fbb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a7a161b7dad4fb9a0f1faff7ab5a8ab'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:30.039053 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-d13e3071-a13a-4dfc-8878-894bfab23fbb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a7a161b7dad4fb9a0f1faff7ab5a8ab'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:30.137139 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-640f2ca8-a11e-454a-b9ed-3cdaa7e829df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'acbb8052a5a145619b8c437e28293cb1'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:30.144532 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1312/2595] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 18 22:06:29 2022] DELETE /identity/v3/users/acbb8052a5a145619b8c437e28293cb1 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 22:06:30.210122 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1284/2596] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 18 22:06:29 2022] DELETE /identity/v3/users/8a7a161b7dad4fb9a0f1faff7ab5a8ab => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 22:06:30.214804 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9082a0-2712-44e3-b4c3-b5d8bdeec52c None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:30.215230 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9082a0-2712-44e3-b4c3-b5d8bdeec52c None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:30.215549 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9082a0-2712-44e3-b4c3-b5d8bdeec52c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:30.235866 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-bb9082a0-2712-44e3-b4c3-b5d8bdeec52c None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:06:30.240805 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-bb9082a0-2712-44e3-b4c3-b5d8bdeec52c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:06:30.302997 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1313/2597] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:06:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:06:30.312852 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13e3071-a13a-4dfc-8878-894bfab23fbb admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:30.314842 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-d13e3071-a13a-4dfc-8878-894bfab23fbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:06:30.347742 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:06:30.383532 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13e3071-a13a-4dfc-8878-894bfab23fbb admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:30.387726 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4e01cb-e1fc-4f9a-b20f-c37e9718bb5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a937971ad1a4b0c8697c764f214d446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:30.388339 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4e01cb-e1fc-4f9a-b20f-c37e9718bb5c service neutron] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:30.388636 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4e01cb-e1fc-4f9a-b20f-c37e9718bb5c service neutron] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:30.388908 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4e01cb-e1fc-4f9a-b20f-c37e9718bb5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:30.399809 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4e01cb-e1fc-4f9a-b20f-c37e9718bb5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:30.401419 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4e01cb-e1fc-4f9a-b20f-c37e9718bb5c service neutron] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:30.411895 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1285/2598] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:06:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:06:30.581733 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9082a0-2712-44e3-b4c3-b5d8bdeec52c None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:30.583737 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-bb9082a0-2712-44e3-b4c3-b5d8bdeec52c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:06:30.606730 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9082a0-2712-44e3-b4c3-b5d8bdeec52c None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:30.613607 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f422b0a-6257-4652-9396-3781fa58e668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:30.614265 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f422b0a-6257-4652-9396-3781fa58e668 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:30.614548 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f422b0a-6257-4652-9396-3781fa58e668 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:30.614904 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f422b0a-6257-4652-9396-3781fa58e668 admin admin] PATH_INFO: `/v3/projects/8a1eb6af8e114d8baec3f4a608851581` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:30.616735 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f422b0a-6257-4652-9396-3781fa58e668 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a1eb6af8e114d8baec3f4a608851581)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:30.618723 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f422b0a-6257-4652-9396-3781fa58e668 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:30.760089 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-8f422b0a-6257-4652-9396-3781fa58e668 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a1eb6af8e114d8baec3f4a608851581', 'request_id': 'req-8f422b0a-6257-4652-9396-3781fa58e668'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:30.766233 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-8f422b0a-6257-4652-9396-3781fa58e668 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a1eb6af8e114d8baec3f4a608851581', 'request_id': 'req-8f422b0a-6257-4652-9396-3781fa58e668'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:30.828172 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-8f422b0a-6257-4652-9396-3781fa58e668 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a1eb6af8e114d8baec3f4a608851581', 'request_id': 'req-8f422b0a-6257-4652-9396-3781fa58e668'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:30.835974 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4e01cb-e1fc-4f9a-b20f-c37e9718bb5c service neutron] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:30.838915 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-5e4e01cb-e1fc-4f9a-b20f-c37e9718bb5c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:06:30.842415 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-8f422b0a-6257-4652-9396-3781fa58e668 admin admin] The token cache is being invalidate because project 8a1eb6af8e114d8baec3f4a608851581 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88097) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 22:06:30.842709 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-8f422b0a-6257-4652-9396-3781fa58e668 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:30.845237 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-8f422b0a-6257-4652-9396-3781fa58e668 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:30.847834 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1314/2599] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 18 22:06:30 2022] DELETE /identity/v3/projects/8a1eb6af8e114d8baec3f4a608851581 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:06:30.854610 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05c774e-6e4e-4b01-b44f-f07d2bca34f3 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:30.861857 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05c774e-6e4e-4b01-b44f-f07d2bca34f3 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:30.861857 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05c774e-6e4e-4b01-b44f-f07d2bca34f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:30.862401 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4e01cb-e1fc-4f9a-b20f-c37e9718bb5c service neutron] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:30.886256 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-c05c774e-6e4e-4b01-b44f-f07d2bca34f3 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:06:30.887642 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-c05c774e-6e4e-4b01-b44f-f07d2bca34f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:06:30.895170 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:06:30.921937 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d864adcc-62d1-4c79-8c1f-f05c3bc2cacf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:30.922576 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d864adcc-62d1-4c79-8c1f-f05c3bc2cacf admin admin] REQUEST_METHOD: `DELETE` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:30.922858 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d864adcc-62d1-4c79-8c1f-f05c3bc2cacf admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:30.923130 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d864adcc-62d1-4c79-8c1f-f05c3bc2cacf admin admin] PATH_INFO: `/v3/projects/dd959dcdcaf24ecbb2013934f124353c` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:30.924318 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d864adcc-62d1-4c79-8c1f-f05c3bc2cacf admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd959dcdcaf24ecbb2013934f124353c)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:30.926298 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d864adcc-62d1-4c79-8c1f-f05c3bc2cacf admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:30.950220 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1315/2600] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:06:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:06:30.958508 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86e52cb-aee0-441f-a622-396396e04cbf None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:30.958791 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86e52cb-aee0-441f-a622-396396e04cbf None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:30.959062 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86e52cb-aee0-441f-a622-396396e04cbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:30.978395 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-b86e52cb-aee0-441f-a622-396396e04cbf None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:06:30.979591 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-b86e52cb-aee0-441f-a622-396396e04cbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:06:30.987597 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1316/2601] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:06:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 22:06:30.991803 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86e52cb-aee0-441f-a622-396396e04cbf None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:31.000405 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86e52cb-aee0-441f-a622-396396e04cbf None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:31.005653 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c525da-08f5-4115-b3d0-58f2a4a176cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:31.006221 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c525da-08f5-4115-b3d0-58f2a4a176cc admin admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:31.006511 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c525da-08f5-4115-b3d0-58f2a4a176cc admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:31.006775 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c525da-08f5-4115-b3d0-58f2a4a176cc admin admin] PATH_INFO: `/v3/domains` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:31.007400 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c525da-08f5-4115-b3d0-58f2a4a176cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 22:06:31.007701 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c525da-08f5-4115-b3d0-58f2a4a176cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:31.009321 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c525da-08f5-4115-b3d0-58f2a4a176cc admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:31.022716 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1317/2602] 10.222.0.27 () {58 vars in 1153 bytes} [Thu Aug 18 22:06:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 22:06:31.027248 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c525da-08f5-4115-b3d0-58f2a4a176cc admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:31.028222 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-d864adcc-62d1-4c79-8c1f-f05c3bc2cacf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd959dcdcaf24ecbb2013934f124353c', 'request_id': 'req-d864adcc-62d1-4c79-8c1f-f05c3bc2cacf'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:31.034935 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-d864adcc-62d1-4c79-8c1f-f05c3bc2cacf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd959dcdcaf24ecbb2013934f124353c', 'request_id': 'req-d864adcc-62d1-4c79-8c1f-f05c3bc2cacf'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:31.037164 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c525da-08f5-4115-b3d0-58f2a4a176cc admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:31.092350 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34558fcf-bb87-4581-8f5f-26470af29fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:31.092904 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34558fcf-bb87-4581-8f5f-26470af29fde admin admin] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:31.093185 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34558fcf-bb87-4581-8f5f-26470af29fde admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:31.093462 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34558fcf-bb87-4581-8f5f-26470af29fde admin admin] PATH_INFO: `/v3/projects` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:31.094103 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34558fcf-bb87-4581-8f5f-26470af29fde admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:31.096834 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34558fcf-bb87-4581-8f5f-26470af29fde admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:31.098046 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-d864adcc-62d1-4c79-8c1f-f05c3bc2cacf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd959dcdcaf24ecbb2013934f124353c', 'request_id': 'req-d864adcc-62d1-4c79-8c1f-f05c3bc2cacf'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:31.113907 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-d864adcc-62d1-4c79-8c1f-f05c3bc2cacf admin admin] The token cache is being invalidate because project dd959dcdcaf24ecbb2013934f124353c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88096) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 22:06:31.114206 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-d864adcc-62d1-4c79-8c1f-f05c3bc2cacf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:31.114902 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-d864adcc-62d1-4c79-8c1f-f05c3bc2cacf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:31.116443 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1286/2603] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 18 22:06:30 2022] DELETE /identity/v3/projects/dd959dcdcaf24ecbb2013934f124353c => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 22:06:31.120397 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d864adcc-62d1-4c79-8c1f-f05c3bc2cacf admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:31.121881 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-d864adcc-62d1-4c79-8c1f-f05c3bc2cacf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:06:31.135288 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d864adcc-62d1-4c79-8c1f-f05c3bc2cacf admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:31.140389 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2deee1c-60a1-49c6-bff8-bf9c66da5d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:31.141067 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2deee1c-60a1-49c6-bff8-bf9c66da5d1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:31.141350 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2deee1c-60a1-49c6-bff8-bf9c66da5d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:31.141627 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2deee1c-60a1-49c6-bff8-bf9c66da5d1f admin admin] PATH_INFO: `/v3/users/9fbed4491d08481faac72b6252d334fe` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:31.142947 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2deee1c-60a1-49c6-bff8-bf9c66da5d1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9fbed4491d08481faac72b6252d334fe)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:31.145073 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2deee1c-60a1-49c6-bff8-bf9c66da5d1f admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:31.199686 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1318/2604] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 18 22:06:31 2022] POST /identity/v3/projects => generated 377 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 22:06:31.203456 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34558fcf-bb87-4581-8f5f-26470af29fde admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:31.205399 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-34558fcf-bb87-4581-8f5f-26470af29fde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:06:31.276683 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34558fcf-bb87-4581-8f5f-26470af29fde admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:31.281432 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a43789-4638-48f7-a4b9-762fe81f9f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:31.282037 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a43789-4638-48f7-a4b9-762fe81f9f04 admin admin] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:31.282322 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a43789-4638-48f7-a4b9-762fe81f9f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:31.287111 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a43789-4638-48f7-a4b9-762fe81f9f04 admin admin] PATH_INFO: `/v3/users` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:31.287111 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a43789-4638-48f7-a4b9-762fe81f9f04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:31.287111 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a43789-4638-48f7-a4b9-762fe81f9f04 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:31.352829 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1319/2605] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 18 22:06:31 2022] POST /identity/v3/users => generated 289 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 22:06:31.353875 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5db601-31a2-4870-9365-e49583abaeb5 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:31.354166 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5db601-31a2-4870-9365-e49583abaeb5 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:31.354456 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5db601-31a2-4870-9365-e49583abaeb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:31.359761 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-a2deee1c-60a1-49c6-bff8-bf9c66da5d1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9fbed4491d08481faac72b6252d334fe'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:31.366572 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:06:31.368571 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-a2deee1c-60a1-49c6-bff8-bf9c66da5d1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9fbed4491d08481faac72b6252d334fe'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:31.369771 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-a2deee1c-60a1-49c6-bff8-bf9c66da5d1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9fbed4491d08481faac72b6252d334fe'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:31.370062 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-a2deee1c-60a1-49c6-bff8-bf9c66da5d1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9fbed4491d08481faac72b6252d334fe'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:31.374704 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-7b5db601-31a2-4870-9365-e49583abaeb5 None None] MFA Rules not processed for user `f079aa6ed5594a4982172b51b93ac54f`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:06:31.375926 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-7b5db601-31a2-4870-9365-e49583abaeb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:06:31.382547 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-a2deee1c-60a1-49c6-bff8-bf9c66da5d1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9fbed4491d08481faac72b6252d334fe'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:31.434609 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1320/2606] 10.222.0.27 () {58 vars in 967 bytes} [Thu Aug 18 22:06:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:06:31.435467 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5db601-31a2-4870-9365-e49583abaeb5 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:31.436780 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-7b5db601-31a2-4870-9365-e49583abaeb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:06:31.451364 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5db601-31a2-4870-9365-e49583abaeb5 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:31.457120 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db83ff02-5e0d-4a00-9527-27eb87f670e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:31.457540 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1287/2607] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 18 22:06:31 2022] DELETE /identity/v3/users/9fbed4491d08481faac72b6252d334fe => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 22:06:31.460907 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2deee1c-60a1-49c6-bff8-bf9c66da5d1f admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:31.460907 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-a2deee1c-60a1-49c6-bff8-bf9c66da5d1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:06:31.461235 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db83ff02-5e0d-4a00-9527-27eb87f670e9 admin admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:31.461235 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db83ff02-5e0d-4a00-9527-27eb87f670e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:31.461235 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db83ff02-5e0d-4a00-9527-27eb87f670e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:31.461881 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db83ff02-5e0d-4a00-9527-27eb87f670e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:31.463489 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db83ff02-5e0d-4a00-9527-27eb87f670e9 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:31.478072 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1321/2608] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:06:31 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:06:31.479677 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db83ff02-5e0d-4a00-9527-27eb87f670e9 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:31.492220 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db83ff02-5e0d-4a00-9527-27eb87f670e9 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:31.525903 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:06:31.555828 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2deee1c-60a1-49c6-bff8-bf9c66da5d1f admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:31.558970 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5324d2-c41d-43da-a5b7-3eb8177cab8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:31.559585 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5324d2-c41d-43da-a5b7-3eb8177cab8b admin admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:31.559868 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5324d2-c41d-43da-a5b7-3eb8177cab8b admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:31.560179 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5324d2-c41d-43da-a5b7-3eb8177cab8b admin admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:31.560887 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5324d2-c41d-43da-a5b7-3eb8177cab8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:31.564872 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5324d2-c41d-43da-a5b7-3eb8177cab8b admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:31.565009 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f350f6a2-db20-4c38-af57-a052af475455 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae59e6dca304c949942ae769acedc74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:31.565009 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f350f6a2-db20-4c38-af57-a052af475455 service swift] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:31.565196 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f350f6a2-db20-4c38-af57-a052af475455 service swift] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:31.565332 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f350f6a2-db20-4c38-af57-a052af475455 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:31.573882 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1322/2609] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:06:31 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 22:06:31.577935 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5324d2-c41d-43da-a5b7-3eb8177cab8b admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:31.588417 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5324d2-c41d-43da-a5b7-3eb8177cab8b admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:31.593135 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a9487e-31c4-4469-b0d6-404fa4e4ae68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:31.593779 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a9487e-31c4-4469-b0d6-404fa4e4ae68 admin admin] REQUEST_METHOD: `PUT` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:31.594061 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a9487e-31c4-4469-b0d6-404fa4e4ae68 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:31.594340 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a9487e-31c4-4469-b0d6-404fa4e4ae68 admin admin] PATH_INFO: `/v3/projects/482f862a3dad4d039cb6a0bd3d981819/users/d8f8192b056c41a78c55d37e3f95e68f/roles/de8f2438056f4af9879423f8a59e0e0b` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:31.609974 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a9487e-31c4-4469-b0d6-404fa4e4ae68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=482f862a3dad4d039cb6a0bd3d981819, user_id=d8f8192b056c41a78c55d37e3f95e68f, role_id=de8f2438056f4af9879423f8a59e0e0b)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:31.613278 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a9487e-31c4-4469-b0d6-404fa4e4ae68 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:31.627627 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f350f6a2-db20-4c38-af57-a052af475455 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:31.629258 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f350f6a2-db20-4c38-af57-a052af475455 service swift] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:31.637932 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1288/2610] 10.222.0.27 () {60 vars in 1384 bytes} [Thu Aug 18 22:06:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 18 22:06:31.758108 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1323/2611] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 18 22:06:31 2022] PUT /identity/v3/projects/482f862a3dad4d039cb6a0bd3d981819/users/d8f8192b056c41a78c55d37e3f95e68f/roles/de8f2438056f4af9879423f8a59e0e0b => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 22:06:31.825238 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fd2d06-48ca-483a-a776-0dd900664e1b None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:31.825521 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fd2d06-48ca-483a-a776-0dd900664e1b None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:31.825790 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fd2d06-48ca-483a-a776-0dd900664e1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:31.855505 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-59fd2d06-48ca-483a-a776-0dd900664e1b None None] MFA Rules not processed for user `d8f8192b056c41a78c55d37e3f95e68f`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:06:31.856784 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-59fd2d06-48ca-483a-a776-0dd900664e1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:06:31.879134 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a9487e-31c4-4469-b0d6-404fa4e4ae68 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:31.881064 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-f1a9487e-31c4-4469-b0d6-404fa4e4ae68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:06:31.927296 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1289/2612] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:06:31 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:06:31.938589 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fd2d06-48ca-483a-a776-0dd900664e1b None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:31.940655 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-59fd2d06-48ca-483a-a776-0dd900664e1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:06:31.965736 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:06:31.975424 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a9487e-31c4-4469-b0d6-404fa4e4ae68 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:31.980153 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56db6770-56d2-44ce-93b1-0fc53b99bdc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:31.980812 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56db6770-56d2-44ce-93b1-0fc53b99bdc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:31.981102 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56db6770-56d2-44ce-93b1-0fc53b99bdc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:31.981383 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56db6770-56d2-44ce-93b1-0fc53b99bdc4 admin admin] PATH_INFO: `/v3/projects/dc5703021db84e04b37cbbb955bb5121` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:31.982651 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56db6770-56d2-44ce-93b1-0fc53b99bdc4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc5703021db84e04b37cbbb955bb5121)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:31.984649 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56db6770-56d2-44ce-93b1-0fc53b99bdc4 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:32.002988 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:06:32.004788 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fd2d06-48ca-483a-a776-0dd900664e1b None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:32.007696 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c98399-bedf-492b-8670-b54517c9670f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22b6a7c36f8a4795a75271b8079821c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:32.008310 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c98399-bedf-492b-8670-b54517c9670f service cinder] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:32.008602 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c98399-bedf-492b-8670-b54517c9670f service cinder] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:32.008911 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c98399-bedf-492b-8670-b54517c9670f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:32.018739 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c98399-bedf-492b-8670-b54517c9670f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:32.020432 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c98399-bedf-492b-8670-b54517c9670f service cinder] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:32.030456 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1290/2613] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:06:31 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 22:06:32.181927 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-56db6770-56d2-44ce-93b1-0fc53b99bdc4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc5703021db84e04b37cbbb955bb5121', 'request_id': 'req-56db6770-56d2-44ce-93b1-0fc53b99bdc4'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:32.182837 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-56db6770-56d2-44ce-93b1-0fc53b99bdc4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc5703021db84e04b37cbbb955bb5121', 'request_id': 'req-56db6770-56d2-44ce-93b1-0fc53b99bdc4'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:32.323259 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-56db6770-56d2-44ce-93b1-0fc53b99bdc4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc5703021db84e04b37cbbb955bb5121', 'request_id': 'req-56db6770-56d2-44ce-93b1-0fc53b99bdc4'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:32.335961 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-56db6770-56d2-44ce-93b1-0fc53b99bdc4 admin admin] The token cache is being invalidate because project dc5703021db84e04b37cbbb955bb5121 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88097) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 22:06:32.336360 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-56db6770-56d2-44ce-93b1-0fc53b99bdc4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:32.337117 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-56db6770-56d2-44ce-93b1-0fc53b99bdc4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:32.338764 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1324/2614] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 18 22:06:31 2022] DELETE /identity/v3/projects/dc5703021db84e04b37cbbb955bb5121 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 22:06:32.343804 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6e51cd-1df6-437f-9a3d-9d5b177b079b None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:32.344097 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6e51cd-1df6-437f-9a3d-9d5b177b079b None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:32.344375 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6e51cd-1df6-437f-9a3d-9d5b177b079b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:32.365037 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-dd6e51cd-1df6-437f-9a3d-9d5b177b079b None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:06:32.366231 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-dd6e51cd-1df6-437f-9a3d-9d5b177b079b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:06:32.454422 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1291/2615] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:06:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 22:06:32.464088 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d193180-685d-4586-88e5-2e82ed394448 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:32.465594 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d193180-685d-4586-88e5-2e82ed394448 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:32.465594 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d193180-685d-4586-88e5-2e82ed394448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:32.485230 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-8d193180-685d-4586-88e5-2e82ed394448 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:06:32.487027 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-8d193180-685d-4586-88e5-2e82ed394448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:06:32.495296 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1325/2616] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:06:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:06:32.499702 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6e51cd-1df6-437f-9a3d-9d5b177b079b None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:32.509978 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6e51cd-1df6-437f-9a3d-9d5b177b079b None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:32.514857 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f9fd87-6976-4eb6-93bd-6c3418be1fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:32.515720 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f9fd87-6976-4eb6-93bd-6c3418be1fc8 admin admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:32.516001 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f9fd87-6976-4eb6-93bd-6c3418be1fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:32.516276 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f9fd87-6976-4eb6-93bd-6c3418be1fc8 admin admin] PATH_INFO: `/v3/domains` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:32.516975 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f9fd87-6976-4eb6-93bd-6c3418be1fc8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 22:06:32.518185 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f9fd87-6976-4eb6-93bd-6c3418be1fc8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:32.519223 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f9fd87-6976-4eb6-93bd-6c3418be1fc8 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:32.530575 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1292/2617] 10.222.0.27 () {58 vars in 1153 bytes} [Thu Aug 18 22:06:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 22:06:32.537661 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d193180-685d-4586-88e5-2e82ed394448 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:32.547592 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d193180-685d-4586-88e5-2e82ed394448 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:32.553752 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c74e095-a87b-4a3e-96d7-42ed2942211d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:32.554479 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c74e095-a87b-4a3e-96d7-42ed2942211d admin admin] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:32.554847 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c74e095-a87b-4a3e-96d7-42ed2942211d admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:32.555193 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c74e095-a87b-4a3e-96d7-42ed2942211d admin admin] PATH_INFO: `/v3/projects` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:32.555887 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c74e095-a87b-4a3e-96d7-42ed2942211d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:32.558044 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c74e095-a87b-4a3e-96d7-42ed2942211d admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:32.658397 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1326/2618] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 18 22:06:32 2022] POST /identity/v3/projects => generated 407 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 22:06:32.660913 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f9fd87-6976-4eb6-93bd-6c3418be1fc8 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:32.671074 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f9fd87-6976-4eb6-93bd-6c3418be1fc8 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:32.730651 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885f4c7a-4172-40b6-b7f1-a247d595cb9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:32.731276 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885f4c7a-4172-40b6-b7f1-a247d595cb9d admin admin] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:32.731557 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885f4c7a-4172-40b6-b7f1-a247d595cb9d admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:32.731831 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885f4c7a-4172-40b6-b7f1-a247d595cb9d admin admin] PATH_INFO: `/v3/users` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:32.732889 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885f4c7a-4172-40b6-b7f1-a247d595cb9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:32.735502 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885f4c7a-4172-40b6-b7f1-a247d595cb9d admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:32.872009 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1293/2619] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 18 22:06:32 2022] POST /identity/v3/users => generated 304 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 22:06:32.873756 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c74e095-a87b-4a3e-96d7-42ed2942211d admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:32.885261 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c74e095-a87b-4a3e-96d7-42ed2942211d admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:32.890785 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9e2e79-c06b-4149-a873-63233c57501c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:32.891393 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9e2e79-c06b-4149-a873-63233c57501c admin admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:32.891676 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9e2e79-c06b-4149-a873-63233c57501c admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:32.892113 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9e2e79-c06b-4149-a873-63233c57501c admin admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:32.893328 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9e2e79-c06b-4149-a873-63233c57501c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:32.895026 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9e2e79-c06b-4149-a873-63233c57501c admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:32.906700 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1327/2620] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:06:32 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:06:32.911666 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885f4c7a-4172-40b6-b7f1-a247d595cb9d admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:32.924982 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885f4c7a-4172-40b6-b7f1-a247d595cb9d admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:32.930386 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de69207-9961-4740-895d-d9bd05c11a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:32.931065 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de69207-9961-4740-895d-d9bd05c11a92 admin admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:32.931355 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de69207-9961-4740-895d-d9bd05c11a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:32.931631 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de69207-9961-4740-895d-d9bd05c11a92 admin admin] PATH_INFO: `/v3/roles` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:32.932284 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de69207-9961-4740-895d-d9bd05c11a92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:32.934184 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de69207-9961-4740-895d-d9bd05c11a92 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:32.947138 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1294/2621] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:06:32 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:06:32.951268 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9e2e79-c06b-4149-a873-63233c57501c admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:32.962307 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9e2e79-c06b-4149-a873-63233c57501c admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:32.966993 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9d76b3-6cfa-483e-8aa7-d06a932ca34c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:32.968035 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9d76b3-6cfa-483e-8aa7-d06a932ca34c admin admin] REQUEST_METHOD: `PUT` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:32.968318 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9d76b3-6cfa-483e-8aa7-d06a932ca34c admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:32.968620 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9d76b3-6cfa-483e-8aa7-d06a932ca34c admin admin] PATH_INFO: `/v3/projects/b505203fba674797911502fb2fab8fa7/users/9fe29cc32a6f4c55bb1436b68ba5d58c/roles/de8f2438056f4af9879423f8a59e0e0b` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:32.984176 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9d76b3-6cfa-483e-8aa7-d06a932ca34c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b505203fba674797911502fb2fab8fa7, user_id=9fe29cc32a6f4c55bb1436b68ba5d58c, role_id=de8f2438056f4af9879423f8a59e0e0b)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:32.986949 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9d76b3-6cfa-483e-8aa7-d06a932ca34c admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:33.068986 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1328/2622] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 18 22:06:32 2022] PUT /identity/v3/projects/b505203fba674797911502fb2fab8fa7/users/9fe29cc32a6f4c55bb1436b68ba5d58c/roles/de8f2438056f4af9879423f8a59e0e0b => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:06:33.081312 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d4e0ea-e8ff-4594-b641-131ad6d54f71 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:33.081604 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d4e0ea-e8ff-4594-b641-131ad6d54f71 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:33.081883 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d4e0ea-e8ff-4594-b641-131ad6d54f71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:33.103265 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:06:33.111506 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-f0d4e0ea-e8ff-4594-b641-131ad6d54f71 None None] MFA Rules not processed for user `9fe29cc32a6f4c55bb1436b68ba5d58c`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:06:33.113114 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-f0d4e0ea-e8ff-4594-b641-131ad6d54f71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:06:33.177714 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1295/2623] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:06:33 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:06:33.182050 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9d76b3-6cfa-483e-8aa7-d06a932ca34c admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:33.246495 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9d76b3-6cfa-483e-8aa7-d06a932ca34c admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:33.251123 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673092a2-0b00-4c63-9f41-7e8e122e392c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:33.251861 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673092a2-0b00-4c63-9f41-7e8e122e392c admin admin] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:33.252136 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673092a2-0b00-4c63-9f41-7e8e122e392c admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:33.252403 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673092a2-0b00-4c63-9f41-7e8e122e392c admin admin] PATH_INFO: `/v3/projects` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:33.253054 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673092a2-0b00-4c63-9f41-7e8e122e392c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:33.254981 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673092a2-0b00-4c63-9f41-7e8e122e392c admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:33.375587 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1329/2624] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 18 22:06:33 2022] POST /identity/v3/projects => generated 407 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 22:06:33.379959 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d4e0ea-e8ff-4594-b641-131ad6d54f71 None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:33.390806 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d4e0ea-e8ff-4594-b641-131ad6d54f71 None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:33.449389 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f821e3-46ca-42ea-b181-e4d2955dbfcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:33.449924 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f821e3-46ca-42ea-b181-e4d2955dbfcf admin admin] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:33.450204 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f821e3-46ca-42ea-b181-e4d2955dbfcf admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:33.450478 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f821e3-46ca-42ea-b181-e4d2955dbfcf admin admin] PATH_INFO: `/v3/users` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:33.451111 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f821e3-46ca-42ea-b181-e4d2955dbfcf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:33.453058 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f821e3-46ca-42ea-b181-e4d2955dbfcf admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:33.557793 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1296/2625] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 18 22:06:33 2022] POST /identity/v3/users => generated 310 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 22:06:33.558994 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673092a2-0b00-4c63-9f41-7e8e122e392c admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:33.569853 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673092a2-0b00-4c63-9f41-7e8e122e392c admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:33.574831 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b598c94-449a-433e-88ac-df5e10cbcc84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:33.575490 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b598c94-449a-433e-88ac-df5e10cbcc84 admin admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:33.575770 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b598c94-449a-433e-88ac-df5e10cbcc84 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:33.576040 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b598c94-449a-433e-88ac-df5e10cbcc84 admin admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:33.576715 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b598c94-449a-433e-88ac-df5e10cbcc84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:33.578422 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b598c94-449a-433e-88ac-df5e10cbcc84 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:33.590443 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1330/2626] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:06:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:06:33.594685 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f821e3-46ca-42ea-b181-e4d2955dbfcf admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:33.612788 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f821e3-46ca-42ea-b181-e4d2955dbfcf admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:33.617823 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9acbf3a-d1bf-4911-93a4-f5de25afc9e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:33.624567 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9acbf3a-d1bf-4911-93a4-f5de25afc9e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:33.624567 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9acbf3a-d1bf-4911-93a4-f5de25afc9e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:33.624567 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9acbf3a-d1bf-4911-93a4-f5de25afc9e1 admin admin] PATH_INFO: `/v3/projects/292b7979ab2e4e718bd2d62230ead2e8/users/631c51fbe18c4bbd9d25d160f6c53d41/roles/0833202e2a3d47d1b6b3af57006641b1` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:33.635571 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9acbf3a-d1bf-4911-93a4-f5de25afc9e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=292b7979ab2e4e718bd2d62230ead2e8, user_id=631c51fbe18c4bbd9d25d160f6c53d41, role_id=0833202e2a3d47d1b6b3af57006641b1)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:33.638428 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9acbf3a-d1bf-4911-93a4-f5de25afc9e1 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:33.723732 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1297/2627] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 18 22:06:33 2022] PUT /identity/v3/projects/292b7979ab2e4e718bd2d62230ead2e8/users/631c51fbe18c4bbd9d25d160f6c53d41/roles/0833202e2a3d47d1b6b3af57006641b1 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:06:33.727972 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b598c94-449a-433e-88ac-df5e10cbcc84 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:33.739106 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b598c94-449a-433e-88ac-df5e10cbcc84 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:33.747999 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:06:33.794721 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3fa6d1-3590-41ae-9957-448a20c4e194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:33.795319 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3fa6d1-3590-41ae-9957-448a20c4e194 admin admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:33.795599 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3fa6d1-3590-41ae-9957-448a20c4e194 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:33.795874 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3fa6d1-3590-41ae-9957-448a20c4e194 admin admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:33.796516 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3fa6d1-3590-41ae-9957-448a20c4e194 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:33.799260 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3fa6d1-3590-41ae-9957-448a20c4e194 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:33.809427 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1331/2628] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:06:33 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:06:33.813766 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9acbf3a-d1bf-4911-93a4-f5de25afc9e1 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:33.825617 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9acbf3a-d1bf-4911-93a4-f5de25afc9e1 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:33.831037 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7c9122-240f-4aab-8ddf-73f07292624b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:33.831700 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7c9122-240f-4aab-8ddf-73f07292624b admin admin] REQUEST_METHOD: `PUT` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:33.831983 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7c9122-240f-4aab-8ddf-73f07292624b admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:33.832260 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7c9122-240f-4aab-8ddf-73f07292624b admin admin] PATH_INFO: `/v3/projects/292b7979ab2e4e718bd2d62230ead2e8/users/631c51fbe18c4bbd9d25d160f6c53d41/roles/0833202e2a3d47d1b6b3af57006641b1` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:33.839291 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7c9122-240f-4aab-8ddf-73f07292624b admin admin] RBAC: Authorizing `identity:create_grant(project_id=292b7979ab2e4e718bd2d62230ead2e8, user_id=631c51fbe18c4bbd9d25d160f6c53d41, role_id=0833202e2a3d47d1b6b3af57006641b1)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:33.839291 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7c9122-240f-4aab-8ddf-73f07292624b admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:33.848470 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1298/2629] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 18 22:06:33 2022] PUT /identity/v3/projects/292b7979ab2e4e718bd2d62230ead2e8/users/631c51fbe18c4bbd9d25d160f6c53d41/roles/0833202e2a3d47d1b6b3af57006641b1 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 22:06:33.859523 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca190f6b-abbb-4b05-b97d-ac08dd87a282 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:33.860725 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca190f6b-abbb-4b05-b97d-ac08dd87a282 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:33.861577 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca190f6b-abbb-4b05-b97d-ac08dd87a282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:33.893260 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-ca190f6b-abbb-4b05-b97d-ac08dd87a282 None None] MFA Rules not processed for user `631c51fbe18c4bbd9d25d160f6c53d41`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:06:33.895222 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-ca190f6b-abbb-4b05-b97d-ac08dd87a282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:06:33.971739 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1332/2630] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:06:33 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:06:33.982564 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7c9122-240f-4aab-8ddf-73f07292624b admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:33.984475 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-1c7c9122-240f-4aab-8ddf-73f07292624b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:06:34.045968 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7c9122-240f-4aab-8ddf-73f07292624b admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:34.050324 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e2031c-cedb-4dc8-af6f-947e0c976478 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22b6a7c36f8a4795a75271b8079821c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:34.050925 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e2031c-cedb-4dc8-af6f-947e0c976478 service cinder] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:34.051293 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e2031c-cedb-4dc8-af6f-947e0c976478 service cinder] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:34.051498 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e2031c-cedb-4dc8-af6f-947e0c976478 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:34.058572 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:06:34.060950 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e2031c-cedb-4dc8-af6f-947e0c976478 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:34.062387 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e2031c-cedb-4dc8-af6f-947e0c976478 service cinder] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:34.072710 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1299/2631] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:06:33 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:06:34.477540 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca190f6b-abbb-4b05-b97d-ac08dd87a282 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:34.478934 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-ca190f6b-abbb-4b05-b97d-ac08dd87a282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:06:34.491355 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca190f6b-abbb-4b05-b97d-ac08dd87a282 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:34.495595 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f40bec-c1c2-4870-8c04-7d28e61b5b39 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22b6a7c36f8a4795a75271b8079821c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:34.496192 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f40bec-c1c2-4870-8c04-7d28e61b5b39 service cinder] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:34.496475 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f40bec-c1c2-4870-8c04-7d28e61b5b39 service cinder] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:34.499510 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f40bec-c1c2-4870-8c04-7d28e61b5b39 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:34.678446 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f40bec-c1c2-4870-8c04-7d28e61b5b39 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:34.679875 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f40bec-c1c2-4870-8c04-7d28e61b5b39 service cinder] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:34.689886 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1333/2632] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:06:34 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:06:41.554322 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e2031c-cedb-4dc8-af6f-947e0c976478 service cinder] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:41.619892 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e2031c-cedb-4dc8-af6f-947e0c976478 service cinder] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:41.625246 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d95c256-ae73-439d-bae5-1d9275710ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:41.625882 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d95c256-ae73-439d-bae5-1d9275710ab5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:41.626184 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d95c256-ae73-439d-bae5-1d9275710ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:41.626430 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d95c256-ae73-439d-bae5-1d9275710ab5 admin admin] PATH_INFO: `/v3/users/9fe29cc32a6f4c55bb1436b68ba5d58c` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:41.628151 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d95c256-ae73-439d-bae5-1d9275710ab5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9fe29cc32a6f4c55bb1436b68ba5d58c)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:41.630347 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d95c256-ae73-439d-bae5-1d9275710ab5 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:41.826850 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-6d95c256-ae73-439d-bae5-1d9275710ab5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9fe29cc32a6f4c55bb1436b68ba5d58c'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:41.834397 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-6d95c256-ae73-439d-bae5-1d9275710ab5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9fe29cc32a6f4c55bb1436b68ba5d58c'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:41.835123 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-6d95c256-ae73-439d-bae5-1d9275710ab5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9fe29cc32a6f4c55bb1436b68ba5d58c'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:41.835735 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-6d95c256-ae73-439d-bae5-1d9275710ab5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9fe29cc32a6f4c55bb1436b68ba5d58c'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:41.848515 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-6d95c256-ae73-439d-bae5-1d9275710ab5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9fe29cc32a6f4c55bb1436b68ba5d58c'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:41.911250 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1300/2633] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 18 22:06:41 2022] DELETE /identity/v3/users/9fe29cc32a6f4c55bb1436b68ba5d58c => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:06:41.915798 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3ef676-34f0-4c38-985c-2441d51689c7 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:41.916251 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3ef676-34f0-4c38-985c-2441d51689c7 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:41.916372 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3ef676-34f0-4c38-985c-2441d51689c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:41.935462 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-2b3ef676-34f0-4c38-985c-2441d51689c7 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:06:41.939347 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-2b3ef676-34f0-4c38-985c-2441d51689c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:06:41.965843 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=100 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:06:41.995705 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1334/2634] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:06:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:06:42.005931 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d95c256-ae73-439d-bae5-1d9275710ab5 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:42.007341 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-6d95c256-ae73-439d-bae5-1d9275710ab5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:06:42.066595 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d95c256-ae73-439d-bae5-1d9275710ab5 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:42.070508 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29f46f5-be14-40a7-8d9f-0ce8ff672ed5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a937971ad1a4b0c8697c764f214d446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:42.071109 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29f46f5-be14-40a7-8d9f-0ce8ff672ed5 service neutron] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:42.071388 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29f46f5-be14-40a7-8d9f-0ce8ff672ed5 service neutron] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:42.071711 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29f46f5-be14-40a7-8d9f-0ce8ff672ed5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:42.081029 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29f46f5-be14-40a7-8d9f-0ce8ff672ed5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:42.082566 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29f46f5-be14-40a7-8d9f-0ce8ff672ed5 service neutron] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:42.092075 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1301/2635] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:06:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:06:42.509140 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3ef676-34f0-4c38-985c-2441d51689c7 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:42.510721 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-2b3ef676-34f0-4c38-985c-2441d51689c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:06:42.524511 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3ef676-34f0-4c38-985c-2441d51689c7 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:42.529101 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bc877c-2a40-4712-82ec-d0fa9901e299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:42.529728 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bc877c-2a40-4712-82ec-d0fa9901e299 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:42.530001 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bc877c-2a40-4712-82ec-d0fa9901e299 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:42.530706 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bc877c-2a40-4712-82ec-d0fa9901e299 admin admin] PATH_INFO: `/v3/projects/b505203fba674797911502fb2fab8fa7` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:42.531416 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bc877c-2a40-4712-82ec-d0fa9901e299 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b505203fba674797911502fb2fab8fa7)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:42.533463 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bc877c-2a40-4712-82ec-d0fa9901e299 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:42.646762 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-81bc877c-2a40-4712-82ec-d0fa9901e299 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b505203fba674797911502fb2fab8fa7', 'request_id': 'req-81bc877c-2a40-4712-82ec-d0fa9901e299'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:42.652567 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-81bc877c-2a40-4712-82ec-d0fa9901e299 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b505203fba674797911502fb2fab8fa7', 'request_id': 'req-81bc877c-2a40-4712-82ec-d0fa9901e299'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:42.728121 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-81bc877c-2a40-4712-82ec-d0fa9901e299 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b505203fba674797911502fb2fab8fa7', 'request_id': 'req-81bc877c-2a40-4712-82ec-d0fa9901e299'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:42.740398 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-81bc877c-2a40-4712-82ec-d0fa9901e299 admin admin] The token cache is being invalidate because project b505203fba674797911502fb2fab8fa7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88097) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 22:06:42.740716 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-81bc877c-2a40-4712-82ec-d0fa9901e299 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:42.741430 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-81bc877c-2a40-4712-82ec-d0fa9901e299 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:42.743039 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1335/2636] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 18 22:06:42 2022] DELETE /identity/v3/projects/b505203fba674797911502fb2fab8fa7 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:06:42.751940 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29f46f5-be14-40a7-8d9f-0ce8ff672ed5 service neutron] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:42.757022 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29f46f5-be14-40a7-8d9f-0ce8ff672ed5 service neutron] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:42.770313 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:06:42.815768 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa367fba-5f63-4d63-948b-3bc482f8d739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:42.816890 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa367fba-5f63-4d63-948b-3bc482f8d739 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:42.817159 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa367fba-5f63-4d63-948b-3bc482f8d739 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:42.817510 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa367fba-5f63-4d63-948b-3bc482f8d739 admin admin] PATH_INFO: `/v3/users/631c51fbe18c4bbd9d25d160f6c53d41` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:42.818682 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa367fba-5f63-4d63-948b-3bc482f8d739 admin admin] RBAC: Authorizing `identity:delete_user(user_id=631c51fbe18c4bbd9d25d160f6c53d41)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:42.820616 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa367fba-5f63-4d63-948b-3bc482f8d739 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:43.029379 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-aa367fba-5f63-4d63-948b-3bc482f8d739 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '631c51fbe18c4bbd9d25d160f6c53d41'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:43.038534 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-aa367fba-5f63-4d63-948b-3bc482f8d739 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '631c51fbe18c4bbd9d25d160f6c53d41'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:43.039226 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-aa367fba-5f63-4d63-948b-3bc482f8d739 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '631c51fbe18c4bbd9d25d160f6c53d41'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:43.039844 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-aa367fba-5f63-4d63-948b-3bc482f8d739 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '631c51fbe18c4bbd9d25d160f6c53d41'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:43.052017 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-aa367fba-5f63-4d63-948b-3bc482f8d739 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '631c51fbe18c4bbd9d25d160f6c53d41'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:43.133813 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1302/2637] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 18 22:06:42 2022] DELETE /identity/v3/users/631c51fbe18c4bbd9d25d160f6c53d41 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:06:43.558314 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bc877c-2a40-4712-82ec-d0fa9901e299 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:43.559774 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-81bc877c-2a40-4712-82ec-d0fa9901e299 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:06:43.576645 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bc877c-2a40-4712-82ec-d0fa9901e299 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:43.635565 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b803d8a-b8e0-4016-b23b-613114f4fdb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:43.636194 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b803d8a-b8e0-4016-b23b-613114f4fdb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:43.636474 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b803d8a-b8e0-4016-b23b-613114f4fdb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:43.636852 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b803d8a-b8e0-4016-b23b-613114f4fdb3 admin admin] PATH_INFO: `/v3/projects/292b7979ab2e4e718bd2d62230ead2e8` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:43.637976 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b803d8a-b8e0-4016-b23b-613114f4fdb3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=292b7979ab2e4e718bd2d62230ead2e8)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:43.640250 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b803d8a-b8e0-4016-b23b-613114f4fdb3 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:43.757633 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-4b803d8a-b8e0-4016-b23b-613114f4fdb3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '292b7979ab2e4e718bd2d62230ead2e8', 'request_id': 'req-4b803d8a-b8e0-4016-b23b-613114f4fdb3'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:43.763095 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-4b803d8a-b8e0-4016-b23b-613114f4fdb3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '292b7979ab2e4e718bd2d62230ead2e8', 'request_id': 'req-4b803d8a-b8e0-4016-b23b-613114f4fdb3'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:43.765230 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:06:43.838658 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-4b803d8a-b8e0-4016-b23b-613114f4fdb3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '292b7979ab2e4e718bd2d62230ead2e8', 'request_id': 'req-4b803d8a-b8e0-4016-b23b-613114f4fdb3'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:43.856337 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-4b803d8a-b8e0-4016-b23b-613114f4fdb3 admin admin] The token cache is being invalidate because project 292b7979ab2e4e718bd2d62230ead2e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88097) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 22:06:43.861038 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-4b803d8a-b8e0-4016-b23b-613114f4fdb3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:43.861038 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-4b803d8a-b8e0-4016-b23b-613114f4fdb3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:43.861038 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1336/2638] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 18 22:06:43 2022] DELETE /identity/v3/projects/292b7979ab2e4e718bd2d62230ead2e8 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:06:43.866490 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3074b41-cdcd-4ace-8b6e-c62c024d10f8 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:43.867027 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3074b41-cdcd-4ace-8b6e-c62c024d10f8 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:43.868140 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3074b41-cdcd-4ace-8b6e-c62c024d10f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:43.902310 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-f3074b41-cdcd-4ace-8b6e-c62c024d10f8 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:06:43.904426 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-f3074b41-cdcd-4ace-8b6e-c62c024d10f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:06:43.970131 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1303/2639] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:06:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:06:43.978969 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc53471-5a2f-430d-a86c-78c6a18680cd None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:43.979264 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc53471-5a2f-430d-a86c-78c6a18680cd None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:43.979540 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc53471-5a2f-430d-a86c-78c6a18680cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:44.000043 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-6fc53471-5a2f-430d-a86c-78c6a18680cd None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:06:44.001268 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-6fc53471-5a2f-430d-a86c-78c6a18680cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:06:44.009713 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1337/2640] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:06:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:06:44.014049 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3074b41-cdcd-4ace-8b6e-c62c024d10f8 None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:44.024980 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3074b41-cdcd-4ace-8b6e-c62c024d10f8 None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:44.029716 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a88b9b-8369-4bb2-8655-deb72f054567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:44.030320 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a88b9b-8369-4bb2-8655-deb72f054567 admin admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:44.030609 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a88b9b-8369-4bb2-8655-deb72f054567 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:44.030890 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a88b9b-8369-4bb2-8655-deb72f054567 admin admin] PATH_INFO: `/v3/domains` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:44.031569 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a88b9b-8369-4bb2-8655-deb72f054567 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 22:06:44.031878 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a88b9b-8369-4bb2-8655-deb72f054567 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:44.033637 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a88b9b-8369-4bb2-8655-deb72f054567 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:44.046278 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1304/2641] 10.222.0.27 () {58 vars in 1153 bytes} [Thu Aug 18 22:06:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 22:06:44.058731 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc53471-5a2f-430d-a86c-78c6a18680cd None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:44.060046 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc53471-5a2f-430d-a86c-78c6a18680cd None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:44.065095 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f5e99c-e298-4092-a587-0a997af7e9a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:44.065714 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f5e99c-e298-4092-a587-0a997af7e9a1 admin admin] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:44.065990 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f5e99c-e298-4092-a587-0a997af7e9a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:44.066259 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f5e99c-e298-4092-a587-0a997af7e9a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:44.066886 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f5e99c-e298-4092-a587-0a997af7e9a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:44.068843 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f5e99c-e298-4092-a587-0a997af7e9a1 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:44.186884 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1338/2642] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 18 22:06:44 2022] POST /identity/v3/projects => generated 361 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 22:06:44.191567 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a88b9b-8369-4bb2-8655-deb72f054567 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:44.201917 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a88b9b-8369-4bb2-8655-deb72f054567 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:44.223230 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:06:44.261768 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc911d5d-d7b0-4dc6-8e97-55561ce23102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:44.262307 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc911d5d-d7b0-4dc6-8e97-55561ce23102 admin admin] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:44.262591 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc911d5d-d7b0-4dc6-8e97-55561ce23102 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:44.262868 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc911d5d-d7b0-4dc6-8e97-55561ce23102 admin admin] PATH_INFO: `/v3/users` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:44.263542 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc911d5d-d7b0-4dc6-8e97-55561ce23102 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:44.265788 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc911d5d-d7b0-4dc6-8e97-55561ce23102 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:44.348515 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1305/2643] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 18 22:06:44 2022] POST /identity/v3/users => generated 281 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 22:06:44.353122 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f5e99c-e298-4092-a587-0a997af7e9a1 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:44.363905 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f5e99c-e298-4092-a587-0a997af7e9a1 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:44.369082 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477cb7d2-b348-4cde-8920-20923fb1d749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:44.369677 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477cb7d2-b348-4cde-8920-20923fb1d749 admin admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:44.369962 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477cb7d2-b348-4cde-8920-20923fb1d749 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:44.370236 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477cb7d2-b348-4cde-8920-20923fb1d749 admin admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:44.370879 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477cb7d2-b348-4cde-8920-20923fb1d749 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:44.372453 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477cb7d2-b348-4cde-8920-20923fb1d749 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:44.388882 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1339/2644] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:06:44 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:06:44.395334 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc911d5d-d7b0-4dc6-8e97-55561ce23102 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:44.406282 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc911d5d-d7b0-4dc6-8e97-55561ce23102 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:44.411708 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265a02b5-4a58-4fa3-84fd-1804cac04b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:44.413057 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265a02b5-4a58-4fa3-84fd-1804cac04b85 admin admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:44.413345 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265a02b5-4a58-4fa3-84fd-1804cac04b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:44.413625 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265a02b5-4a58-4fa3-84fd-1804cac04b85 admin admin] PATH_INFO: `/v3/roles` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:44.414276 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265a02b5-4a58-4fa3-84fd-1804cac04b85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:44.415863 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265a02b5-4a58-4fa3-84fd-1804cac04b85 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:44.429889 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1306/2645] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:06:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:06:44.431084 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477cb7d2-b348-4cde-8920-20923fb1d749 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:44.441202 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477cb7d2-b348-4cde-8920-20923fb1d749 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:44.446364 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e625aa2-cba3-4a80-8a07-b685d414bddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:44.447004 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e625aa2-cba3-4a80-8a07-b685d414bddd admin admin] REQUEST_METHOD: `PUT` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:44.447282 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e625aa2-cba3-4a80-8a07-b685d414bddd admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:44.447551 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e625aa2-cba3-4a80-8a07-b685d414bddd admin admin] PATH_INFO: `/v3/projects/f0fcff120bc94c0e8a800487c3ec5b88/users/d882115ac7f44b7cbdf0387211b0e204/roles/de8f2438056f4af9879423f8a59e0e0b` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:44.463252 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e625aa2-cba3-4a80-8a07-b685d414bddd admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0fcff120bc94c0e8a800487c3ec5b88, user_id=d882115ac7f44b7cbdf0387211b0e204, role_id=de8f2438056f4af9879423f8a59e0e0b)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:44.467085 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e625aa2-cba3-4a80-8a07-b685d414bddd admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:44.530853 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1340/2646] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 18 22:06:44 2022] PUT /identity/v3/projects/f0fcff120bc94c0e8a800487c3ec5b88/users/d882115ac7f44b7cbdf0387211b0e204/roles/de8f2438056f4af9879423f8a59e0e0b => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:06:44.541967 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9939f87c-a4fe-4a9d-85ad-f72f1550a7cf None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:44.542257 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9939f87c-a4fe-4a9d-85ad-f72f1550a7cf None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:44.542533 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9939f87c-a4fe-4a9d-85ad-f72f1550a7cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:44.570176 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-9939f87c-a4fe-4a9d-85ad-f72f1550a7cf None None] MFA Rules not processed for user `d882115ac7f44b7cbdf0387211b0e204`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:06:44.571379 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-9939f87c-a4fe-4a9d-85ad-f72f1550a7cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:06:44.637625 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1307/2647] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:06:44 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:06:44.675031 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e625aa2-cba3-4a80-8a07-b685d414bddd admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:44.676802 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-5e625aa2-cba3-4a80-8a07-b685d414bddd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:06:44.741656 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e625aa2-cba3-4a80-8a07-b685d414bddd admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:44.745389 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e81ec8-48d5-4ab0-9d2c-8578330efcb9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22b6a7c36f8a4795a75271b8079821c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:44.745982 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e81ec8-48d5-4ab0-9d2c-8578330efcb9 service cinder] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:44.746258 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e81ec8-48d5-4ab0-9d2c-8578330efcb9 service cinder] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:44.746526 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e81ec8-48d5-4ab0-9d2c-8578330efcb9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:44.755115 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e81ec8-48d5-4ab0-9d2c-8578330efcb9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:44.757371 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e81ec8-48d5-4ab0-9d2c-8578330efcb9 service cinder] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:44.766402 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1341/2648] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:06:44 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:06:44.782910 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9939f87c-a4fe-4a9d-85ad-f72f1550a7cf None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:44.844316 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9939f87c-a4fe-4a9d-85ad-f72f1550a7cf None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:44.848877 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e022ad6c-5c39-469d-aa36-b37bb3ca1463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:44.849610 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e022ad6c-5c39-469d-aa36-b37bb3ca1463 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:44.849896 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e022ad6c-5c39-469d-aa36-b37bb3ca1463 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:44.850168 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e022ad6c-5c39-469d-aa36-b37bb3ca1463 admin admin] PATH_INFO: `/v3/users/d882115ac7f44b7cbdf0387211b0e204` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:44.851310 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e022ad6c-5c39-469d-aa36-b37bb3ca1463 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d882115ac7f44b7cbdf0387211b0e204)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:44.853258 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e022ad6c-5c39-469d-aa36-b37bb3ca1463 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:45.011497 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:06:45.021076 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-e022ad6c-5c39-469d-aa36-b37bb3ca1463 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd882115ac7f44b7cbdf0387211b0e204'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:45.028391 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-e022ad6c-5c39-469d-aa36-b37bb3ca1463 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd882115ac7f44b7cbdf0387211b0e204'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:45.029097 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-e022ad6c-5c39-469d-aa36-b37bb3ca1463 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd882115ac7f44b7cbdf0387211b0e204'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:45.029725 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-e022ad6c-5c39-469d-aa36-b37bb3ca1463 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd882115ac7f44b7cbdf0387211b0e204'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:45.042284 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-e022ad6c-5c39-469d-aa36-b37bb3ca1463 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd882115ac7f44b7cbdf0387211b0e204'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:45.145150 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1308/2649] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 18 22:06:44 2022] DELETE /identity/v3/users/d882115ac7f44b7cbdf0387211b0e204 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:06:45.149960 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8ea271-12e7-4810-9efb-c5d789c3db89 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:45.150143 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8ea271-12e7-4810-9efb-c5d789c3db89 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:45.150415 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8ea271-12e7-4810-9efb-c5d789c3db89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:45.170730 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-ed8ea271-12e7-4810-9efb-c5d789c3db89 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:06:45.171967 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-ed8ea271-12e7-4810-9efb-c5d789c3db89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:06:45.230166 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1342/2650] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:06:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:06:45.240519 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e022ad6c-5c39-469d-aa36-b37bb3ca1463 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:45.242220 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-e022ad6c-5c39-469d-aa36-b37bb3ca1463 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:06:45.299507 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e022ad6c-5c39-469d-aa36-b37bb3ca1463 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:45.303982 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdf8f15-3399-4fc2-a40a-9724ac670a11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a937971ad1a4b0c8697c764f214d446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:45.304584 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdf8f15-3399-4fc2-a40a-9724ac670a11 service neutron] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:45.304908 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdf8f15-3399-4fc2-a40a-9724ac670a11 service neutron] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:45.305180 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdf8f15-3399-4fc2-a40a-9724ac670a11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:45.314240 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdf8f15-3399-4fc2-a40a-9724ac670a11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:45.315656 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdf8f15-3399-4fc2-a40a-9724ac670a11 service neutron] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:45.325169 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1309/2651] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:06:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:06:45.754880 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8ea271-12e7-4810-9efb-c5d789c3db89 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:45.756578 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-ed8ea271-12e7-4810-9efb-c5d789c3db89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:06:45.770081 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8ea271-12e7-4810-9efb-c5d789c3db89 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:45.776230 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ecbb23-e271-4867-b7ed-22e9c8da181e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:45.777060 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ecbb23-e271-4867-b7ed-22e9c8da181e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:45.777421 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ecbb23-e271-4867-b7ed-22e9c8da181e admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:45.777702 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ecbb23-e271-4867-b7ed-22e9c8da181e admin admin] PATH_INFO: `/v3/projects/f0fcff120bc94c0e8a800487c3ec5b88` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:45.779448 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ecbb23-e271-4867-b7ed-22e9c8da181e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0fcff120bc94c0e8a800487c3ec5b88)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:45.783591 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ecbb23-e271-4867-b7ed-22e9c8da181e admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:45.813076 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:INSERT=3,keystone:DELETE=1,keystone:SELECT=96 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:06:45.892056 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-95ecbb23-e271-4867-b7ed-22e9c8da181e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0fcff120bc94c0e8a800487c3ec5b88', 'request_id': 'req-95ecbb23-e271-4867-b7ed-22e9c8da181e'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:45.898606 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-95ecbb23-e271-4867-b7ed-22e9c8da181e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0fcff120bc94c0e8a800487c3ec5b88', 'request_id': 'req-95ecbb23-e271-4867-b7ed-22e9c8da181e'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:45.981616 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-95ecbb23-e271-4867-b7ed-22e9c8da181e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0fcff120bc94c0e8a800487c3ec5b88', 'request_id': 'req-95ecbb23-e271-4867-b7ed-22e9c8da181e'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:45.993472 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-95ecbb23-e271-4867-b7ed-22e9c8da181e admin admin] The token cache is being invalidate because project f0fcff120bc94c0e8a800487c3ec5b88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88097) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 22:06:45.993765 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-95ecbb23-e271-4867-b7ed-22e9c8da181e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:45.994420 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-95ecbb23-e271-4867-b7ed-22e9c8da181e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:45.995909 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1343/2652] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 18 22:06:45 2022] DELETE /identity/v3/projects/f0fcff120bc94c0e8a800487c3ec5b88 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:06:46.000904 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4996a9cf-b1e1-4559-992d-e106cd0b5e2f None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:46.001220 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4996a9cf-b1e1-4559-992d-e106cd0b5e2f None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:46.001495 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4996a9cf-b1e1-4559-992d-e106cd0b5e2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:46.022867 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-4996a9cf-b1e1-4559-992d-e106cd0b5e2f None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:06:46.024090 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-4996a9cf-b1e1-4559-992d-e106cd0b5e2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:06:46.089884 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1310/2653] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:06:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:06:46.097782 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3616a51-df19-425d-8178-d457d610d214 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:46.098063 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3616a51-df19-425d-8178-d457d610d214 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:46.098333 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3616a51-df19-425d-8178-d457d610d214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:46.117543 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-e3616a51-df19-425d-8178-d457d610d214 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:06:46.118736 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-e3616a51-df19-425d-8178-d457d610d214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:06:46.127177 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1344/2654] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:06:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:06:46.132020 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4996a9cf-b1e1-4559-992d-e106cd0b5e2f None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:46.142245 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4996a9cf-b1e1-4559-992d-e106cd0b5e2f None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:46.147950 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2454da-ef4b-4ff4-bde8-507848fe7b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:46.148575 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2454da-ef4b-4ff4-bde8-507848fe7b43 admin admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:46.148886 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2454da-ef4b-4ff4-bde8-507848fe7b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:46.149162 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2454da-ef4b-4ff4-bde8-507848fe7b43 admin admin] PATH_INFO: `/v3/domains` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:46.149810 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2454da-ef4b-4ff4-bde8-507848fe7b43 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 22:06:46.150115 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2454da-ef4b-4ff4-bde8-507848fe7b43 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:46.151706 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2454da-ef4b-4ff4-bde8-507848fe7b43 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:46.163538 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1311/2655] 10.222.0.27 () {58 vars in 1153 bytes} [Thu Aug 18 22:06:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 22:06:46.167763 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3616a51-df19-425d-8178-d457d610d214 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:46.177191 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3616a51-df19-425d-8178-d457d610d214 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:46.182219 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786c735d-5a2e-4b22-8a7c-65d148faa56e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:46.184817 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786c735d-5a2e-4b22-8a7c-65d148faa56e admin admin] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:46.184817 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786c735d-5a2e-4b22-8a7c-65d148faa56e admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:46.184817 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786c735d-5a2e-4b22-8a7c-65d148faa56e admin admin] PATH_INFO: `/v3/projects` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:46.184817 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786c735d-5a2e-4b22-8a7c-65d148faa56e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:46.185864 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786c735d-5a2e-4b22-8a7c-65d148faa56e admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:46.273102 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1345/2656] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 18 22:06:46 2022] POST /identity/v3/projects => generated 377 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 22:06:46.277424 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2454da-ef4b-4ff4-bde8-507848fe7b43 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:46.287854 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2454da-ef4b-4ff4-bde8-507848fe7b43 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:46.331727 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:06:46.347661 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a94b82-69b2-4495-b866-60c2070c79e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:46.348263 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a94b82-69b2-4495-b866-60c2070c79e0 admin admin] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:46.348541 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a94b82-69b2-4495-b866-60c2070c79e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:46.349897 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a94b82-69b2-4495-b866-60c2070c79e0 admin admin] PATH_INFO: `/v3/users` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:46.349897 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a94b82-69b2-4495-b866-60c2070c79e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:46.351502 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a94b82-69b2-4495-b866-60c2070c79e0 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:46.450759 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1312/2657] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 18 22:06:46 2022] POST /identity/v3/users => generated 289 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 22:06:46.454981 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786c735d-5a2e-4b22-8a7c-65d148faa56e admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:46.465317 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786c735d-5a2e-4b22-8a7c-65d148faa56e admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:46.470006 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86cf739-64c1-454b-9d39-0e92feb51477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:46.470600 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86cf739-64c1-454b-9d39-0e92feb51477 admin admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:46.470910 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86cf739-64c1-454b-9d39-0e92feb51477 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:46.471185 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86cf739-64c1-454b-9d39-0e92feb51477 admin admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:46.471828 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86cf739-64c1-454b-9d39-0e92feb51477 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:46.473474 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86cf739-64c1-454b-9d39-0e92feb51477 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:46.483883 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1346/2658] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:06:46 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:06:46.488092 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a94b82-69b2-4495-b866-60c2070c79e0 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:46.498790 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a94b82-69b2-4495-b866-60c2070c79e0 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:46.503406 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5114ecc6-7a77-4f6a-88b4-2f07594b8cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:46.503993 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5114ecc6-7a77-4f6a-88b4-2f07594b8cc9 admin admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:46.504265 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5114ecc6-7a77-4f6a-88b4-2f07594b8cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:46.504534 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5114ecc6-7a77-4f6a-88b4-2f07594b8cc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:46.505197 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5114ecc6-7a77-4f6a-88b4-2f07594b8cc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:46.507708 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5114ecc6-7a77-4f6a-88b4-2f07594b8cc9 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:46.518538 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1313/2659] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:06:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:06:46.522752 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86cf739-64c1-454b-9d39-0e92feb51477 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:46.532980 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86cf739-64c1-454b-9d39-0e92feb51477 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:46.537706 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e51df39-9d8f-41a6-ac45-41b6d4d2cf1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:46.538344 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e51df39-9d8f-41a6-ac45-41b6d4d2cf1e admin admin] REQUEST_METHOD: `PUT` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:46.538620 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e51df39-9d8f-41a6-ac45-41b6d4d2cf1e admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:46.538888 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e51df39-9d8f-41a6-ac45-41b6d4d2cf1e admin admin] PATH_INFO: `/v3/projects/5f767492ba1048d9bc2fa0746428d8d0/users/76d13fccbf4d4bd1a9a0755528e692e8/roles/de8f2438056f4af9879423f8a59e0e0b` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:46.554066 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e51df39-9d8f-41a6-ac45-41b6d4d2cf1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f767492ba1048d9bc2fa0746428d8d0, user_id=76d13fccbf4d4bd1a9a0755528e692e8, role_id=de8f2438056f4af9879423f8a59e0e0b)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:46.556743 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e51df39-9d8f-41a6-ac45-41b6d4d2cf1e admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:46.624260 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1347/2660] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 18 22:06:46 2022] PUT /identity/v3/projects/5f767492ba1048d9bc2fa0746428d8d0/users/76d13fccbf4d4bd1a9a0755528e692e8/roles/de8f2438056f4af9879423f8a59e0e0b => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:06:46.635747 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f80e9c0-5a3f-4e0d-abea-9b1cf5f369b3 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:46.636036 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f80e9c0-5a3f-4e0d-abea-9b1cf5f369b3 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:46.636355 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f80e9c0-5a3f-4e0d-abea-9b1cf5f369b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:46.664980 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-8f80e9c0-5a3f-4e0d-abea-9b1cf5f369b3 None None] MFA Rules not processed for user `76d13fccbf4d4bd1a9a0755528e692e8`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:06:46.666196 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-8f80e9c0-5a3f-4e0d-abea-9b1cf5f369b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:06:46.730612 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1314/2661] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:06:46 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:06:46.735100 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e51df39-9d8f-41a6-ac45-41b6d4d2cf1e admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:46.795046 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e51df39-9d8f-41a6-ac45-41b6d4d2cf1e admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:46.799765 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1b530d-fd25-4fd9-b73a-8bc81c4a5585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:46.800354 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1b530d-fd25-4fd9-b73a-8bc81c4a5585 admin admin] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:46.800654 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1b530d-fd25-4fd9-b73a-8bc81c4a5585 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:46.800927 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1b530d-fd25-4fd9-b73a-8bc81c4a5585 admin admin] PATH_INFO: `/v3/projects` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:46.801550 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1b530d-fd25-4fd9-b73a-8bc81c4a5585 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:46.804133 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1b530d-fd25-4fd9-b73a-8bc81c4a5585 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:46.923756 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1348/2662] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 18 22:06:46 2022] POST /identity/v3/projects => generated 373 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 22:06:46.928459 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f80e9c0-5a3f-4e0d-abea-9b1cf5f369b3 None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:46.939275 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f80e9c0-5a3f-4e0d-abea-9b1cf5f369b3 None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:46.995786 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da347a8d-3fa5-4f6a-857b-a6b196a4f15e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:46.996396 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da347a8d-3fa5-4f6a-857b-a6b196a4f15e admin admin] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:46.996713 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da347a8d-3fa5-4f6a-857b-a6b196a4f15e admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:46.996990 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da347a8d-3fa5-4f6a-857b-a6b196a4f15e admin admin] PATH_INFO: `/v3/users` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:46.997616 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da347a8d-3fa5-4f6a-857b-a6b196a4f15e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:46.999524 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da347a8d-3fa5-4f6a-857b-a6b196a4f15e admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:47.119295 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1315/2663] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 18 22:06:46 2022] POST /identity/v3/users => generated 287 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 22:06:47.120678 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1b530d-fd25-4fd9-b73a-8bc81c4a5585 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:47.131752 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1b530d-fd25-4fd9-b73a-8bc81c4a5585 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:47.136333 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e1186e-ea63-48a8-bb7f-c8452db5a57f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:47.136964 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e1186e-ea63-48a8-bb7f-c8452db5a57f admin admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:47.137240 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e1186e-ea63-48a8-bb7f-c8452db5a57f admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:47.137510 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e1186e-ea63-48a8-bb7f-c8452db5a57f admin admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:47.138284 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e1186e-ea63-48a8-bb7f-c8452db5a57f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:47.140052 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e1186e-ea63-48a8-bb7f-c8452db5a57f admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:47.154942 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1349/2664] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:06:47 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:06:47.158774 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da347a8d-3fa5-4f6a-857b-a6b196a4f15e admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:47.169594 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da347a8d-3fa5-4f6a-857b-a6b196a4f15e admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:47.174657 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc4d484-f5da-4e32-9739-a6b7768676ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:47.175212 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc4d484-f5da-4e32-9739-a6b7768676ce admin admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:47.175496 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc4d484-f5da-4e32-9739-a6b7768676ce admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:47.175771 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc4d484-f5da-4e32-9739-a6b7768676ce admin admin] PATH_INFO: `/v3/roles` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:47.176507 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc4d484-f5da-4e32-9739-a6b7768676ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:47.178197 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc4d484-f5da-4e32-9739-a6b7768676ce admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:47.188719 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1316/2665] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:06:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:06:47.192777 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e1186e-ea63-48a8-bb7f-c8452db5a57f admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:47.203118 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e1186e-ea63-48a8-bb7f-c8452db5a57f admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:47.209817 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e974f632-0c8b-4dd9-be29-ad3e2575cff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:47.210458 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e974f632-0c8b-4dd9-be29-ad3e2575cff2 admin admin] REQUEST_METHOD: `PUT` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:47.210731 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e974f632-0c8b-4dd9-be29-ad3e2575cff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:47.210999 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e974f632-0c8b-4dd9-be29-ad3e2575cff2 admin admin] PATH_INFO: `/v3/projects/382421fd24784faf9e06c84c89ebfd16/users/87ceb31dda974e36a24b21939943ab9e/roles/de8f2438056f4af9879423f8a59e0e0b` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:47.218792 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc4d484-f5da-4e32-9739-a6b7768676ce admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:47.220567 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-7dc4d484-f5da-4e32-9739-a6b7768676ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:06:47.226425 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e974f632-0c8b-4dd9-be29-ad3e2575cff2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=382421fd24784faf9e06c84c89ebfd16, user_id=87ceb31dda974e36a24b21939943ab9e, role_id=de8f2438056f4af9879423f8a59e0e0b)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:47.229166 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e974f632-0c8b-4dd9-be29-ad3e2575cff2 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:47.232304 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:DELETE=7,keystone:SELECT=88,keystone:INSERT=5 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:06:47.233932 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc4d484-f5da-4e32-9739-a6b7768676ce admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:47.238581 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3c9fe2-3777-4928-a5df-ec98c24ed318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:47.239204 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3c9fe2-3777-4928-a5df-ec98c24ed318 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:47.239485 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3c9fe2-3777-4928-a5df-ec98c24ed318 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:47.239865 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3c9fe2-3777-4928-a5df-ec98c24ed318 admin admin] PATH_INFO: `/v3/users/d8f8192b056c41a78c55d37e3f95e68f` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:47.241030 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3c9fe2-3777-4928-a5df-ec98c24ed318 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8f8192b056c41a78c55d37e3f95e68f)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:47.243935 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3c9fe2-3777-4928-a5df-ec98c24ed318 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:47.266269 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=90,keystone:INSERT=6,keystone:DELETE=4 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:06:47.325177 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1350/2666] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 18 22:06:47 2022] PUT /identity/v3/projects/382421fd24784faf9e06c84c89ebfd16/users/87ceb31dda974e36a24b21939943ab9e/roles/de8f2438056f4af9879423f8a59e0e0b => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:06:47.336453 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7025bcef-9118-4670-9d5d-238198518efb None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:47.336775 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7025bcef-9118-4670-9d5d-238198518efb None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:47.337057 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7025bcef-9118-4670-9d5d-238198518efb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:47.364932 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-7025bcef-9118-4670-9d5d-238198518efb None None] MFA Rules not processed for user `87ceb31dda974e36a24b21939943ab9e`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:06:47.366648 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-7025bcef-9118-4670-9d5d-238198518efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:06:47.433657 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1351/2667] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:06:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 22:06:47.437846 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7025bcef-9118-4670-9d5d-238198518efb None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:47.454761 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-6a3c9fe2-3777-4928-a5df-ec98c24ed318 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8f8192b056c41a78c55d37e3f95e68f'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:47.462836 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-6a3c9fe2-3777-4928-a5df-ec98c24ed318 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8f8192b056c41a78c55d37e3f95e68f'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:47.463656 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-6a3c9fe2-3777-4928-a5df-ec98c24ed318 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8f8192b056c41a78c55d37e3f95e68f'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:47.464310 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-6a3c9fe2-3777-4928-a5df-ec98c24ed318 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8f8192b056c41a78c55d37e3f95e68f'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:47.476952 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-6a3c9fe2-3777-4928-a5df-ec98c24ed318 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8f8192b056c41a78c55d37e3f95e68f'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:47.498166 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7025bcef-9118-4670-9d5d-238198518efb None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:47.502876 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648b5a1d-6812-4a26-a7ab-95fbf3ce223a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:47.503471 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648b5a1d-6812-4a26-a7ab-95fbf3ce223a admin admin] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:47.503748 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648b5a1d-6812-4a26-a7ab-95fbf3ce223a admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:47.504021 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648b5a1d-6812-4a26-a7ab-95fbf3ce223a admin admin] PATH_INFO: `/v3/projects` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:47.504676 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648b5a1d-6812-4a26-a7ab-95fbf3ce223a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:47.507213 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648b5a1d-6812-4a26-a7ab-95fbf3ce223a admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:47.564088 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1317/2668] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 18 22:06:47 2022] DELETE /identity/v3/users/d8f8192b056c41a78c55d37e3f95e68f => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 22:06:47.569470 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533fcde8-5d76-4f32-abfa-9e96a8f2a21d None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:47.569766 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533fcde8-5d76-4f32-abfa-9e96a8f2a21d None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:47.570047 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533fcde8-5d76-4f32-abfa-9e96a8f2a21d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:47.591570 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-533fcde8-5d76-4f32-abfa-9e96a8f2a21d None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:06:47.592809 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-533fcde8-5d76-4f32-abfa-9e96a8f2a21d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:06:47.633633 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1352/2669] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 18 22:06:47 2022] POST /identity/v3/projects => generated 377 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 22:06:47.638432 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648b5a1d-6812-4a26-a7ab-95fbf3ce223a admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:47.640505 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-648b5a1d-6812-4a26-a7ab-95fbf3ce223a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:06:47.712018 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648b5a1d-6812-4a26-a7ab-95fbf3ce223a admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:47.717356 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4afcba-c7d7-406d-b21c-be8f75e699f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:47.718068 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4afcba-c7d7-406d-b21c-be8f75e699f9 admin admin] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:47.718348 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4afcba-c7d7-406d-b21c-be8f75e699f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:47.718624 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4afcba-c7d7-406d-b21c-be8f75e699f9 admin admin] PATH_INFO: `/v3/users` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:47.719272 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4afcba-c7d7-406d-b21c-be8f75e699f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:47.721296 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4afcba-c7d7-406d-b21c-be8f75e699f9 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:47.779581 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1318/2670] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:06:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 22:06:47.789371 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533fcde8-5d76-4f32-abfa-9e96a8f2a21d None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:47.790683 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-533fcde8-5d76-4f32-abfa-9e96a8f2a21d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:06:47.825815 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:06:47.831612 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1353/2671] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 18 22:06:47 2022] POST /identity/v3/users => generated 295 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 22:06:47.835527 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4afcba-c7d7-406d-b21c-be8f75e699f9 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:47.845279 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4afcba-c7d7-406d-b21c-be8f75e699f9 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:47.847765 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533fcde8-5d76-4f32-abfa-9e96a8f2a21d None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:47.850462 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abee666-a271-4052-92e6-742ba438e037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:47.851049 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abee666-a271-4052-92e6-742ba438e037 admin admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:47.851329 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abee666-a271-4052-92e6-742ba438e037 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:47.851602 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abee666-a271-4052-92e6-742ba438e037 admin admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:47.852246 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abee666-a271-4052-92e6-742ba438e037 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:47.853864 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abee666-a271-4052-92e6-742ba438e037 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:47.863535 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1354/2672] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:06:47 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 22:06:47.868316 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abee666-a271-4052-92e6-742ba438e037 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:47.877749 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abee666-a271-4052-92e6-742ba438e037 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:47.883491 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b851e468-3173-4c63-9e05-312d2478a2f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:47.884134 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b851e468-3173-4c63-9e05-312d2478a2f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:47.884414 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b851e468-3173-4c63-9e05-312d2478a2f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:47.885495 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b851e468-3173-4c63-9e05-312d2478a2f8 admin admin] PATH_INFO: `/v3/projects/a17c1699071646d68b5651a47b641a54/users/02fef3e881d344069a2908997ca28e57/roles/0833202e2a3d47d1b6b3af57006641b1` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:47.900745 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b851e468-3173-4c63-9e05-312d2478a2f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a17c1699071646d68b5651a47b641a54, user_id=02fef3e881d344069a2908997ca28e57, role_id=0833202e2a3d47d1b6b3af57006641b1)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:47.901841 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9640c91c-54bd-4204-8379-82bde2d2c673 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a937971ad1a4b0c8697c764f214d446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:47.902454 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9640c91c-54bd-4204-8379-82bde2d2c673 service neutron] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:47.902733 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9640c91c-54bd-4204-8379-82bde2d2c673 service neutron] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:47.903008 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9640c91c-54bd-4204-8379-82bde2d2c673 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:47.903438 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b851e468-3173-4c63-9e05-312d2478a2f8 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:47.912587 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9640c91c-54bd-4204-8379-82bde2d2c673 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:47.914067 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9640c91c-54bd-4204-8379-82bde2d2c673 service neutron] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:47.919011 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:06:47.923690 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1319/2673] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:06:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 22:06:47.991321 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1355/2674] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 18 22:06:47 2022] PUT /identity/v3/projects/a17c1699071646d68b5651a47b641a54/users/02fef3e881d344069a2908997ca28e57/roles/0833202e2a3d47d1b6b3af57006641b1 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 22:06:47.995377 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9640c91c-54bd-4204-8379-82bde2d2c673 service neutron] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:48.005070 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9640c91c-54bd-4204-8379-82bde2d2c673 service neutron] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:48.062949 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8187693-4ce5-42be-bd71-a99e02bd21c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:48.063543 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8187693-4ce5-42be-bd71-a99e02bd21c7 admin admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:48.063825 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8187693-4ce5-42be-bd71-a99e02bd21c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:48.064094 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8187693-4ce5-42be-bd71-a99e02bd21c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:48.064779 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8187693-4ce5-42be-bd71-a99e02bd21c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:48.066399 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8187693-4ce5-42be-bd71-a99e02bd21c7 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:48.076621 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1320/2675] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:06:47 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:06:48.080767 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b851e468-3173-4c63-9e05-312d2478a2f8 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:48.091776 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b851e468-3173-4c63-9e05-312d2478a2f8 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:48.096442 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3a25be-52f8-49ba-aa35-973c4a6263f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:48.097136 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3a25be-52f8-49ba-aa35-973c4a6263f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:48.097445 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3a25be-52f8-49ba-aa35-973c4a6263f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:48.097691 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3a25be-52f8-49ba-aa35-973c4a6263f1 admin admin] PATH_INFO: `/v3/projects/a17c1699071646d68b5651a47b641a54/users/02fef3e881d344069a2908997ca28e57/roles/0833202e2a3d47d1b6b3af57006641b1` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:48.100359 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3a25be-52f8-49ba-aa35-973c4a6263f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a17c1699071646d68b5651a47b641a54, user_id=02fef3e881d344069a2908997ca28e57, role_id=0833202e2a3d47d1b6b3af57006641b1)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:48.103173 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3a25be-52f8-49ba-aa35-973c4a6263f1 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:48.113946 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1356/2676] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 18 22:06:48 2022] PUT /identity/v3/projects/a17c1699071646d68b5651a47b641a54/users/02fef3e881d344069a2908997ca28e57/roles/0833202e2a3d47d1b6b3af57006641b1 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:06:48.124702 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfb1bf1-347c-40e4-926f-5a5f338e621e None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:48.125248 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfb1bf1-347c-40e4-926f-5a5f338e621e None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:48.125248 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfb1bf1-347c-40e4-926f-5a5f338e621e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:48.155083 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-0bfb1bf1-347c-40e4-926f-5a5f338e621e None None] MFA Rules not processed for user `02fef3e881d344069a2908997ca28e57`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:06:48.156292 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-0bfb1bf1-347c-40e4-926f-5a5f338e621e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:06:48.229753 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1321/2677] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:06:48 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:06:48.242029 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3a25be-52f8-49ba-aa35-973c4a6263f1 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:48.243780 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-bb3a25be-52f8-49ba-aa35-973c4a6263f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:06:48.304133 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3a25be-52f8-49ba-aa35-973c4a6263f1 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:48.308169 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bb352c-345a-4eb4-a674-746a25031a2a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22b6a7c36f8a4795a75271b8079821c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:48.308878 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bb352c-345a-4eb4-a674-746a25031a2a service cinder] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:48.309165 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bb352c-345a-4eb4-a674-746a25031a2a service cinder] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:48.309438 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bb352c-345a-4eb4-a674-746a25031a2a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:48.311240 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-38bb352c-345a-4eb4-a674-746a25031a2a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:06:48.358319 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfb1bf1-347c-40e4-926f-5a5f338e621e None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:48.359890 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-0bfb1bf1-347c-40e4-926f-5a5f338e621e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:06:48.371767 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bb352c-345a-4eb4-a674-746a25031a2a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:48.373571 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bb352c-345a-4eb4-a674-746a25031a2a service cinder] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:48.384742 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1357/2678] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:06:48 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:06:48.436141 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfb1bf1-347c-40e4-926f-5a5f338e621e None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:48.441807 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac20583-39ed-4293-8f8c-b1bdf27b84eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:48.442536 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac20583-39ed-4293-8f8c-b1bdf27b84eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:48.443240 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac20583-39ed-4293-8f8c-b1bdf27b84eb admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:48.443610 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac20583-39ed-4293-8f8c-b1bdf27b84eb admin admin] PATH_INFO: `/v3/projects/482f862a3dad4d039cb6a0bd3d981819` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:48.445056 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac20583-39ed-4293-8f8c-b1bdf27b84eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=482f862a3dad4d039cb6a0bd3d981819)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:48.447187 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac20583-39ed-4293-8f8c-b1bdf27b84eb admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:48.475955 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:06:48.578701 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-9ac20583-39ed-4293-8f8c-b1bdf27b84eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '482f862a3dad4d039cb6a0bd3d981819', 'request_id': 'req-9ac20583-39ed-4293-8f8c-b1bdf27b84eb'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:48.584773 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-9ac20583-39ed-4293-8f8c-b1bdf27b84eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '482f862a3dad4d039cb6a0bd3d981819', 'request_id': 'req-9ac20583-39ed-4293-8f8c-b1bdf27b84eb'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:48.655852 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-9ac20583-39ed-4293-8f8c-b1bdf27b84eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '482f862a3dad4d039cb6a0bd3d981819', 'request_id': 'req-9ac20583-39ed-4293-8f8c-b1bdf27b84eb'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:48.668052 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-9ac20583-39ed-4293-8f8c-b1bdf27b84eb admin admin] The token cache is being invalidate because project 482f862a3dad4d039cb6a0bd3d981819 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88096) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 22:06:48.668334 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-9ac20583-39ed-4293-8f8c-b1bdf27b84eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:48.668982 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-9ac20583-39ed-4293-8f8c-b1bdf27b84eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:48.670457 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1322/2679] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 18 22:06:48 2022] DELETE /identity/v3/projects/482f862a3dad4d039cb6a0bd3d981819 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 22:06:48.675492 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d342996-7b45-452e-9c7f-1c8618ee91df None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:48.675775 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d342996-7b45-452e-9c7f-1c8618ee91df None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:48.676040 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d342996-7b45-452e-9c7f-1c8618ee91df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:48.695711 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-7d342996-7b45-452e-9c7f-1c8618ee91df None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:06:48.696946 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-7d342996-7b45-452e-9c7f-1c8618ee91df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:06:48.755628 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1358/2680] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:06:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:06:48.763197 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2124513f-2a45-4928-8d8a-733cffc1beed None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:48.763482 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2124513f-2a45-4928-8d8a-733cffc1beed None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:48.763873 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2124513f-2a45-4928-8d8a-733cffc1beed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:48.784496 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-2124513f-2a45-4928-8d8a-733cffc1beed None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:06:48.785751 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-2124513f-2a45-4928-8d8a-733cffc1beed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:06:48.794506 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1323/2681] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:06:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:06:48.799196 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d342996-7b45-452e-9c7f-1c8618ee91df None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:48.809036 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d342996-7b45-452e-9c7f-1c8618ee91df None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:48.813853 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744b5e37-cbac-4ac1-9caf-45c558f9d172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:48.814474 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744b5e37-cbac-4ac1-9caf-45c558f9d172 admin admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:48.814840 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744b5e37-cbac-4ac1-9caf-45c558f9d172 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:48.815112 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744b5e37-cbac-4ac1-9caf-45c558f9d172 admin admin] PATH_INFO: `/v3/domains` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:48.815750 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744b5e37-cbac-4ac1-9caf-45c558f9d172 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 22:06:48.816049 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744b5e37-cbac-4ac1-9caf-45c558f9d172 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:48.817704 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744b5e37-cbac-4ac1-9caf-45c558f9d172 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:48.819167 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:06:48.829599 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1359/2682] 10.222.0.27 () {58 vars in 1153 bytes} [Thu Aug 18 22:06:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 22:06:48.834580 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2124513f-2a45-4928-8d8a-733cffc1beed None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:48.843875 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2124513f-2a45-4928-8d8a-733cffc1beed None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:48.848835 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eb2f0d-bf71-4cc7-92fc-22ef53f484e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:48.850000 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eb2f0d-bf71-4cc7-92fc-22ef53f484e3 admin admin] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:48.850347 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eb2f0d-bf71-4cc7-92fc-22ef53f484e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:48.850617 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eb2f0d-bf71-4cc7-92fc-22ef53f484e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:48.851229 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94eb2f0d-bf71-4cc7-92fc-22ef53f484e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:48.853134 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94eb2f0d-bf71-4cc7-92fc-22ef53f484e3 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:48.985451 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1324/2683] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 18 22:06:48 2022] POST /identity/v3/projects => generated 375 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 22:06:48.989702 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744b5e37-cbac-4ac1-9caf-45c558f9d172 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:48.999973 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744b5e37-cbac-4ac1-9caf-45c558f9d172 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:49.056865 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc426dfc-0267-45df-84cd-08deaf981767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:49.057486 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc426dfc-0267-45df-84cd-08deaf981767 admin admin] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:49.057796 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc426dfc-0267-45df-84cd-08deaf981767 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:49.058075 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc426dfc-0267-45df-84cd-08deaf981767 admin admin] PATH_INFO: `/v3/users` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:49.058714 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc426dfc-0267-45df-84cd-08deaf981767 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:49.060717 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc426dfc-0267-45df-84cd-08deaf981767 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:49.154325 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1360/2684] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 18 22:06:48 2022] POST /identity/v3/users => generated 288 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 22:06:49.158502 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eb2f0d-bf71-4cc7-92fc-22ef53f484e3 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:49.168927 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eb2f0d-bf71-4cc7-92fc-22ef53f484e3 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:49.173457 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cc6db6-81c9-4c72-9dea-f960a1c1bb62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:49.174048 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cc6db6-81c9-4c72-9dea-f960a1c1bb62 admin admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:49.174354 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cc6db6-81c9-4c72-9dea-f960a1c1bb62 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:49.174833 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cc6db6-81c9-4c72-9dea-f960a1c1bb62 admin admin] PATH_INFO: `/v3/roles` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:49.175474 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cc6db6-81c9-4c72-9dea-f960a1c1bb62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:49.177095 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cc6db6-81c9-4c72-9dea-f960a1c1bb62 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:49.187069 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1325/2685] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:06:49 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:06:49.191921 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc426dfc-0267-45df-84cd-08deaf981767 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:49.205228 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc426dfc-0267-45df-84cd-08deaf981767 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:49.210924 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11f0d67-c20d-48e9-9e3f-014a323c3732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:49.211530 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11f0d67-c20d-48e9-9e3f-014a323c3732 admin admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:49.211810 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11f0d67-c20d-48e9-9e3f-014a323c3732 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:49.212084 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11f0d67-c20d-48e9-9e3f-014a323c3732 admin admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:49.212763 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11f0d67-c20d-48e9-9e3f-014a323c3732 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:49.214370 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11f0d67-c20d-48e9-9e3f-014a323c3732 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:49.225592 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1361/2686] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:06:49 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:06:49.229852 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cc6db6-81c9-4c72-9dea-f960a1c1bb62 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:49.240356 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cc6db6-81c9-4c72-9dea-f960a1c1bb62 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:49.245403 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a088df3-9346-4d3a-93fe-e7a9fd608f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:49.249658 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a088df3-9346-4d3a-93fe-e7a9fd608f49 admin admin] REQUEST_METHOD: `PUT` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:49.249658 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a088df3-9346-4d3a-93fe-e7a9fd608f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:49.249658 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a088df3-9346-4d3a-93fe-e7a9fd608f49 admin admin] PATH_INFO: `/v3/projects/d284fac4916b4c2cab5df9d411689275/users/04700e45bfce40a492eb33bd30b96948/roles/de8f2438056f4af9879423f8a59e0e0b` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:49.261806 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a088df3-9346-4d3a-93fe-e7a9fd608f49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d284fac4916b4c2cab5df9d411689275, user_id=04700e45bfce40a492eb33bd30b96948, role_id=de8f2438056f4af9879423f8a59e0e0b)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:49.264795 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a088df3-9346-4d3a-93fe-e7a9fd608f49 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:49.385477 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1326/2687] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 18 22:06:49 2022] PUT /identity/v3/projects/d284fac4916b4c2cab5df9d411689275/users/04700e45bfce40a492eb33bd30b96948/roles/de8f2438056f4af9879423f8a59e0e0b => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:06:49.395721 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b52b107-35ee-4d71-9cc7-96b9f52e2702 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:49.396070 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b52b107-35ee-4d71-9cc7-96b9f52e2702 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:49.396281 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b52b107-35ee-4d71-9cc7-96b9f52e2702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:49.425053 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-0b52b107-35ee-4d71-9cc7-96b9f52e2702 None None] MFA Rules not processed for user `04700e45bfce40a492eb33bd30b96948`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:06:49.426596 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-0b52b107-35ee-4d71-9cc7-96b9f52e2702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:06:49.492111 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1362/2688] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:06:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:06:49.503038 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a088df3-9346-4d3a-93fe-e7a9fd608f49 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:49.504764 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-6a088df3-9346-4d3a-93fe-e7a9fd608f49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:06:49.565069 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a088df3-9346-4d3a-93fe-e7a9fd608f49 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:49.569255 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e21bbe-484a-4c59-8e27-8198550da277 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22b6a7c36f8a4795a75271b8079821c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:49.569847 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e21bbe-484a-4c59-8e27-8198550da277 service cinder] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:49.570120 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e21bbe-484a-4c59-8e27-8198550da277 service cinder] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:49.570377 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e21bbe-484a-4c59-8e27-8198550da277 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:49.578407 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e21bbe-484a-4c59-8e27-8198550da277 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:49.579811 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e21bbe-484a-4c59-8e27-8198550da277 service cinder] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:49.588465 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1327/2689] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:06:49 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 22:06:50.297936 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b52b107-35ee-4d71-9cc7-96b9f52e2702 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:50.299483 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-0b52b107-35ee-4d71-9cc7-96b9f52e2702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:06:50.311784 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b52b107-35ee-4d71-9cc7-96b9f52e2702 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:50.315720 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a239a23-4f41-4b0a-9d54-40bd3599ce0d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22b6a7c36f8a4795a75271b8079821c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:50.318073 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a239a23-4f41-4b0a-9d54-40bd3599ce0d service cinder] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:50.318073 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a239a23-4f41-4b0a-9d54-40bd3599ce0d service cinder] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:50.318073 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a239a23-4f41-4b0a-9d54-40bd3599ce0d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:50.318869 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-3a239a23-4f41-4b0a-9d54-40bd3599ce0d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:06:50.381710 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a239a23-4f41-4b0a-9d54-40bd3599ce0d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:50.383205 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a239a23-4f41-4b0a-9d54-40bd3599ce0d service cinder] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:50.387882 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:06:50.392948 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1363/2690] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:06:50 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:06:52.152528 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e21bbe-484a-4c59-8e27-8198550da277 service cinder] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:52.161730 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e21bbe-484a-4c59-8e27-8198550da277 service cinder] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:52.166054 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086d7ce4-d8f1-498b-8810-71ff68d3ccb0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22b6a7c36f8a4795a75271b8079821c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:52.166657 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086d7ce4-d8f1-498b-8810-71ff68d3ccb0 service cinder] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:52.166939 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086d7ce4-d8f1-498b-8810-71ff68d3ccb0 service cinder] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:52.167509 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086d7ce4-d8f1-498b-8810-71ff68d3ccb0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:52.168994 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-086d7ce4-d8f1-498b-8810-71ff68d3ccb0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:06:52.218625 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=91,keystone:DELETE=6,keystone:INSERT=3 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:06:52.234116 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086d7ce4-d8f1-498b-8810-71ff68d3ccb0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:52.235585 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086d7ce4-d8f1-498b-8810-71ff68d3ccb0 service cinder] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:52.245130 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1328/2691] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:06:52 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 22:06:56.922088 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a239a23-4f41-4b0a-9d54-40bd3599ce0d service cinder] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:56.923701 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-3a239a23-4f41-4b0a-9d54-40bd3599ce0d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:06:56.988923 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a239a23-4f41-4b0a-9d54-40bd3599ce0d service cinder] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:56.993588 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2972a33b-5508-4ede-84fa-0c6edf9746aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:56.994204 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2972a33b-5508-4ede-84fa-0c6edf9746aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:56.994478 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2972a33b-5508-4ede-84fa-0c6edf9746aa admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:56.994747 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2972a33b-5508-4ede-84fa-0c6edf9746aa admin admin] PATH_INFO: `/v3/users/76d13fccbf4d4bd1a9a0755528e692e8` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:56.995847 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2972a33b-5508-4ede-84fa-0c6edf9746aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=76d13fccbf4d4bd1a9a0755528e692e8)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:56.997775 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2972a33b-5508-4ede-84fa-0c6edf9746aa admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:57.176094 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-2972a33b-5508-4ede-84fa-0c6edf9746aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76d13fccbf4d4bd1a9a0755528e692e8'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:57.184474 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-2972a33b-5508-4ede-84fa-0c6edf9746aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76d13fccbf4d4bd1a9a0755528e692e8'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:57.185223 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-2972a33b-5508-4ede-84fa-0c6edf9746aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76d13fccbf4d4bd1a9a0755528e692e8'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:57.197756 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-2972a33b-5508-4ede-84fa-0c6edf9746aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76d13fccbf4d4bd1a9a0755528e692e8'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:57.330125 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-2972a33b-5508-4ede-84fa-0c6edf9746aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76d13fccbf4d4bd1a9a0755528e692e8'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:57.336796 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1364/2692] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 18 22:06:56 2022] DELETE /identity/v3/users/76d13fccbf4d4bd1a9a0755528e692e8 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:06:57.341351 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba73080-3d4d-4d6c-abdd-8bb3b6f109cc None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:57.341816 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba73080-3d4d-4d6c-abdd-8bb3b6f109cc None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:57.341937 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba73080-3d4d-4d6c-abdd-8bb3b6f109cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:57.367308 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-cba73080-3d4d-4d6c-abdd-8bb3b6f109cc None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:06:57.367308 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-cba73080-3d4d-4d6c-abdd-8bb3b6f109cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:06:57.435925 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1329/2693] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:06:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:06:57.445856 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2972a33b-5508-4ede-84fa-0c6edf9746aa admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:57.447367 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-2972a33b-5508-4ede-84fa-0c6edf9746aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:06:57.506018 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2972a33b-5508-4ede-84fa-0c6edf9746aa admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:57.510537 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe5b2b0-3a42-4064-aa2b-a37367bb311e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a937971ad1a4b0c8697c764f214d446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:57.510972 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe5b2b0-3a42-4064-aa2b-a37367bb311e service neutron] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:57.511249 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe5b2b0-3a42-4064-aa2b-a37367bb311e service neutron] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:57.511517 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe5b2b0-3a42-4064-aa2b-a37367bb311e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:57.521307 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe5b2b0-3a42-4064-aa2b-a37367bb311e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:57.523536 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe5b2b0-3a42-4064-aa2b-a37367bb311e service neutron] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:57.533629 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1365/2694] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:06:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:06:57.925332 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba73080-3d4d-4d6c-abdd-8bb3b6f109cc None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:57.929209 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-cba73080-3d4d-4d6c-abdd-8bb3b6f109cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:06:57.939145 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba73080-3d4d-4d6c-abdd-8bb3b6f109cc None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:57.945359 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656c4821-1f6a-4b36-a7bf-e79bff9ba6ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:57.946005 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656c4821-1f6a-4b36-a7bf-e79bff9ba6ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:57.946291 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656c4821-1f6a-4b36-a7bf-e79bff9ba6ab admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:57.946566 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656c4821-1f6a-4b36-a7bf-e79bff9ba6ab admin admin] PATH_INFO: `/v3/projects/5f767492ba1048d9bc2fa0746428d8d0` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:57.947802 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656c4821-1f6a-4b36-a7bf-e79bff9ba6ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f767492ba1048d9bc2fa0746428d8d0)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:57.949749 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656c4821-1f6a-4b36-a7bf-e79bff9ba6ab admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:58.050877 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-656c4821-1f6a-4b36-a7bf-e79bff9ba6ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f767492ba1048d9bc2fa0746428d8d0', 'request_id': 'req-656c4821-1f6a-4b36-a7bf-e79bff9ba6ab'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:58.056738 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-656c4821-1f6a-4b36-a7bf-e79bff9ba6ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f767492ba1048d9bc2fa0746428d8d0', 'request_id': 'req-656c4821-1f6a-4b36-a7bf-e79bff9ba6ab'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:58.123733 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-656c4821-1f6a-4b36-a7bf-e79bff9ba6ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f767492ba1048d9bc2fa0746428d8d0', 'request_id': 'req-656c4821-1f6a-4b36-a7bf-e79bff9ba6ab'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:58.135107 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-656c4821-1f6a-4b36-a7bf-e79bff9ba6ab admin admin] The token cache is being invalidate because project 5f767492ba1048d9bc2fa0746428d8d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88096) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 22:06:58.135459 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-656c4821-1f6a-4b36-a7bf-e79bff9ba6ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:58.136164 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-656c4821-1f6a-4b36-a7bf-e79bff9ba6ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:58.137686 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1330/2695] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 18 22:06:57 2022] DELETE /identity/v3/projects/5f767492ba1048d9bc2fa0746428d8d0 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:06:58.141967 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe5b2b0-3a42-4064-aa2b-a37367bb311e service neutron] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:58.152278 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe5b2b0-3a42-4064-aa2b-a37367bb311e service neutron] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:58.170880 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:06:58.209391 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5c119c-d59c-46c8-a72f-c3ffb481b84f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:58.210017 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5c119c-d59c-46c8-a72f-c3ffb481b84f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:58.210300 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5c119c-d59c-46c8-a72f-c3ffb481b84f admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:58.210574 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5c119c-d59c-46c8-a72f-c3ffb481b84f admin admin] PATH_INFO: `/v3/users/87ceb31dda974e36a24b21939943ab9e` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:58.212583 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5c119c-d59c-46c8-a72f-c3ffb481b84f admin admin] RBAC: Authorizing `identity:delete_user(user_id=87ceb31dda974e36a24b21939943ab9e)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:58.214645 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5c119c-d59c-46c8-a72f-c3ffb481b84f admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:58.373606 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-4b5c119c-d59c-46c8-a72f-c3ffb481b84f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87ceb31dda974e36a24b21939943ab9e'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:58.380539 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-4b5c119c-d59c-46c8-a72f-c3ffb481b84f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87ceb31dda974e36a24b21939943ab9e'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:58.381226 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-4b5c119c-d59c-46c8-a72f-c3ffb481b84f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87ceb31dda974e36a24b21939943ab9e'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:58.394081 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-4b5c119c-d59c-46c8-a72f-c3ffb481b84f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87ceb31dda974e36a24b21939943ab9e'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:58.466862 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-4b5c119c-d59c-46c8-a72f-c3ffb481b84f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87ceb31dda974e36a24b21939943ab9e'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:58.474851 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1366/2696] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 18 22:06:58 2022] DELETE /identity/v3/users/87ceb31dda974e36a24b21939943ab9e => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:06:58.900924 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656c4821-1f6a-4b36-a7bf-e79bff9ba6ab admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:58.902433 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-656c4821-1f6a-4b36-a7bf-e79bff9ba6ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:06:58.916382 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656c4821-1f6a-4b36-a7bf-e79bff9ba6ab admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:58.974756 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ce128c-a903-4415-9f95-5a2e59bf190e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:58.975632 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ce128c-a903-4415-9f95-5a2e59bf190e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:58.975916 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ce128c-a903-4415-9f95-5a2e59bf190e admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:58.976186 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ce128c-a903-4415-9f95-5a2e59bf190e admin admin] PATH_INFO: `/v3/projects/382421fd24784faf9e06c84c89ebfd16` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:58.977363 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ce128c-a903-4415-9f95-5a2e59bf190e admin admin] RBAC: Authorizing `identity:delete_project(project_id=382421fd24784faf9e06c84c89ebfd16)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:58.979313 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ce128c-a903-4415-9f95-5a2e59bf190e admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:58.989864 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:06:59.115811 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-f8ce128c-a903-4415-9f95-5a2e59bf190e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '382421fd24784faf9e06c84c89ebfd16', 'request_id': 'req-f8ce128c-a903-4415-9f95-5a2e59bf190e'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:59.121205 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-f8ce128c-a903-4415-9f95-5a2e59bf190e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '382421fd24784faf9e06c84c89ebfd16', 'request_id': 'req-f8ce128c-a903-4415-9f95-5a2e59bf190e'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:59.210252 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-f8ce128c-a903-4415-9f95-5a2e59bf190e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '382421fd24784faf9e06c84c89ebfd16', 'request_id': 'req-f8ce128c-a903-4415-9f95-5a2e59bf190e'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:59.223171 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-f8ce128c-a903-4415-9f95-5a2e59bf190e admin admin] The token cache is being invalidate because project 382421fd24784faf9e06c84c89ebfd16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88096) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 22:06:59.223461 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-f8ce128c-a903-4415-9f95-5a2e59bf190e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:59.224105 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-f8ce128c-a903-4415-9f95-5a2e59bf190e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:59.225621 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1331/2697] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 18 22:06:58 2022] DELETE /identity/v3/projects/382421fd24784faf9e06c84c89ebfd16 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:06:59.229858 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5c119c-d59c-46c8-a72f-c3ffb481b84f admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:06:59.231244 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-4b5c119c-d59c-46c8-a72f-c3ffb481b84f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:06:59.243994 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5c119c-d59c-46c8-a72f-c3ffb481b84f admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:06:59.302972 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50689f50-1621-4af2-a8bb-87c90ba8d070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:06:59.308885 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50689f50-1621-4af2-a8bb-87c90ba8d070 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:06:59.308885 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50689f50-1621-4af2-a8bb-87c90ba8d070 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:06:59.308885 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50689f50-1621-4af2-a8bb-87c90ba8d070 admin admin] PATH_INFO: `/v3/users/02fef3e881d344069a2908997ca28e57` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:06:59.308885 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50689f50-1621-4af2-a8bb-87c90ba8d070 admin admin] RBAC: Authorizing `identity:delete_user(user_id=02fef3e881d344069a2908997ca28e57)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:06:59.308885 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50689f50-1621-4af2-a8bb-87c90ba8d070 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:06:59.530266 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:06:59.532716 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-50689f50-1621-4af2-a8bb-87c90ba8d070 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02fef3e881d344069a2908997ca28e57'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:59.540425 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-50689f50-1621-4af2-a8bb-87c90ba8d070 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02fef3e881d344069a2908997ca28e57'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:59.541158 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-50689f50-1621-4af2-a8bb-87c90ba8d070 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02fef3e881d344069a2908997ca28e57'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:59.552612 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-50689f50-1621-4af2-a8bb-87c90ba8d070 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02fef3e881d344069a2908997ca28e57'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:59.650508 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-50689f50-1621-4af2-a8bb-87c90ba8d070 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02fef3e881d344069a2908997ca28e57'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:06:59.656781 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1367/2698] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 18 22:06:59 2022] DELETE /identity/v3/users/02fef3e881d344069a2908997ca28e57 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 22:07:00.143667 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ce128c-a903-4415-9f95-5a2e59bf190e admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:07:00.145243 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-f8ce128c-a903-4415-9f95-5a2e59bf190e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:07:00.158415 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ce128c-a903-4415-9f95-5a2e59bf190e admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:07:00.219108 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fce1ea3-8b06-447f-ad09-8d7fbb490881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:07:00.219741 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fce1ea3-8b06-447f-ad09-8d7fbb490881 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:07:00.220018 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fce1ea3-8b06-447f-ad09-8d7fbb490881 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:07:00.220362 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fce1ea3-8b06-447f-ad09-8d7fbb490881 admin admin] PATH_INFO: `/v3/projects/a17c1699071646d68b5651a47b641a54` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:07:00.221535 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fce1ea3-8b06-447f-ad09-8d7fbb490881 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a17c1699071646d68b5651a47b641a54)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:07:00.223444 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fce1ea3-8b06-447f-ad09-8d7fbb490881 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:07:00.364058 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-9fce1ea3-8b06-447f-ad09-8d7fbb490881 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a17c1699071646d68b5651a47b641a54', 'request_id': 'req-9fce1ea3-8b06-447f-ad09-8d7fbb490881'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:07:00.370648 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-9fce1ea3-8b06-447f-ad09-8d7fbb490881 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a17c1699071646d68b5651a47b641a54', 'request_id': 'req-9fce1ea3-8b06-447f-ad09-8d7fbb490881'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:07:00.438294 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-9fce1ea3-8b06-447f-ad09-8d7fbb490881 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a17c1699071646d68b5651a47b641a54', 'request_id': 'req-9fce1ea3-8b06-447f-ad09-8d7fbb490881'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:07:00.450355 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-9fce1ea3-8b06-447f-ad09-8d7fbb490881 admin admin] The token cache is being invalidate because project a17c1699071646d68b5651a47b641a54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88096) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 22:07:00.450648 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-9fce1ea3-8b06-447f-ad09-8d7fbb490881 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:07:00.451279 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-9fce1ea3-8b06-447f-ad09-8d7fbb490881 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:07:00.452834 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1332/2699] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 18 22:07:00 2022] DELETE /identity/v3/projects/a17c1699071646d68b5651a47b641a54 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:07:00.457861 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d23b1a3-917c-4e82-8b2c-81868100391e None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:07:00.460079 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d23b1a3-917c-4e82-8b2c-81868100391e None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:07:00.460079 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d23b1a3-917c-4e82-8b2c-81868100391e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:07:00.478251 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-2d23b1a3-917c-4e82-8b2c-81868100391e None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:07:00.479461 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-2d23b1a3-917c-4e82-8b2c-81868100391e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:07:00.540254 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1368/2700] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:07:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:07:00.549495 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8566a25e-fe72-41c2-9738-fe7a8fd5241e None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:07:00.549713 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8566a25e-fe72-41c2-9738-fe7a8fd5241e None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:07:00.549982 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8566a25e-fe72-41c2-9738-fe7a8fd5241e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:07:00.569461 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-8566a25e-fe72-41c2-9738-fe7a8fd5241e None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:07:00.571404 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-8566a25e-fe72-41c2-9738-fe7a8fd5241e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:07:00.579337 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1333/2701] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:07:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:07:00.583590 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d23b1a3-917c-4e82-8b2c-81868100391e None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:07:00.594344 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d23b1a3-917c-4e82-8b2c-81868100391e None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:07:00.599071 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdee547-fe5e-4bb1-8f7b-b2f8cc4b7d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:07:00.599663 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdee547-fe5e-4bb1-8f7b-b2f8cc4b7d2c admin admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:07:00.599936 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdee547-fe5e-4bb1-8f7b-b2f8cc4b7d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:07:00.600204 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdee547-fe5e-4bb1-8f7b-b2f8cc4b7d2c admin admin] PATH_INFO: `/v3/domains` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:07:00.600866 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdee547-fe5e-4bb1-8f7b-b2f8cc4b7d2c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 22:07:00.601168 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdee547-fe5e-4bb1-8f7b-b2f8cc4b7d2c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:07:00.603507 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdee547-fe5e-4bb1-8f7b-b2f8cc4b7d2c admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:07:00.614781 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1369/2702] 10.222.0.27 () {58 vars in 1153 bytes} [Thu Aug 18 22:07:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 22:07:00.619865 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8566a25e-fe72-41c2-9738-fe7a8fd5241e None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:07:00.629244 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8566a25e-fe72-41c2-9738-fe7a8fd5241e None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:07:00.634137 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaa77fd-a4a9-4e9f-b73b-309e02918408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:07:00.634729 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaa77fd-a4a9-4e9f-b73b-309e02918408 admin admin] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:07:00.635008 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaa77fd-a4a9-4e9f-b73b-309e02918408 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:07:00.635279 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaa77fd-a4a9-4e9f-b73b-309e02918408 admin admin] PATH_INFO: `/v3/projects` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:07:00.635910 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaa77fd-a4a9-4e9f-b73b-309e02918408 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:07:00.637828 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaa77fd-a4a9-4e9f-b73b-309e02918408 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:07:00.708542 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:07:00.715750 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1334/2703] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 18 22:07:00 2022] POST /identity/v3/projects => generated 369 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 22:07:00.720011 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdee547-fe5e-4bb1-8f7b-b2f8cc4b7d2c admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:07:00.730997 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdee547-fe5e-4bb1-8f7b-b2f8cc4b7d2c admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:07:00.786142 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5caaf9d-ab82-4c35-b2ba-595523a76354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:07:00.786743 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5caaf9d-ab82-4c35-b2ba-595523a76354 admin admin] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:07:00.787029 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5caaf9d-ab82-4c35-b2ba-595523a76354 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:07:00.787307 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5caaf9d-ab82-4c35-b2ba-595523a76354 admin admin] PATH_INFO: `/v3/users` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:07:00.787943 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5caaf9d-ab82-4c35-b2ba-595523a76354 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:07:00.790413 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5caaf9d-ab82-4c35-b2ba-595523a76354 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:07:00.860944 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1370/2704] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 18 22:07:00 2022] POST /identity/v3/users => generated 285 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 22:07:00.865071 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaa77fd-a4a9-4e9f-b73b-309e02918408 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:07:00.875323 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaa77fd-a4a9-4e9f-b73b-309e02918408 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:07:00.880433 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485a2427-e752-4069-bbb2-f42f7043a905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:07:00.881059 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485a2427-e752-4069-bbb2-f42f7043a905 admin admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:07:00.881332 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485a2427-e752-4069-bbb2-f42f7043a905 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:07:00.890118 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485a2427-e752-4069-bbb2-f42f7043a905 admin admin] PATH_INFO: `/v3/roles` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:07:00.890118 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485a2427-e752-4069-bbb2-f42f7043a905 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:07:00.890118 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485a2427-e752-4069-bbb2-f42f7043a905 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:07:00.894402 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1335/2705] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:07:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:07:00.898341 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5caaf9d-ab82-4c35-b2ba-595523a76354 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:07:00.909103 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5caaf9d-ab82-4c35-b2ba-595523a76354 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:07:00.913705 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4096ba82-d4aa-42de-9939-172d3b3eaeab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:07:00.914379 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4096ba82-d4aa-42de-9939-172d3b3eaeab admin admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:07:00.915249 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4096ba82-d4aa-42de-9939-172d3b3eaeab admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:07:00.915614 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4096ba82-d4aa-42de-9939-172d3b3eaeab admin admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:07:00.916170 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4096ba82-d4aa-42de-9939-172d3b3eaeab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:07:00.917790 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4096ba82-d4aa-42de-9939-172d3b3eaeab admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:07:00.928176 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1371/2706] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:07:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:07:00.932255 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485a2427-e752-4069-bbb2-f42f7043a905 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:07:00.942387 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485a2427-e752-4069-bbb2-f42f7043a905 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:07:00.947199 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825dd4b8-954a-4241-93f2-741c0e3a065c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:07:00.947837 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825dd4b8-954a-4241-93f2-741c0e3a065c admin admin] REQUEST_METHOD: `PUT` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:07:00.948117 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825dd4b8-954a-4241-93f2-741c0e3a065c admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:07:00.948386 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825dd4b8-954a-4241-93f2-741c0e3a065c admin admin] PATH_INFO: `/v3/projects/dca3f1c20875401bbfb786739631a468/users/e32301c6b74f4cc6a1dd1c2a7cef4391/roles/de8f2438056f4af9879423f8a59e0e0b` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:07:00.962969 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825dd4b8-954a-4241-93f2-741c0e3a065c admin admin] RBAC: Authorizing `identity:create_grant(project_id=dca3f1c20875401bbfb786739631a468, user_id=e32301c6b74f4cc6a1dd1c2a7cef4391, role_id=de8f2438056f4af9879423f8a59e0e0b)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:07:00.965609 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825dd4b8-954a-4241-93f2-741c0e3a065c admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:07:01.061827 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1336/2707] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 18 22:07:00 2022] PUT /identity/v3/projects/dca3f1c20875401bbfb786739631a468/users/e32301c6b74f4cc6a1dd1c2a7cef4391/roles/de8f2438056f4af9879423f8a59e0e0b => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 22:07:01.073411 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e21a557-b63e-46ee-9a70-4e1bd66d3864 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:07:01.073702 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e21a557-b63e-46ee-9a70-4e1bd66d3864 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:07:01.074194 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e21a557-b63e-46ee-9a70-4e1bd66d3864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:07:01.075038 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825dd4b8-954a-4241-93f2-741c0e3a065c admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:07:01.076788 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-825dd4b8-954a-4241-93f2-741c0e3a065c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:07:01.105446 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-2e21a557-b63e-46ee-9a70-4e1bd66d3864 None None] MFA Rules not processed for user `e32301c6b74f4cc6a1dd1c2a7cef4391`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:07:01.106739 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-2e21a557-b63e-46ee-9a70-4e1bd66d3864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:07:01.119933 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:07:01.142342 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825dd4b8-954a-4241-93f2-741c0e3a065c admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:07:01.147139 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6218f1d0-539b-4920-98d7-f18b7ccaa8ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:07:01.147848 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6218f1d0-539b-4920-98d7-f18b7ccaa8ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:07:01.148215 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6218f1d0-539b-4920-98d7-f18b7ccaa8ee admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:07:01.148635 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6218f1d0-539b-4920-98d7-f18b7ccaa8ee admin admin] PATH_INFO: `/v3/users/04700e45bfce40a492eb33bd30b96948` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:07:01.150372 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6218f1d0-539b-4920-98d7-f18b7ccaa8ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=04700e45bfce40a492eb33bd30b96948)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:07:01.152371 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6218f1d0-539b-4920-98d7-f18b7ccaa8ee admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:07:01.178036 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1372/2708] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:07:01 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:07:01.185843 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e21a557-b63e-46ee-9a70-4e1bd66d3864 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:07:01.187205 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-2e21a557-b63e-46ee-9a70-4e1bd66d3864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:07:01.241622 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e21a557-b63e-46ee-9a70-4e1bd66d3864 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:07:01.245476 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd02b003-3055-4fa3-92e0-12eccfa7492c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85dfef6a910547da9706d294e7d40fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:07:01.246073 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd02b003-3055-4fa3-92e0-12eccfa7492c service glance] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:07:01.246350 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd02b003-3055-4fa3-92e0-12eccfa7492c service glance] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:07:01.246620 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd02b003-3055-4fa3-92e0-12eccfa7492c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:07:01.255088 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd02b003-3055-4fa3-92e0-12eccfa7492c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:07:01.259777 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd02b003-3055-4fa3-92e0-12eccfa7492c service glance] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:07:01.267136 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1373/2709] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:07:01 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 22:07:01.372759 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-6218f1d0-539b-4920-98d7-f18b7ccaa8ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04700e45bfce40a492eb33bd30b96948'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:07:01.379783 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-6218f1d0-539b-4920-98d7-f18b7ccaa8ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04700e45bfce40a492eb33bd30b96948'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:07:01.380471 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-6218f1d0-539b-4920-98d7-f18b7ccaa8ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04700e45bfce40a492eb33bd30b96948'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:07:01.381116 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-6218f1d0-539b-4920-98d7-f18b7ccaa8ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04700e45bfce40a492eb33bd30b96948'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:07:01.395227 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-6218f1d0-539b-4920-98d7-f18b7ccaa8ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04700e45bfce40a492eb33bd30b96948'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:07:01.479895 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1337/2710] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 18 22:07:01 2022] DELETE /identity/v3/users/04700e45bfce40a492eb33bd30b96948 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 22:07:01.484495 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ad7abb-2354-4adb-a64c-43f010e65581 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:07:01.484999 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ad7abb-2354-4adb-a64c-43f010e65581 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:07:01.485104 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ad7abb-2354-4adb-a64c-43f010e65581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:07:01.504549 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-12ad7abb-2354-4adb-a64c-43f010e65581 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:07:01.505804 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-12ad7abb-2354-4adb-a64c-43f010e65581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:07:01.568057 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1374/2711] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:07:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:07:01.578619 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6218f1d0-539b-4920-98d7-f18b7ccaa8ee admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:07:01.580056 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-6218f1d0-539b-4920-98d7-f18b7ccaa8ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:07:01.625673 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:07:01.636710 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6218f1d0-539b-4920-98d7-f18b7ccaa8ee admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:07:01.640538 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c66f9cc-1af6-42b5-8866-cb9e47a10017 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a937971ad1a4b0c8697c764f214d446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:07:01.641171 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c66f9cc-1af6-42b5-8866-cb9e47a10017 service neutron] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:07:01.641449 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c66f9cc-1af6-42b5-8866-cb9e47a10017 service neutron] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:07:01.641719 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c66f9cc-1af6-42b5-8866-cb9e47a10017 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:07:01.651355 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c66f9cc-1af6-42b5-8866-cb9e47a10017 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:07:01.653207 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c66f9cc-1af6-42b5-8866-cb9e47a10017 service neutron] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:07:01.663750 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1338/2712] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:07:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:07:02.063920 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ad7abb-2354-4adb-a64c-43f010e65581 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:07:02.065420 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-12ad7abb-2354-4adb-a64c-43f010e65581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:07:02.088108 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ad7abb-2354-4adb-a64c-43f010e65581 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:07:02.106659 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9cca61-26d5-4ea5-8937-46a256b22600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:07:02.107298 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9cca61-26d5-4ea5-8937-46a256b22600 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:07:02.108825 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9cca61-26d5-4ea5-8937-46a256b22600 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:07:02.108825 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9cca61-26d5-4ea5-8937-46a256b22600 admin admin] PATH_INFO: `/v3/projects/d284fac4916b4c2cab5df9d411689275` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:07:02.109188 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9cca61-26d5-4ea5-8937-46a256b22600 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d284fac4916b4c2cab5df9d411689275)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:07:02.111158 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9cca61-26d5-4ea5-8937-46a256b22600 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:07:02.213673 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-8b9cca61-26d5-4ea5-8937-46a256b22600 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd284fac4916b4c2cab5df9d411689275', 'request_id': 'req-8b9cca61-26d5-4ea5-8937-46a256b22600'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:07:02.217556 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:07:02.221563 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-8b9cca61-26d5-4ea5-8937-46a256b22600 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd284fac4916b4c2cab5df9d411689275', 'request_id': 'req-8b9cca61-26d5-4ea5-8937-46a256b22600'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:07:02.322104 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-8b9cca61-26d5-4ea5-8937-46a256b22600 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd284fac4916b4c2cab5df9d411689275', 'request_id': 'req-8b9cca61-26d5-4ea5-8937-46a256b22600'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:07:02.334079 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-8b9cca61-26d5-4ea5-8937-46a256b22600 admin admin] The token cache is being invalidate because project d284fac4916b4c2cab5df9d411689275 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88097) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 22:07:02.334370 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-8b9cca61-26d5-4ea5-8937-46a256b22600 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:07:02.335017 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-8b9cca61-26d5-4ea5-8937-46a256b22600 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:07:02.337163 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1375/2713] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 18 22:07:02 2022] DELETE /identity/v3/projects/d284fac4916b4c2cab5df9d411689275 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:07:11.958566 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=6 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:07:12.350256 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:DELETE=2,keystone:SELECT=5,keystone:INSERT=1 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:07:12.904500 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c66f9cc-1af6-42b5-8866-cb9e47a10017 service neutron] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:07:12.913252 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c66f9cc-1af6-42b5-8866-cb9e47a10017 service neutron] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:07:12.962946 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389884eb-5e46-492b-8413-9e1bb7b79a4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a937971ad1a4b0c8697c764f214d446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:07:12.963613 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389884eb-5e46-492b-8413-9e1bb7b79a4c service neutron] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:07:12.963876 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389884eb-5e46-492b-8413-9e1bb7b79a4c service neutron] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:07:12.964167 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389884eb-5e46-492b-8413-9e1bb7b79a4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:07:12.966150 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-389884eb-5e46-492b-8413-9e1bb7b79a4c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:07:13.031136 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389884eb-5e46-492b-8413-9e1bb7b79a4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:07:13.032622 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389884eb-5e46-492b-8413-9e1bb7b79a4c service neutron] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:07:13.042350 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1339/2714] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:07:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 22:07:16.676934 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9cca61-26d5-4ea5-8937-46a256b22600 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:07:16.678441 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-8b9cca61-26d5-4ea5-8937-46a256b22600 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:07:16.692661 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9cca61-26d5-4ea5-8937-46a256b22600 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:07:16.697463 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dccd03-e5b2-4acf-ac13-a11bd965a6a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:07:16.698094 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dccd03-e5b2-4acf-ac13-a11bd965a6a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:07:16.698372 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dccd03-e5b2-4acf-ac13-a11bd965a6a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:07:16.698644 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dccd03-e5b2-4acf-ac13-a11bd965a6a4 admin admin] PATH_INFO: `/v3/users/9c13345ad7e8464fa2f06e013d0ad058` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:07:16.699848 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dccd03-e5b2-4acf-ac13-a11bd965a6a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c13345ad7e8464fa2f06e013d0ad058)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:07:16.702480 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dccd03-e5b2-4acf-ac13-a11bd965a6a4 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:07:16.893463 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-d6dccd03-e5b2-4acf-ac13-a11bd965a6a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c13345ad7e8464fa2f06e013d0ad058'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:07:16.900209 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-d6dccd03-e5b2-4acf-ac13-a11bd965a6a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c13345ad7e8464fa2f06e013d0ad058'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:07:16.900926 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-d6dccd03-e5b2-4acf-ac13-a11bd965a6a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c13345ad7e8464fa2f06e013d0ad058'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:07:16.913073 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-d6dccd03-e5b2-4acf-ac13-a11bd965a6a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c13345ad7e8464fa2f06e013d0ad058'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:07:16.977804 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-d6dccd03-e5b2-4acf-ac13-a11bd965a6a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c13345ad7e8464fa2f06e013d0ad058'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:07:16.983955 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1376/2715] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 18 22:07:16 2022] DELETE /identity/v3/users/9c13345ad7e8464fa2f06e013d0ad058 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:07:17.220585 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389884eb-5e46-492b-8413-9e1bb7b79a4c service neutron] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:07:17.239572 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389884eb-5e46-492b-8413-9e1bb7b79a4c service neutron] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:07:17.333504 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e59841-588c-46dd-9160-1be842f580d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:07:17.336090 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e59841-588c-46dd-9160-1be842f580d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:07:17.336090 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e59841-588c-46dd-9160-1be842f580d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:07:17.336090 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e59841-588c-46dd-9160-1be842f580d2 admin admin] PATH_INFO: `/v3/projects/00fd9271d45d48919e5a0f203cb2dffa` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:07:17.336090 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e59841-588c-46dd-9160-1be842f580d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=00fd9271d45d48919e5a0f203cb2dffa)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:07:17.337939 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e59841-588c-46dd-9160-1be842f580d2 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:07:17.456466 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-65e59841-588c-46dd-9160-1be842f580d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00fd9271d45d48919e5a0f203cb2dffa', 'request_id': 'req-65e59841-588c-46dd-9160-1be842f580d2'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:07:17.458465 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:07:17.462168 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-65e59841-588c-46dd-9160-1be842f580d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00fd9271d45d48919e5a0f203cb2dffa', 'request_id': 'req-65e59841-588c-46dd-9160-1be842f580d2'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:07:17.563920 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-65e59841-588c-46dd-9160-1be842f580d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00fd9271d45d48919e5a0f203cb2dffa', 'request_id': 'req-65e59841-588c-46dd-9160-1be842f580d2'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:07:17.577779 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-65e59841-588c-46dd-9160-1be842f580d2 admin admin] The token cache is being invalidate because project 00fd9271d45d48919e5a0f203cb2dffa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88096) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 22:07:17.578093 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-65e59841-588c-46dd-9160-1be842f580d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:07:17.578751 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-65e59841-588c-46dd-9160-1be842f580d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:07:17.580476 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1340/2716] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 18 22:07:17 2022] DELETE /identity/v3/projects/00fd9271d45d48919e5a0f203cb2dffa => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:07:17.585542 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1173695-a1a6-4fe8-a34b-af966c109034 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:07:17.585900 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1173695-a1a6-4fe8-a34b-af966c109034 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:07:17.586246 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1173695-a1a6-4fe8-a34b-af966c109034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:07:17.606985 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-e1173695-a1a6-4fe8-a34b-af966c109034 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:07:17.608241 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-e1173695-a1a6-4fe8-a34b-af966c109034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:07:17.670155 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1377/2717] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:07:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:07:17.677922 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2208133b-5457-4031-a777-053b4a893f4b None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:07:17.679574 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2208133b-5457-4031-a777-053b4a893f4b None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:07:17.679574 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2208133b-5457-4031-a777-053b4a893f4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:07:17.698685 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-2208133b-5457-4031-a777-053b4a893f4b None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:07:17.700726 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-2208133b-5457-4031-a777-053b4a893f4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:07:17.708891 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1341/2718] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:07:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:07:17.713265 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1173695-a1a6-4fe8-a34b-af966c109034 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:07:17.723550 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1173695-a1a6-4fe8-a34b-af966c109034 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:07:17.728180 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16e0844-9c57-4339-8cad-ede641d8ddbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:07:17.728811 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16e0844-9c57-4339-8cad-ede641d8ddbb admin admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:07:17.729095 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16e0844-9c57-4339-8cad-ede641d8ddbb admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:07:17.729370 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16e0844-9c57-4339-8cad-ede641d8ddbb admin admin] PATH_INFO: `/v3/domains` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:07:17.730040 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16e0844-9c57-4339-8cad-ede641d8ddbb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 22:07:17.730346 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16e0844-9c57-4339-8cad-ede641d8ddbb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:07:17.732285 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16e0844-9c57-4339-8cad-ede641d8ddbb admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:07:17.744009 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1378/2719] 10.222.0.27 () {58 vars in 1153 bytes} [Thu Aug 18 22:07:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 22:07:17.748945 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2208133b-5457-4031-a777-053b4a893f4b None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:07:17.758149 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2208133b-5457-4031-a777-053b4a893f4b None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:07:17.764971 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b324de7-b4f7-47ba-860f-5460165464e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:07:17.764971 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b324de7-b4f7-47ba-860f-5460165464e6 admin admin] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:07:17.765164 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b324de7-b4f7-47ba-860f-5460165464e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:07:17.765353 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b324de7-b4f7-47ba-860f-5460165464e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:07:17.765926 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b324de7-b4f7-47ba-860f-5460165464e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:07:17.767838 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b324de7-b4f7-47ba-860f-5460165464e6 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:07:17.894469 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1342/2720] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 18 22:07:17 2022] POST /identity/v3/projects => generated 385 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 22:07:17.898740 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16e0844-9c57-4339-8cad-ede641d8ddbb admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:07:17.909199 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16e0844-9c57-4339-8cad-ede641d8ddbb admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:07:17.970291 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8729e3d-6055-4ce2-b59b-1b820b885535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:07:17.970998 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8729e3d-6055-4ce2-b59b-1b820b885535 admin admin] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:07:17.971278 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8729e3d-6055-4ce2-b59b-1b820b885535 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:07:17.971550 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8729e3d-6055-4ce2-b59b-1b820b885535 admin admin] PATH_INFO: `/v3/users` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:07:17.972165 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8729e3d-6055-4ce2-b59b-1b820b885535 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:07:17.974092 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8729e3d-6055-4ce2-b59b-1b820b885535 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:07:17.982879 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:07:18.075561 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1379/2721] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 18 22:07:17 2022] POST /identity/v3/users => generated 293 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 22:07:18.079941 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b324de7-b4f7-47ba-860f-5460165464e6 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:07:18.090587 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b324de7-b4f7-47ba-860f-5460165464e6 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:07:18.095569 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1806f70a-2f89-4e43-a562-0445b1534a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:07:18.096167 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1806f70a-2f89-4e43-a562-0445b1534a8c admin admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:07:18.096777 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1806f70a-2f89-4e43-a562-0445b1534a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:07:18.097054 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1806f70a-2f89-4e43-a562-0445b1534a8c admin admin] PATH_INFO: `/v3/roles` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:07:18.097693 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1806f70a-2f89-4e43-a562-0445b1534a8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:07:18.099310 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1806f70a-2f89-4e43-a562-0445b1534a8c admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:07:18.110058 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1343/2722] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:07:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:07:18.114106 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8729e3d-6055-4ce2-b59b-1b820b885535 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:07:18.124070 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8729e3d-6055-4ce2-b59b-1b820b885535 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:07:18.129201 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186e5d66-fff7-4a36-87b6-4c7bbcaa9a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:07:18.129900 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186e5d66-fff7-4a36-87b6-4c7bbcaa9a8e admin admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:07:18.130254 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186e5d66-fff7-4a36-87b6-4c7bbcaa9a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:07:18.130603 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186e5d66-fff7-4a36-87b6-4c7bbcaa9a8e admin admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:07:18.131312 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186e5d66-fff7-4a36-87b6-4c7bbcaa9a8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:07:18.133115 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186e5d66-fff7-4a36-87b6-4c7bbcaa9a8e admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:07:18.146554 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1380/2723] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:07:18 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:07:18.150893 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1806f70a-2f89-4e43-a562-0445b1534a8c admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:07:18.161880 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1806f70a-2f89-4e43-a562-0445b1534a8c admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:07:18.166751 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc6d626-68d4-415c-97f2-e1b81b3350d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:07:18.167423 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc6d626-68d4-415c-97f2-e1b81b3350d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:07:18.167701 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc6d626-68d4-415c-97f2-e1b81b3350d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:07:18.167968 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc6d626-68d4-415c-97f2-e1b81b3350d6 admin admin] PATH_INFO: `/v3/projects/fd8bb9f3880744b2a9e80426e1f6ef3b/users/57a63003de8c4bc89bfcc0288172e4fc/roles/de8f2438056f4af9879423f8a59e0e0b` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:07:18.182435 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc6d626-68d4-415c-97f2-e1b81b3350d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd8bb9f3880744b2a9e80426e1f6ef3b, user_id=57a63003de8c4bc89bfcc0288172e4fc, role_id=de8f2438056f4af9879423f8a59e0e0b)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:07:18.187656 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc6d626-68d4-415c-97f2-e1b81b3350d6 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:07:18.260678 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1344/2724] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 18 22:07:18 2022] PUT /identity/v3/projects/fd8bb9f3880744b2a9e80426e1f6ef3b/users/57a63003de8c4bc89bfcc0288172e4fc/roles/de8f2438056f4af9879423f8a59e0e0b => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:07:18.266803 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1dfee0-54af-4cb6-8128-792af95c906c None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:07:18.267279 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1dfee0-54af-4cb6-8128-792af95c906c None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:07:18.267693 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1dfee0-54af-4cb6-8128-792af95c906c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:07:18.287553 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-4d1dfee0-54af-4cb6-8128-792af95c906c None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:07:18.288726 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-4d1dfee0-54af-4cb6-8128-792af95c906c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:07:18.350442 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1381/2725] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:07:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:07:18.360148 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc6d626-68d4-415c-97f2-e1b81b3350d6 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:07:18.361945 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-7cc6d626-68d4-415c-97f2-e1b81b3350d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:07:18.417895 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc6d626-68d4-415c-97f2-e1b81b3350d6 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:07:18.421685 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3070e3-9fe5-420d-82c5-cbff66310b5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a937971ad1a4b0c8697c764f214d446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:07:18.422291 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3070e3-9fe5-420d-82c5-cbff66310b5b service neutron] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:07:18.422568 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3070e3-9fe5-420d-82c5-cbff66310b5b service neutron] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:07:18.422837 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3070e3-9fe5-420d-82c5-cbff66310b5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:07:18.431641 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3070e3-9fe5-420d-82c5-cbff66310b5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:07:18.433133 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3070e3-9fe5-420d-82c5-cbff66310b5b service neutron] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:07:18.443775 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1345/2726] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:07:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:07:23.983649 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d0a2df-0540-4a16-8df7-9ce7a6ccde01 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:07:23.984143 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d0a2df-0540-4a16-8df7-9ce7a6ccde01 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:07:23.984239 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d0a2df-0540-4a16-8df7-9ce7a6ccde01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:07:24.017026 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-b4d0a2df-0540-4a16-8df7-9ce7a6ccde01 None None] MFA Rules not processed for user `57a63003de8c4bc89bfcc0288172e4fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:07:24.018078 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-b4d0a2df-0540-4a16-8df7-9ce7a6ccde01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:07:24.102826 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1382/2727] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:07:23 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:07:24.119685 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3070e3-9fe5-420d-82c5-cbff66310b5b service neutron] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:07:24.121251 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-be3070e3-9fe5-420d-82c5-cbff66310b5b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:07:24.202090 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3070e3-9fe5-420d-82c5-cbff66310b5b service neutron] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:07:24.207760 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531026b4-5743-41f2-9fa2-5a82c04dce6d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a39cd50340184779ac589bbcb7cac9aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:07:24.208373 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531026b4-5743-41f2-9fa2-5a82c04dce6d service nova] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:07:24.208680 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531026b4-5743-41f2-9fa2-5a82c04dce6d service nova] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:07:24.208960 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531026b4-5743-41f2-9fa2-5a82c04dce6d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:07:24.218683 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531026b4-5743-41f2-9fa2-5a82c04dce6d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:07:24.221568 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531026b4-5743-41f2-9fa2-5a82c04dce6d service nova] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:07:24.230595 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1346/2728] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:07:24 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:07:25.798275 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d0a2df-0540-4a16-8df7-9ce7a6ccde01 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:07:25.800086 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-b4d0a2df-0540-4a16-8df7-9ce7a6ccde01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:07:25.819915 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d0a2df-0540-4a16-8df7-9ce7a6ccde01 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:07:25.827112 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046b798b-2fee-4008-b73d-b3173186cc13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:07:25.827759 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046b798b-2fee-4008-b73d-b3173186cc13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:07:25.828066 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046b798b-2fee-4008-b73d-b3173186cc13 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:07:25.828582 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046b798b-2fee-4008-b73d-b3173186cc13 admin admin] PATH_INFO: `/v3/users/e32301c6b74f4cc6a1dd1c2a7cef4391` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:07:25.829780 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046b798b-2fee-4008-b73d-b3173186cc13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e32301c6b74f4cc6a1dd1c2a7cef4391)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:07:25.831708 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046b798b-2fee-4008-b73d-b3173186cc13 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:07:26.041117 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-046b798b-2fee-4008-b73d-b3173186cc13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e32301c6b74f4cc6a1dd1c2a7cef4391'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:07:26.053273 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-046b798b-2fee-4008-b73d-b3173186cc13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e32301c6b74f4cc6a1dd1c2a7cef4391'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:07:26.053273 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-046b798b-2fee-4008-b73d-b3173186cc13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e32301c6b74f4cc6a1dd1c2a7cef4391'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:07:26.059026 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:INSERT=3,keystone:SELECT=89,keystone:DELETE=8 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:07:26.069534 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-046b798b-2fee-4008-b73d-b3173186cc13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e32301c6b74f4cc6a1dd1c2a7cef4391'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:07:26.135604 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-046b798b-2fee-4008-b73d-b3173186cc13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e32301c6b74f4cc6a1dd1c2a7cef4391'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:07:26.143646 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1383/2729] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 18 22:07:25 2022] DELETE /identity/v3/users/e32301c6b74f4cc6a1dd1c2a7cef4391 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:07:26.148245 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8a4a57-60ec-4e86-8e34-2c4c9377584f None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:07:26.148754 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8a4a57-60ec-4e86-8e34-2c4c9377584f None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:07:26.148885 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8a4a57-60ec-4e86-8e34-2c4c9377584f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:07:26.157918 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:07:26.171092 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-8b8a4a57-60ec-4e86-8e34-2c4c9377584f None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:07:26.174162 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-8b8a4a57-60ec-4e86-8e34-2c4c9377584f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:07:26.239273 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1347/2730] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:07:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:07:26.249166 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046b798b-2fee-4008-b73d-b3173186cc13 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:07:26.250899 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-046b798b-2fee-4008-b73d-b3173186cc13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:07:26.313135 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046b798b-2fee-4008-b73d-b3173186cc13 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:07:26.316960 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef61058-d8c6-41c1-9aee-49b2fa781fdf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a937971ad1a4b0c8697c764f214d446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:07:26.317726 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef61058-d8c6-41c1-9aee-49b2fa781fdf service neutron] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:07:26.318187 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef61058-d8c6-41c1-9aee-49b2fa781fdf service neutron] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:07:26.318467 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef61058-d8c6-41c1-9aee-49b2fa781fdf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:07:26.329430 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef61058-d8c6-41c1-9aee-49b2fa781fdf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:07:26.330953 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef61058-d8c6-41c1-9aee-49b2fa781fdf service neutron] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:07:26.342608 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1384/2731] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:07:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:07:26.600280 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190d010f-013c-4118-a5d5-0641ca7a8d9c None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:07:26.603997 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190d010f-013c-4118-a5d5-0641ca7a8d9c None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:07:26.603997 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190d010f-013c-4118-a5d5-0641ca7a8d9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:07:26.631189 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-190d010f-013c-4118-a5d5-0641ca7a8d9c None None] MFA Rules not processed for user `57a63003de8c4bc89bfcc0288172e4fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:07:26.633930 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-190d010f-013c-4118-a5d5-0641ca7a8d9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:07:26.741705 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1348/2732] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:07:26 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:07:26.830536 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef61058-d8c6-41c1-9aee-49b2fa781fdf service neutron] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:07:26.844473 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-1ef61058-d8c6-41c1-9aee-49b2fa781fdf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:07:26.879605 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef61058-d8c6-41c1-9aee-49b2fa781fdf service neutron] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:07:26.885182 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba2b73e-b0a6-4daf-8a10-55d40c9e2026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:07:26.885831 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba2b73e-b0a6-4daf-8a10-55d40c9e2026 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:07:26.886114 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba2b73e-b0a6-4daf-8a10-55d40c9e2026 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:07:26.886391 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba2b73e-b0a6-4daf-8a10-55d40c9e2026 admin admin] PATH_INFO: `/v3/projects/dca3f1c20875401bbfb786739631a468` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:07:26.888581 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba2b73e-b0a6-4daf-8a10-55d40c9e2026 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dca3f1c20875401bbfb786739631a468)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:07:26.893063 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba2b73e-b0a6-4daf-8a10-55d40c9e2026 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:07:27.015703 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-4ba2b73e-b0a6-4daf-8a10-55d40c9e2026 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dca3f1c20875401bbfb786739631a468', 'request_id': 'req-4ba2b73e-b0a6-4daf-8a10-55d40c9e2026'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:07:27.022873 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-4ba2b73e-b0a6-4daf-8a10-55d40c9e2026 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dca3f1c20875401bbfb786739631a468', 'request_id': 'req-4ba2b73e-b0a6-4daf-8a10-55d40c9e2026'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:07:27.100508 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-4ba2b73e-b0a6-4daf-8a10-55d40c9e2026 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dca3f1c20875401bbfb786739631a468', 'request_id': 'req-4ba2b73e-b0a6-4daf-8a10-55d40c9e2026'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:07:27.113478 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-4ba2b73e-b0a6-4daf-8a10-55d40c9e2026 admin admin] The token cache is being invalidate because project dca3f1c20875401bbfb786739631a468 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88097) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 22:07:27.113794 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-4ba2b73e-b0a6-4daf-8a10-55d40c9e2026 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:07:27.114420 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-4ba2b73e-b0a6-4daf-8a10-55d40c9e2026 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:07:27.115915 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1385/2733] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 18 22:07:26 2022] DELETE /identity/v3/projects/dca3f1c20875401bbfb786739631a468 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:07:27.120177 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190d010f-013c-4118-a5d5-0641ca7a8d9c None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:07:27.122857 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3707f2ae-8da4-4e39-8acd-ca0ed5eea914 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:07:27.123149 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3707f2ae-8da4-4e39-8acd-ca0ed5eea914 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:07:27.123434 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3707f2ae-8da4-4e39-8acd-ca0ed5eea914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:07:27.131384 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190d010f-013c-4118-a5d5-0641ca7a8d9c None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:07:27.148512 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-3707f2ae-8da4-4e39-8acd-ca0ed5eea914 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:07:27.149957 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-3707f2ae-8da4-4e39-8acd-ca0ed5eea914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:07:27.190195 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da48f05d-01c7-4d42-b2c1-3155ebd26ee6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a937971ad1a4b0c8697c764f214d446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:07:27.191224 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da48f05d-01c7-4d42-b2c1-3155ebd26ee6 service neutron] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:07:27.194403 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da48f05d-01c7-4d42-b2c1-3155ebd26ee6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:07:27.194403 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da48f05d-01c7-4d42-b2c1-3155ebd26ee6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:07:27.194403 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-da48f05d-01c7-4d42-b2c1-3155ebd26ee6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:07:27.205111 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da48f05d-01c7-4d42-b2c1-3155ebd26ee6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:07:27.206735 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da48f05d-01c7-4d42-b2c1-3155ebd26ee6 service neutron] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:07:27.217501 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1349/2734] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:07:27 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 22:07:27.221503 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1386/2735] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:07:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:07:27.293351 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff3c454-76a2-45fb-919f-9d93eb26428c None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:07:27.293351 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff3c454-76a2-45fb-919f-9d93eb26428c None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:07:27.293582 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff3c454-76a2-45fb-919f-9d93eb26428c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:07:27.316190 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-dff3c454-76a2-45fb-919f-9d93eb26428c None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:07:27.317853 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-dff3c454-76a2-45fb-919f-9d93eb26428c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:07:27.327003 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1350/2736] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:07:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:07:27.331326 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3707f2ae-8da4-4e39-8acd-ca0ed5eea914 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:07:27.341959 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3707f2ae-8da4-4e39-8acd-ca0ed5eea914 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:07:27.347653 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fcfe86-e7a4-4fca-a861-4e74dd284454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:07:27.348367 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fcfe86-e7a4-4fca-a861-4e74dd284454 admin admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:07:27.348786 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fcfe86-e7a4-4fca-a861-4e74dd284454 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:07:27.349160 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fcfe86-e7a4-4fca-a861-4e74dd284454 admin admin] PATH_INFO: `/v3/domains` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:07:27.349924 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fcfe86-e7a4-4fca-a861-4e74dd284454 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 22:07:27.350332 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fcfe86-e7a4-4fca-a861-4e74dd284454 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:07:27.352447 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fcfe86-e7a4-4fca-a861-4e74dd284454 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:07:27.354352 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:07:27.367810 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1387/2737] 10.222.0.27 () {58 vars in 1153 bytes} [Thu Aug 18 22:07:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 22:07:27.374509 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff3c454-76a2-45fb-919f-9d93eb26428c None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:07:27.384312 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff3c454-76a2-45fb-919f-9d93eb26428c None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:07:27.390343 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aed7a0-83f0-4e95-964a-6a1ad2c6bcdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:07:27.390963 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aed7a0-83f0-4e95-964a-6a1ad2c6bcdd admin admin] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:07:27.391240 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aed7a0-83f0-4e95-964a-6a1ad2c6bcdd admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:07:27.391511 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aed7a0-83f0-4e95-964a-6a1ad2c6bcdd admin admin] PATH_INFO: `/v3/projects` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:07:27.392143 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67aed7a0-83f0-4e95-964a-6a1ad2c6bcdd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:07:27.394135 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67aed7a0-83f0-4e95-964a-6a1ad2c6bcdd admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:07:27.483505 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1351/2738] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 18 22:07:27 2022] POST /identity/v3/projects => generated 375 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 22:07:27.487408 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fcfe86-e7a4-4fca-a861-4e74dd284454 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:07:27.499020 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fcfe86-e7a4-4fca-a861-4e74dd284454 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:07:27.571372 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83e7095-12c3-46a0-8124-3a8e3acdbed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:07:27.572325 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83e7095-12c3-46a0-8124-3a8e3acdbed0 admin admin] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:07:27.572452 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83e7095-12c3-46a0-8124-3a8e3acdbed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:07:27.572807 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83e7095-12c3-46a0-8124-3a8e3acdbed0 admin admin] PATH_INFO: `/v3/users` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:07:27.573859 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83e7095-12c3-46a0-8124-3a8e3acdbed0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:07:27.575750 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83e7095-12c3-46a0-8124-3a8e3acdbed0 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:07:27.691623 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1388/2739] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 18 22:07:27 2022] POST /identity/v3/users => generated 288 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 22:07:27.698556 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aed7a0-83f0-4e95-964a-6a1ad2c6bcdd admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:07:27.730761 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aed7a0-83f0-4e95-964a-6a1ad2c6bcdd admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:07:27.730761 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3b2f12-8ec6-4509-98bf-890683263ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:07:27.730761 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3b2f12-8ec6-4509-98bf-890683263ec3 admin admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:07:27.730761 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3b2f12-8ec6-4509-98bf-890683263ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:07:27.731570 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3b2f12-8ec6-4509-98bf-890683263ec3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:07:27.731570 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3b2f12-8ec6-4509-98bf-890683263ec3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:07:27.731570 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3b2f12-8ec6-4509-98bf-890683263ec3 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:07:27.746509 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1352/2740] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:07:27 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:07:27.750614 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83e7095-12c3-46a0-8124-3a8e3acdbed0 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:07:27.765452 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83e7095-12c3-46a0-8124-3a8e3acdbed0 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:07:27.772530 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb21d09c-9e3c-4d70-ac83-212861102a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:07:27.772530 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb21d09c-9e3c-4d70-ac83-212861102a37 admin admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:07:27.772530 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb21d09c-9e3c-4d70-ac83-212861102a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:07:27.772530 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb21d09c-9e3c-4d70-ac83-212861102a37 admin admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:07:27.772988 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb21d09c-9e3c-4d70-ac83-212861102a37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:07:27.774207 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb21d09c-9e3c-4d70-ac83-212861102a37 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:07:27.789455 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1389/2741] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:07:27 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 22:07:27.794112 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3b2f12-8ec6-4509-98bf-890683263ec3 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:07:27.805935 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3b2f12-8ec6-4509-98bf-890683263ec3 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:07:27.812332 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7b4a23-f47c-43ff-8664-48a403004563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:07:27.812953 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7b4a23-f47c-43ff-8664-48a403004563 admin admin] REQUEST_METHOD: `PUT` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:07:27.813223 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7b4a23-f47c-43ff-8664-48a403004563 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:07:27.813613 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7b4a23-f47c-43ff-8664-48a403004563 admin admin] PATH_INFO: `/v3/projects/b211ae4397364178bc1c37b18030da8e/users/df350589f0af45a6963d894b611a1297/roles/de8f2438056f4af9879423f8a59e0e0b` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:07:27.835635 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:07:27.843141 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7b4a23-f47c-43ff-8664-48a403004563 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b211ae4397364178bc1c37b18030da8e, user_id=df350589f0af45a6963d894b611a1297, role_id=de8f2438056f4af9879423f8a59e0e0b)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:07:27.846288 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7b4a23-f47c-43ff-8664-48a403004563 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:07:27.914825 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1353/2742] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 18 22:07:27 2022] PUT /identity/v3/projects/b211ae4397364178bc1c37b18030da8e/users/df350589f0af45a6963d894b611a1297/roles/de8f2438056f4af9879423f8a59e0e0b => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:07:27.929009 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b40699-a4a6-48cc-9850-c05ddde0df41 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:07:27.929894 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b40699-a4a6-48cc-9850-c05ddde0df41 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:07:27.930748 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b40699-a4a6-48cc-9850-c05ddde0df41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:07:27.979172 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-f3b40699-a4a6-48cc-9850-c05ddde0df41 None None] MFA Rules not processed for user `df350589f0af45a6963d894b611a1297`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:07:27.980807 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-f3b40699-a4a6-48cc-9850-c05ddde0df41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:07:28.055969 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1390/2743] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:07:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:07:28.067188 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7b4a23-f47c-43ff-8664-48a403004563 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:07:28.068977 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-8b7b4a23-f47c-43ff-8664-48a403004563 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:07:28.130647 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7b4a23-f47c-43ff-8664-48a403004563 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:07:28.135520 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e57906-8c3e-41b7-992a-0c6be902e6db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22b6a7c36f8a4795a75271b8079821c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:07:28.136688 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e57906-8c3e-41b7-992a-0c6be902e6db service cinder] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:07:28.137145 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e57906-8c3e-41b7-992a-0c6be902e6db service cinder] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:07:28.137874 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e57906-8c3e-41b7-992a-0c6be902e6db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:07:28.150467 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e57906-8c3e-41b7-992a-0c6be902e6db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:07:28.152098 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e57906-8c3e-41b7-992a-0c6be902e6db service cinder] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:07:28.163499 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1354/2744] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:07:28 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:07:29.973974 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aa2014-48e5-4699-ad24-9c1b10360530 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:07:29.977636 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aa2014-48e5-4699-ad24-9c1b10360530 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:07:29.977636 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aa2014-48e5-4699-ad24-9c1b10360530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:07:29.995791 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-90aa2014-48e5-4699-ad24-9c1b10360530 None None] MFA Rules not processed for user `df350589f0af45a6963d894b611a1297`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:07:29.996584 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-90aa2014-48e5-4699-ad24-9c1b10360530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:07:30.004144 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1391/2745] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:07:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:07:38.158744 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=30,keystone:INSERT=1 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:07:39.988839 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=72,keystone:INSERT=3 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:07:42.065708 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e57906-8c3e-41b7-992a-0c6be902e6db service cinder] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:07:42.067501 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-69e57906-8c3e-41b7-992a-0c6be902e6db service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:07:42.153286 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e57906-8c3e-41b7-992a-0c6be902e6db service cinder] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:07:42.162048 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011bed31-4a72-4487-a101-dfcde4a9a166 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a39cd50340184779ac589bbcb7cac9aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:07:42.162733 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011bed31-4a72-4487-a101-dfcde4a9a166 service nova] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:07:42.163028 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011bed31-4a72-4487-a101-dfcde4a9a166 service nova] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:07:42.163707 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011bed31-4a72-4487-a101-dfcde4a9a166 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:07:42.165184 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-011bed31-4a72-4487-a101-dfcde4a9a166 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:07:42.182771 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011bed31-4a72-4487-a101-dfcde4a9a166 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:07:42.182771 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011bed31-4a72-4487-a101-dfcde4a9a166 service nova] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:07:42.195065 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1355/2746] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:07:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:07:48.696493 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81656223-f8e5-4e09-8e82-a40fa1552cc2 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:07:48.696982 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81656223-f8e5-4e09-8e82-a40fa1552cc2 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:07:48.697089 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81656223-f8e5-4e09-8e82-a40fa1552cc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:07:48.716452 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-81656223-f8e5-4e09-8e82-a40fa1552cc2 None None] MFA Rules not processed for user `f079aa6ed5594a4982172b51b93ac54f`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:07:48.717712 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-81656223-f8e5-4e09-8e82-a40fa1552cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:07:48.772608 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1392/2747] 10.222.0.27 () {58 vars in 1009 bytes} [Thu Aug 18 22:07:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:07:48.917550 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011bed31-4a72-4487-a101-dfcde4a9a166 service nova] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:07:48.918962 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-011bed31-4a72-4487-a101-dfcde4a9a166 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:07:48.986553 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011bed31-4a72-4487-a101-dfcde4a9a166 service nova] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:07:48.991546 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8ee176-3cd0-45ba-9d9d-502ecfe6c3f8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae59e6dca304c949942ae769acedc74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:07:48.992144 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8ee176-3cd0-45ba-9d9d-502ecfe6c3f8 service swift] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:07:48.992424 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8ee176-3cd0-45ba-9d9d-502ecfe6c3f8 service swift] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:07:48.992723 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8ee176-3cd0-45ba-9d9d-502ecfe6c3f8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:07:49.001443 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8ee176-3cd0-45ba-9d9d-502ecfe6c3f8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:07:49.003004 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8ee176-3cd0-45ba-9d9d-502ecfe6c3f8 service swift] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:07:49.010939 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1356/2748] 10.222.0.27 () {60 vars in 1384 bytes} [Thu Aug 18 22:07:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 18 22:07:49.811574 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4590ab11-5cfc-459f-96b9-c5e9f18e0048 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:07:49.812217 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4590ab11-5cfc-459f-96b9-c5e9f18e0048 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:07:49.812426 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4590ab11-5cfc-459f-96b9-c5e9f18e0048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:07:49.831862 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-4590ab11-5cfc-459f-96b9-c5e9f18e0048 None None] MFA Rules not processed for user `f079aa6ed5594a4982172b51b93ac54f`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:07:49.833096 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-4590ab11-5cfc-459f-96b9-c5e9f18e0048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:07:49.840143 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1393/2749] 10.222.0.27 () {58 vars in 967 bytes} [Thu Aug 18 22:07:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:07:49.853447 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8ee176-3cd0-45ba-9d9d-502ecfe6c3f8 service swift] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:07:49.863899 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8ee176-3cd0-45ba-9d9d-502ecfe6c3f8 service swift] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:07:49.868909 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af22777c-cd47-4641-8a65-5814f581d022 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae59e6dca304c949942ae769acedc74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:07:49.869536 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af22777c-cd47-4641-8a65-5814f581d022 service swift] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:07:49.869816 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af22777c-cd47-4641-8a65-5814f581d022 service swift] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:07:49.870088 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af22777c-cd47-4641-8a65-5814f581d022 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:07:49.878638 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af22777c-cd47-4641-8a65-5814f581d022 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:07:49.880207 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af22777c-cd47-4641-8a65-5814f581d022 service swift] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:07:49.888232 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1357/2750] 10.222.0.27 () {60 vars in 1384 bytes} [Thu Aug 18 22:07:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 18 22:07:50.466295 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024cc021-6e67-480f-9f75-12d49df63070 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:07:50.466580 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024cc021-6e67-480f-9f75-12d49df63070 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:07:50.466856 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024cc021-6e67-480f-9f75-12d49df63070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:07:50.486301 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-024cc021-6e67-480f-9f75-12d49df63070 None None] MFA Rules not processed for user `f079aa6ed5594a4982172b51b93ac54f`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:07:50.487480 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-024cc021-6e67-480f-9f75-12d49df63070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:07:50.494436 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1394/2751] 10.222.0.27 () {58 vars in 1009 bytes} [Thu Aug 18 22:07:50 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:07:50.506243 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af22777c-cd47-4641-8a65-5814f581d022 service swift] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:07:50.517710 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af22777c-cd47-4641-8a65-5814f581d022 service swift] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:07:50.522794 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643bcdba-2361-4851-92a4-e9101ac0ee16 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae59e6dca304c949942ae769acedc74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:07:50.523384 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643bcdba-2361-4851-92a4-e9101ac0ee16 service swift] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:07:50.523666 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643bcdba-2361-4851-92a4-e9101ac0ee16 service swift] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:07:50.523942 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643bcdba-2361-4851-92a4-e9101ac0ee16 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:07:50.532489 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643bcdba-2361-4851-92a4-e9101ac0ee16 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:07:50.534080 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643bcdba-2361-4851-92a4-e9101ac0ee16 service swift] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:07:50.542018 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1358/2752] 10.222.0.27 () {60 vars in 1384 bytes} [Thu Aug 18 22:07:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 18 22:07:51.085119 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8baade-bc10-49a1-9420-cba32aa505a0 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:07:51.085619 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8baade-bc10-49a1-9420-cba32aa505a0 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:07:51.085718 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8baade-bc10-49a1-9420-cba32aa505a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:07:51.104760 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-7c8baade-bc10-49a1-9420-cba32aa505a0 None None] MFA Rules not processed for user `f079aa6ed5594a4982172b51b93ac54f`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:07:51.105953 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-7c8baade-bc10-49a1-9420-cba32aa505a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:07:51.113139 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1395/2753] 10.222.0.27 () {58 vars in 967 bytes} [Thu Aug 18 22:07:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:07:51.125063 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643bcdba-2361-4851-92a4-e9101ac0ee16 service swift] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:07:51.135652 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643bcdba-2361-4851-92a4-e9101ac0ee16 service swift] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:07:51.141075 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404faae2-7ac8-43d1-99d3-ddd24e50b0ee service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae59e6dca304c949942ae769acedc74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:07:51.142164 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404faae2-7ac8-43d1-99d3-ddd24e50b0ee service swift] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:07:51.142440 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404faae2-7ac8-43d1-99d3-ddd24e50b0ee service swift] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:07:51.142715 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404faae2-7ac8-43d1-99d3-ddd24e50b0ee service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:07:51.150721 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404faae2-7ac8-43d1-99d3-ddd24e50b0ee service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:07:51.152272 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404faae2-7ac8-43d1-99d3-ddd24e50b0ee service swift] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:07:51.161041 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1359/2754] 10.222.0.27 () {60 vars in 1384 bytes} [Thu Aug 18 22:07:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 18 22:07:53.794022 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8baade-bc10-49a1-9420-cba32aa505a0 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:07:53.857165 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8baade-bc10-49a1-9420-cba32aa505a0 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:07:53.862556 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1057fe46-dc8e-46bc-9082-5773ba74dbff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:07:53.863181 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1057fe46-dc8e-46bc-9082-5773ba74dbff admin admin] REQUEST_METHOD: `DELETE` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:07:53.863499 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1057fe46-dc8e-46bc-9082-5773ba74dbff admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:07:53.863774 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1057fe46-dc8e-46bc-9082-5773ba74dbff admin admin] PATH_INFO: `/v3/users/df350589f0af45a6963d894b611a1297` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:07:53.865061 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1057fe46-dc8e-46bc-9082-5773ba74dbff admin admin] RBAC: Authorizing `identity:delete_user(user_id=df350589f0af45a6963d894b611a1297)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:07:53.866971 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1057fe46-dc8e-46bc-9082-5773ba74dbff admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:07:54.049780 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-1057fe46-dc8e-46bc-9082-5773ba74dbff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df350589f0af45a6963d894b611a1297'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:07:54.056613 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-1057fe46-dc8e-46bc-9082-5773ba74dbff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df350589f0af45a6963d894b611a1297'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:07:54.057292 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-1057fe46-dc8e-46bc-9082-5773ba74dbff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df350589f0af45a6963d894b611a1297'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:07:54.070064 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-1057fe46-dc8e-46bc-9082-5773ba74dbff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df350589f0af45a6963d894b611a1297'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:07:54.150368 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-1057fe46-dc8e-46bc-9082-5773ba74dbff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df350589f0af45a6963d894b611a1297'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:07:54.156670 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1396/2755] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 18 22:07:53 2022] DELETE /identity/v3/users/df350589f0af45a6963d894b611a1297 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:07:54.161422 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696e5c01-34ea-4c46-8d88-dbdf3031e0b0 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:07:54.161924 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696e5c01-34ea-4c46-8d88-dbdf3031e0b0 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:07:54.162025 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696e5c01-34ea-4c46-8d88-dbdf3031e0b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:07:54.181227 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-696e5c01-34ea-4c46-8d88-dbdf3031e0b0 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:07:54.182434 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-696e5c01-34ea-4c46-8d88-dbdf3031e0b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:07:54.213713 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=100 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:07:54.242794 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1360/2756] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:07:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:07:54.252951 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1057fe46-dc8e-46bc-9082-5773ba74dbff admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:07:54.254388 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-1057fe46-dc8e-46bc-9082-5773ba74dbff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:07:54.260837 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:07:54.313284 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1057fe46-dc8e-46bc-9082-5773ba74dbff admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:07:54.317900 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdeaa4f-730e-4af5-a6af-997568d01898 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a937971ad1a4b0c8697c764f214d446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:07:54.318500 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdeaa4f-730e-4af5-a6af-997568d01898 service neutron] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:07:54.318783 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdeaa4f-730e-4af5-a6af-997568d01898 service neutron] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:07:54.319060 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdeaa4f-730e-4af5-a6af-997568d01898 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:07:54.328307 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdeaa4f-730e-4af5-a6af-997568d01898 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:07:54.330181 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdeaa4f-730e-4af5-a6af-997568d01898 service neutron] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:07:54.339641 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1397/2757] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:07:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:07:54.609144 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696e5c01-34ea-4c46-8d88-dbdf3031e0b0 None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:07:54.611300 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-696e5c01-34ea-4c46-8d88-dbdf3031e0b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:07:54.629213 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696e5c01-34ea-4c46-8d88-dbdf3031e0b0 None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:07:54.629213 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470731e7-2621-4038-825a-84ee3f3bfa6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:07:54.629213 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470731e7-2621-4038-825a-84ee3f3bfa6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:07:54.629213 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470731e7-2621-4038-825a-84ee3f3bfa6b admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:07:54.629755 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470731e7-2621-4038-825a-84ee3f3bfa6b admin admin] PATH_INFO: `/v3/projects/b211ae4397364178bc1c37b18030da8e` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:07:54.629986 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470731e7-2621-4038-825a-84ee3f3bfa6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b211ae4397364178bc1c37b18030da8e)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:07:54.631867 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470731e7-2621-4038-825a-84ee3f3bfa6b admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:07:54.746956 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-470731e7-2621-4038-825a-84ee3f3bfa6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b211ae4397364178bc1c37b18030da8e', 'request_id': 'req-470731e7-2621-4038-825a-84ee3f3bfa6b'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:07:54.753103 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-470731e7-2621-4038-825a-84ee3f3bfa6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b211ae4397364178bc1c37b18030da8e', 'request_id': 'req-470731e7-2621-4038-825a-84ee3f3bfa6b'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:07:54.830829 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-470731e7-2621-4038-825a-84ee3f3bfa6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b211ae4397364178bc1c37b18030da8e', 'request_id': 'req-470731e7-2621-4038-825a-84ee3f3bfa6b'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:07:54.842162 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-470731e7-2621-4038-825a-84ee3f3bfa6b admin admin] The token cache is being invalidate because project b211ae4397364178bc1c37b18030da8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88096) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 22:07:54.845853 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-470731e7-2621-4038-825a-84ee3f3bfa6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:07:54.845853 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-470731e7-2621-4038-825a-84ee3f3bfa6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:07:54.845853 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1361/2758] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 18 22:07:54 2022] DELETE /identity/v3/projects/b211ae4397364178bc1c37b18030da8e => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:08:04.355996 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=24 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:08:04.839103 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=38,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:08:25.663000 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617b1878-83ea-4f5f-91e4-6fb3725dc241 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:08:25.663503 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617b1878-83ea-4f5f-91e4-6fb3725dc241 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:08:25.663631 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617b1878-83ea-4f5f-91e4-6fb3725dc241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:08:25.681960 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-617b1878-83ea-4f5f-91e4-6fb3725dc241 None None] MFA Rules not processed for user `57a63003de8c4bc89bfcc0288172e4fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:08:25.683330 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-617b1878-83ea-4f5f-91e4-6fb3725dc241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:08:25.736260 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1398/2759] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:08:25 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:08:35.729815 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=25 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:08:38.992886 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470731e7-2621-4038-825a-84ee3f3bfa6b admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:08:38.994880 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-470731e7-2621-4038-825a-84ee3f3bfa6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:08:39.139093 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470731e7-2621-4038-825a-84ee3f3bfa6b admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:08:39.144252 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27a454e-cf10-4365-a37d-8ea1a0f7c090 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b44c0cf2d8b34f3e81c59d19eedbdfcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:08:39.144907 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27a454e-cf10-4365-a37d-8ea1a0f7c090 service placement] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:08:39.145191 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27a454e-cf10-4365-a37d-8ea1a0f7c090 service placement] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:08:39.145466 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27a454e-cf10-4365-a37d-8ea1a0f7c090 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:08:39.147230 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-a27a454e-cf10-4365-a37d-8ea1a0f7c090 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:08:39.160091 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27a454e-cf10-4365-a37d-8ea1a0f7c090 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:08:39.162698 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27a454e-cf10-4365-a37d-8ea1a0f7c090 service placement] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:08:39.173549 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1362/2760] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:08:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:08:49.168875 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=63 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:09:29.547390 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d178d784-2167-4b87-8ba6-20ba28254cd3 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:09:29.549464 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d178d784-2167-4b87-8ba6-20ba28254cd3 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:09:29.549464 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d178d784-2167-4b87-8ba6-20ba28254cd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:09:29.568165 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-d178d784-2167-4b87-8ba6-20ba28254cd3 None None] MFA Rules not processed for user `57a63003de8c4bc89bfcc0288172e4fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:09:29.569397 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-d178d784-2167-4b87-8ba6-20ba28254cd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:09:29.576226 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1399/2761] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:09:29 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:09:39.562688 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=3 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:10:27.023667 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27a454e-cf10-4365-a37d-8ea1a0f7c090 service placement] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:10:27.024340 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-a27a454e-cf10-4365-a37d-8ea1a0f7c090 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:10:27.112474 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27a454e-cf10-4365-a37d-8ea1a0f7c090 service placement] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:10:27.116100 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb247e1-9e9b-4611-8ba7-d4b3e4a48b54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a937971ad1a4b0c8697c764f214d446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:10:27.117357 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb247e1-9e9b-4611-8ba7-d4b3e4a48b54 service neutron] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:10:27.117637 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb247e1-9e9b-4611-8ba7-d4b3e4a48b54 service neutron] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:10:27.117909 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb247e1-9e9b-4611-8ba7-d4b3e4a48b54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:10:27.119686 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-6eb247e1-9e9b-4611-8ba7-d4b3e4a48b54 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:10:27.211543 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb247e1-9e9b-4611-8ba7-d4b3e4a48b54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:10:27.213056 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb247e1-9e9b-4611-8ba7-d4b3e4a48b54 service neutron] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:10:27.234525 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1363/2762] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:10:27 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:10:31.484990 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e84646e-5421-4f6b-9aec-3033119de048 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:10:31.485548 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e84646e-5421-4f6b-9aec-3033119de048 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:10:31.485656 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e84646e-5421-4f6b-9aec-3033119de048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:10:31.506476 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-6e84646e-5421-4f6b-9aec-3033119de048 None None] MFA Rules not processed for user `57a63003de8c4bc89bfcc0288172e4fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:10:31.508080 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-6e84646e-5421-4f6b-9aec-3033119de048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:10:31.515595 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1400/2763] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:10:31 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:10:32.206549 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb247e1-9e9b-4611-8ba7-d4b3e4a48b54 service neutron] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:10:32.209062 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-6eb247e1-9e9b-4611-8ba7-d4b3e4a48b54 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:10:32.219769 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb247e1-9e9b-4611-8ba7-d4b3e4a48b54 service neutron] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:10:32.223318 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bc107a-69cc-492e-ad7b-193a0ca70f02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a937971ad1a4b0c8697c764f214d446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:10:32.223912 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bc107a-69cc-492e-ad7b-193a0ca70f02 service neutron] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:10:32.224194 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bc107a-69cc-492e-ad7b-193a0ca70f02 service neutron] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:10:32.224464 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bc107a-69cc-492e-ad7b-193a0ca70f02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:10:32.226193 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-25bc107a-69cc-492e-ad7b-193a0ca70f02 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:10:32.240685 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bc107a-69cc-492e-ad7b-193a0ca70f02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:10:32.242124 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bc107a-69cc-492e-ad7b-193a0ca70f02 service neutron] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:10:32.254112 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1364/2764] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:10:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:10:41.500241 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=3 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:10:42.249025 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=81 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:11:28.504139 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e84646e-5421-4f6b-9aec-3033119de048 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:11:28.505975 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-6e84646e-5421-4f6b-9aec-3033119de048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:11:28.524375 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e84646e-5421-4f6b-9aec-3033119de048 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:11:28.530062 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d785f598-ace4-48c2-81cb-b080dd273705 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a39cd50340184779ac589bbcb7cac9aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:11:28.530664 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d785f598-ace4-48c2-81cb-b080dd273705 service nova] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:11:28.531056 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d785f598-ace4-48c2-81cb-b080dd273705 service nova] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:11:28.531336 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d785f598-ace4-48c2-81cb-b080dd273705 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:11:28.533066 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-d785f598-ace4-48c2-81cb-b080dd273705 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:11:28.548485 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d785f598-ace4-48c2-81cb-b080dd273705 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:11:28.548485 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d785f598-ace4-48c2-81cb-b080dd273705 service nova] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:11:28.562685 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1401/2765] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:11:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:11:38.555001 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=6 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:11:38.878801 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bc107a-69cc-492e-ad7b-193a0ca70f02 service neutron] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:11:38.880278 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-25bc107a-69cc-492e-ad7b-193a0ca70f02 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:11:38.895271 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bc107a-69cc-492e-ad7b-193a0ca70f02 service neutron] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:11:38.900375 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e986ec9b-303d-4866-a1a6-9ec86c9ced79 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b44c0cf2d8b34f3e81c59d19eedbdfcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:11:38.901013 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e986ec9b-303d-4866-a1a6-9ec86c9ced79 service placement] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:11:38.901298 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e986ec9b-303d-4866-a1a6-9ec86c9ced79 service placement] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:11:38.901580 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e986ec9b-303d-4866-a1a6-9ec86c9ced79 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:11:38.904088 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-e986ec9b-303d-4866-a1a6-9ec86c9ced79 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:11:38.916559 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e986ec9b-303d-4866-a1a6-9ec86c9ced79 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:11:38.918208 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e986ec9b-303d-4866-a1a6-9ec86c9ced79 service placement] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:11:38.929851 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1365/2766] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:11:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:11:39.011787 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d785f598-ace4-48c2-81cb-b080dd273705 service nova] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:11:39.013545 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-d785f598-ace4-48c2-81cb-b080dd273705 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:11:39.107787 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d785f598-ace4-48c2-81cb-b080dd273705 service nova] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:11:39.112235 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d66ce2-e7e9-46c9-bf44-9c523f2f1635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:11:39.112888 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d66ce2-e7e9-46c9-bf44-9c523f2f1635 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:11:39.113164 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d66ce2-e7e9-46c9-bf44-9c523f2f1635 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:11:39.113436 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d66ce2-e7e9-46c9-bf44-9c523f2f1635 admin admin] PATH_INFO: `/v3/users/57a63003de8c4bc89bfcc0288172e4fc` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:11:39.114544 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d66ce2-e7e9-46c9-bf44-9c523f2f1635 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57a63003de8c4bc89bfcc0288172e4fc)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:11:39.116450 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d66ce2-e7e9-46c9-bf44-9c523f2f1635 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:11:39.267873 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-22d66ce2-e7e9-46c9-bf44-9c523f2f1635 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57a63003de8c4bc89bfcc0288172e4fc'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:11:39.274817 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-22d66ce2-e7e9-46c9-bf44-9c523f2f1635 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57a63003de8c4bc89bfcc0288172e4fc'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:11:39.275520 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-22d66ce2-e7e9-46c9-bf44-9c523f2f1635 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57a63003de8c4bc89bfcc0288172e4fc'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:11:39.288357 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-22d66ce2-e7e9-46c9-bf44-9c523f2f1635 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57a63003de8c4bc89bfcc0288172e4fc'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:11:39.388128 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-22d66ce2-e7e9-46c9-bf44-9c523f2f1635 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57a63003de8c4bc89bfcc0288172e4fc'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:11:39.394457 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1402/2767] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 18 22:11:39 2022] DELETE /identity/v3/users/57a63003de8c4bc89bfcc0288172e4fc => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:11:39.620741 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e986ec9b-303d-4866-a1a6-9ec86c9ced79 service placement] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:11:39.633829 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e986ec9b-303d-4866-a1a6-9ec86c9ced79 service placement] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:11:39.693524 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265d8a73-9a89-4bb0-951d-0de28e0c3dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:11:39.694009 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265d8a73-9a89-4bb0-951d-0de28e0c3dc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:11:39.694287 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265d8a73-9a89-4bb0-951d-0de28e0c3dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:11:39.694659 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265d8a73-9a89-4bb0-951d-0de28e0c3dc6 admin admin] PATH_INFO: `/v3/projects/fd8bb9f3880744b2a9e80426e1f6ef3b` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:11:39.695820 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265d8a73-9a89-4bb0-951d-0de28e0c3dc6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd8bb9f3880744b2a9e80426e1f6ef3b)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:11:39.697895 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265d8a73-9a89-4bb0-951d-0de28e0c3dc6 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:11:39.818262 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-265d8a73-9a89-4bb0-951d-0de28e0c3dc6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd8bb9f3880744b2a9e80426e1f6ef3b', 'request_id': 'req-265d8a73-9a89-4bb0-951d-0de28e0c3dc6'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:11:39.823789 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-265d8a73-9a89-4bb0-951d-0de28e0c3dc6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd8bb9f3880744b2a9e80426e1f6ef3b', 'request_id': 'req-265d8a73-9a89-4bb0-951d-0de28e0c3dc6'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:11:39.902049 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-265d8a73-9a89-4bb0-951d-0de28e0c3dc6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd8bb9f3880744b2a9e80426e1f6ef3b', 'request_id': 'req-265d8a73-9a89-4bb0-951d-0de28e0c3dc6'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:11:39.913605 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-265d8a73-9a89-4bb0-951d-0de28e0c3dc6 admin admin] The token cache is being invalidate because project fd8bb9f3880744b2a9e80426e1f6ef3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88096) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 22:11:39.913892 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-265d8a73-9a89-4bb0-951d-0de28e0c3dc6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:11:39.914530 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-265d8a73-9a89-4bb0-951d-0de28e0c3dc6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:11:39.915999 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1366/2768] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 18 22:11:39 2022] DELETE /identity/v3/projects/fd8bb9f3880744b2a9e80426e1f6ef3b => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:11:39.921314 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf327b99-74ea-42ae-8b02-92766c8bd686 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:11:39.921820 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf327b99-74ea-42ae-8b02-92766c8bd686 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:11:39.921921 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf327b99-74ea-42ae-8b02-92766c8bd686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:11:39.979271 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-bf327b99-74ea-42ae-8b02-92766c8bd686 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:11:39.980551 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-bf327b99-74ea-42ae-8b02-92766c8bd686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:11:39.995483 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:11:40.042405 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1403/2769] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:11:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:11:40.051041 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f9c6b9-11c3-4835-bd1a-2dbac30c1472 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:11:40.051322 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f9c6b9-11c3-4835-bd1a-2dbac30c1472 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:11:40.051593 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f9c6b9-11c3-4835-bd1a-2dbac30c1472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:11:40.071609 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-e4f9c6b9-11c3-4835-bd1a-2dbac30c1472 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:11:40.072861 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-e4f9c6b9-11c3-4835-bd1a-2dbac30c1472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:11:40.080703 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1367/2770] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:11:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:11:40.084956 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf327b99-74ea-42ae-8b02-92766c8bd686 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:11:40.094641 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf327b99-74ea-42ae-8b02-92766c8bd686 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:11:40.099140 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecee3dc-e433-4525-be66-ccf1bbf9a40c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:11:40.099725 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecee3dc-e433-4525-be66-ccf1bbf9a40c admin admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:11:40.100000 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecee3dc-e433-4525-be66-ccf1bbf9a40c admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:11:40.100268 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecee3dc-e433-4525-be66-ccf1bbf9a40c admin admin] PATH_INFO: `/v3/domains` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:11:40.100975 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecee3dc-e433-4525-be66-ccf1bbf9a40c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 22:11:40.101271 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecee3dc-e433-4525-be66-ccf1bbf9a40c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:11:40.102962 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecee3dc-e433-4525-be66-ccf1bbf9a40c admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:11:40.114937 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1404/2771] 10.222.0.27 () {58 vars in 1153 bytes} [Thu Aug 18 22:11:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 22:11:40.119316 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f9c6b9-11c3-4835-bd1a-2dbac30c1472 None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:11:40.129755 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f9c6b9-11c3-4835-bd1a-2dbac30c1472 None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:11:40.134707 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5913226-fb8b-4cc3-b6fc-dbdfc03386bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:11:40.135338 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5913226-fb8b-4cc3-b6fc-dbdfc03386bb admin admin] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:11:40.135619 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5913226-fb8b-4cc3-b6fc-dbdfc03386bb admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:11:40.135894 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5913226-fb8b-4cc3-b6fc-dbdfc03386bb admin admin] PATH_INFO: `/v3/projects` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:11:40.136516 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5913226-fb8b-4cc3-b6fc-dbdfc03386bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:11:40.138805 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5913226-fb8b-4cc3-b6fc-dbdfc03386bb admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:11:40.281515 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1368/2772] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 18 22:11:40 2022] POST /identity/v3/projects => generated 365 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 22:11:40.285644 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecee3dc-e433-4525-be66-ccf1bbf9a40c admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:11:40.295993 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecee3dc-e433-4525-be66-ccf1bbf9a40c admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:11:40.351094 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b8b9ee-796d-4d64-a2c6-3f74fe7323a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:11:40.351687 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b8b9ee-796d-4d64-a2c6-3f74fe7323a7 admin admin] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:11:40.351967 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b8b9ee-796d-4d64-a2c6-3f74fe7323a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:11:40.352241 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b8b9ee-796d-4d64-a2c6-3f74fe7323a7 admin admin] PATH_INFO: `/v3/users` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:11:40.352893 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b8b9ee-796d-4d64-a2c6-3f74fe7323a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:11:40.354796 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b8b9ee-796d-4d64-a2c6-3f74fe7323a7 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:11:40.432703 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1405/2773] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 18 22:11:40 2022] POST /identity/v3/users => generated 283 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 22:11:40.437790 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5913226-fb8b-4cc3-b6fc-dbdfc03386bb admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:11:40.448190 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5913226-fb8b-4cc3-b6fc-dbdfc03386bb admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:11:40.453818 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1c8d74-c77b-42c7-8e7c-25cd1404ef2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:11:40.454457 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1c8d74-c77b-42c7-8e7c-25cd1404ef2f admin admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:11:40.454739 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1c8d74-c77b-42c7-8e7c-25cd1404ef2f admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:11:40.455024 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1c8d74-c77b-42c7-8e7c-25cd1404ef2f admin admin] PATH_INFO: `/v3/roles` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:11:40.455653 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1c8d74-c77b-42c7-8e7c-25cd1404ef2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:11:40.457279 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1c8d74-c77b-42c7-8e7c-25cd1404ef2f admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:11:40.467323 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1369/2774] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:11:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:11:40.471448 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b8b9ee-796d-4d64-a2c6-3f74fe7323a7 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:11:40.481651 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b8b9ee-796d-4d64-a2c6-3f74fe7323a7 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:11:40.486308 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11644b59-d961-492b-af5c-318846f1ff5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:11:40.486899 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11644b59-d961-492b-af5c-318846f1ff5c admin admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:11:40.487201 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11644b59-d961-492b-af5c-318846f1ff5c admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:11:40.487460 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11644b59-d961-492b-af5c-318846f1ff5c admin admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:11:40.488099 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11644b59-d961-492b-af5c-318846f1ff5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:11:40.489733 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11644b59-d961-492b-af5c-318846f1ff5c admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:11:40.500743 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1406/2775] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:11:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 22:11:40.504806 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1c8d74-c77b-42c7-8e7c-25cd1404ef2f admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:11:40.516214 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1c8d74-c77b-42c7-8e7c-25cd1404ef2f admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:11:40.520899 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cbb8f5-a581-4b84-9ff5-7f76a98566e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:11:40.521579 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cbb8f5-a581-4b84-9ff5-7f76a98566e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:11:40.521858 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cbb8f5-a581-4b84-9ff5-7f76a98566e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:11:40.522132 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cbb8f5-a581-4b84-9ff5-7f76a98566e6 admin admin] PATH_INFO: `/v3/projects/91ab59c4bf924715b28da8a91b3b48be/users/d908a00a532546309264620bde0ad0ae/roles/de8f2438056f4af9879423f8a59e0e0b` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:11:40.538310 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cbb8f5-a581-4b84-9ff5-7f76a98566e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91ab59c4bf924715b28da8a91b3b48be, user_id=d908a00a532546309264620bde0ad0ae, role_id=de8f2438056f4af9879423f8a59e0e0b)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:11:40.540906 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cbb8f5-a581-4b84-9ff5-7f76a98566e6 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:11:40.605665 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1370/2776] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 18 22:11:40 2022] PUT /identity/v3/projects/91ab59c4bf924715b28da8a91b3b48be/users/d908a00a532546309264620bde0ad0ae/roles/de8f2438056f4af9879423f8a59e0e0b => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:11:40.615983 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763ca276-3d19-4848-a8c4-7208f60c8300 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:11:40.616302 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763ca276-3d19-4848-a8c4-7208f60c8300 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:11:40.616583 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763ca276-3d19-4848-a8c4-7208f60c8300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:11:40.645094 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-763ca276-3d19-4848-a8c4-7208f60c8300 None None] MFA Rules not processed for user `d908a00a532546309264620bde0ad0ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:11:40.646335 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-763ca276-3d19-4848-a8c4-7208f60c8300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:11:40.709607 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1407/2777] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:11:40 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:11:40.720457 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cbb8f5-a581-4b84-9ff5-7f76a98566e6 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:11:40.722212 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-c6cbb8f5-a581-4b84-9ff5-7f76a98566e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:11:40.727150 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:11:40.801716 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cbb8f5-a581-4b84-9ff5-7f76a98566e6 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:11:40.805344 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fb8851-1f46-46d0-b3cf-86b4326216c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22b6a7c36f8a4795a75271b8079821c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:11:40.805947 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fb8851-1f46-46d0-b3cf-86b4326216c3 service cinder] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:11:40.806313 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fb8851-1f46-46d0-b3cf-86b4326216c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:11:40.806589 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fb8851-1f46-46d0-b3cf-86b4326216c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:11:40.815002 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fb8851-1f46-46d0-b3cf-86b4326216c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:11:40.816421 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fb8851-1f46-46d0-b3cf-86b4326216c3 service cinder] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:11:40.827193 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1371/2778] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:11:40 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:11:50.336422 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763ca276-3d19-4848-a8c4-7208f60c8300 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:11:50.354307 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:11:50.400287 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763ca276-3d19-4848-a8c4-7208f60c8300 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:11:50.405662 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5c9f40-4263-4875-ac99-2e86709262f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:11:50.406356 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5c9f40-4263-4875-ac99-2e86709262f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:11:50.406638 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5c9f40-4263-4875-ac99-2e86709262f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:11:50.406916 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5c9f40-4263-4875-ac99-2e86709262f7 admin admin] PATH_INFO: `/v3/users/d908a00a532546309264620bde0ad0ae` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:11:50.408048 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5c9f40-4263-4875-ac99-2e86709262f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d908a00a532546309264620bde0ad0ae)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:11:50.409995 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5c9f40-4263-4875-ac99-2e86709262f7 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:11:50.592427 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-1c5c9f40-4263-4875-ac99-2e86709262f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd908a00a532546309264620bde0ad0ae'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:11:50.599073 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-1c5c9f40-4263-4875-ac99-2e86709262f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd908a00a532546309264620bde0ad0ae'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:11:50.599716 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-1c5c9f40-4263-4875-ac99-2e86709262f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd908a00a532546309264620bde0ad0ae'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:11:50.612754 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-1c5c9f40-4263-4875-ac99-2e86709262f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd908a00a532546309264620bde0ad0ae'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:11:50.735630 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-1c5c9f40-4263-4875-ac99-2e86709262f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd908a00a532546309264620bde0ad0ae'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:11:50.742103 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1408/2779] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 18 22:11:50 2022] DELETE /identity/v3/users/d908a00a532546309264620bde0ad0ae => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:11:50.746786 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d133c9-1aab-406e-9429-d223fa7b2bf7 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:11:50.747945 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d133c9-1aab-406e-9429-d223fa7b2bf7 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:11:50.747945 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d133c9-1aab-406e-9429-d223fa7b2bf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:11:50.766585 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-b8d133c9-1aab-406e-9429-d223fa7b2bf7 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:11:50.767785 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-b8d133c9-1aab-406e-9429-d223fa7b2bf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:11:50.825246 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1372/2780] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:11:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:11:50.835122 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5c9f40-4263-4875-ac99-2e86709262f7 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:11:50.836510 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-1c5c9f40-4263-4875-ac99-2e86709262f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:11:50.893653 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5c9f40-4263-4875-ac99-2e86709262f7 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:11:50.897264 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d8a14c-a53e-42fb-a6b7-ba8bbf449ecf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a937971ad1a4b0c8697c764f214d446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:11:50.897858 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d8a14c-a53e-42fb-a6b7-ba8bbf449ecf service neutron] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:11:50.898133 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d8a14c-a53e-42fb-a6b7-ba8bbf449ecf service neutron] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:11:50.898403 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d8a14c-a53e-42fb-a6b7-ba8bbf449ecf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:11:50.908041 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d8a14c-a53e-42fb-a6b7-ba8bbf449ecf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:11:50.909501 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d8a14c-a53e-42fb-a6b7-ba8bbf449ecf service neutron] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:11:50.918834 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1409/2781] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:11:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:11:51.337933 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d133c9-1aab-406e-9429-d223fa7b2bf7 None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:11:51.339664 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-b8d133c9-1aab-406e-9429-d223fa7b2bf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:11:51.352792 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d133c9-1aab-406e-9429-d223fa7b2bf7 None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:11:51.357704 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4303f3-b53e-4a20-bed3-5a0a9e90cfaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:11:51.360890 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4303f3-b53e-4a20-bed3-5a0a9e90cfaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:11:51.360890 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4303f3-b53e-4a20-bed3-5a0a9e90cfaf admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:11:51.360890 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4303f3-b53e-4a20-bed3-5a0a9e90cfaf admin admin] PATH_INFO: `/v3/projects/91ab59c4bf924715b28da8a91b3b48be` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:11:51.360890 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4303f3-b53e-4a20-bed3-5a0a9e90cfaf admin admin] RBAC: Authorizing `identity:delete_project(project_id=91ab59c4bf924715b28da8a91b3b48be)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:11:51.362027 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4303f3-b53e-4a20-bed3-5a0a9e90cfaf admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:11:51.479351 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-ba4303f3-b53e-4a20-bed3-5a0a9e90cfaf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91ab59c4bf924715b28da8a91b3b48be', 'request_id': 'req-ba4303f3-b53e-4a20-bed3-5a0a9e90cfaf'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:11:51.484951 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-ba4303f3-b53e-4a20-bed3-5a0a9e90cfaf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91ab59c4bf924715b28da8a91b3b48be', 'request_id': 'req-ba4303f3-b53e-4a20-bed3-5a0a9e90cfaf'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:11:51.564142 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-ba4303f3-b53e-4a20-bed3-5a0a9e90cfaf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91ab59c4bf924715b28da8a91b3b48be', 'request_id': 'req-ba4303f3-b53e-4a20-bed3-5a0a9e90cfaf'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:11:51.575260 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-ba4303f3-b53e-4a20-bed3-5a0a9e90cfaf admin admin] The token cache is being invalidate because project 91ab59c4bf924715b28da8a91b3b48be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88096) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 22:11:51.575547 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-ba4303f3-b53e-4a20-bed3-5a0a9e90cfaf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:11:51.576762 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-ba4303f3-b53e-4a20-bed3-5a0a9e90cfaf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:11:51.578266 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1373/2782] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 18 22:11:51 2022] DELETE /identity/v3/projects/91ab59c4bf924715b28da8a91b3b48be => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:11:51.583099 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3b9c15-2173-4371-b127-f917bd7b4bf7 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:11:51.588563 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3b9c15-2173-4371-b127-f917bd7b4bf7 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:11:51.588563 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3b9c15-2173-4371-b127-f917bd7b4bf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:11:51.603684 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-bd3b9c15-2173-4371-b127-f917bd7b4bf7 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:11:51.605024 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-bd3b9c15-2173-4371-b127-f917bd7b4bf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:11:51.636852 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:11:51.663489 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1410/2783] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:11:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:11:51.672860 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5f0182-b871-43e9-98f7-76eda62ea4d0 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:11:51.673145 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5f0182-b871-43e9-98f7-76eda62ea4d0 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:11:51.673422 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5f0182-b871-43e9-98f7-76eda62ea4d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:11:51.693410 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-6e5f0182-b871-43e9-98f7-76eda62ea4d0 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:11:51.694650 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-6e5f0182-b871-43e9-98f7-76eda62ea4d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:11:51.703466 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1374/2784] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:11:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:11:51.707795 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3b9c15-2173-4371-b127-f917bd7b4bf7 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:11:51.717345 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3b9c15-2173-4371-b127-f917bd7b4bf7 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:11:51.721932 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c8f47c-637f-4c48-940d-aa8be6825b80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:11:51.722514 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c8f47c-637f-4c48-940d-aa8be6825b80 admin admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:11:51.722843 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c8f47c-637f-4c48-940d-aa8be6825b80 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:11:51.723125 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c8f47c-637f-4c48-940d-aa8be6825b80 admin admin] PATH_INFO: `/v3/domains` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:11:51.723978 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c8f47c-637f-4c48-940d-aa8be6825b80 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 22:11:51.724512 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c8f47c-637f-4c48-940d-aa8be6825b80 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:11:51.726497 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c8f47c-637f-4c48-940d-aa8be6825b80 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:11:51.738090 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1411/2785] 10.222.0.27 () {58 vars in 1153 bytes} [Thu Aug 18 22:11:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 22:11:51.742266 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5f0182-b871-43e9-98f7-76eda62ea4d0 None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:11:51.748302 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:11:51.752778 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5f0182-b871-43e9-98f7-76eda62ea4d0 None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:11:51.757384 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa04dd45-addb-4008-947b-d3feeb5e8ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:11:51.758231 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa04dd45-addb-4008-947b-d3feeb5e8ee5 admin admin] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:11:51.758613 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa04dd45-addb-4008-947b-d3feeb5e8ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:11:51.758870 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa04dd45-addb-4008-947b-d3feeb5e8ee5 admin admin] PATH_INFO: `/v3/projects` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:11:51.759491 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa04dd45-addb-4008-947b-d3feeb5e8ee5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:11:51.761429 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa04dd45-addb-4008-947b-d3feeb5e8ee5 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:11:51.845658 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1375/2786] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 18 22:11:51 2022] POST /identity/v3/projects => generated 385 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 22:11:51.849891 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c8f47c-637f-4c48-940d-aa8be6825b80 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:11:51.860021 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c8f47c-637f-4c48-940d-aa8be6825b80 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:11:51.916019 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c24a42-5425-41dc-8f5d-0120cfcade84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:11:51.916641 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c24a42-5425-41dc-8f5d-0120cfcade84 admin admin] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:11:51.916927 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c24a42-5425-41dc-8f5d-0120cfcade84 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:11:51.917203 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c24a42-5425-41dc-8f5d-0120cfcade84 admin admin] PATH_INFO: `/v3/users` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:11:51.917830 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c24a42-5425-41dc-8f5d-0120cfcade84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:11:51.919771 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c24a42-5425-41dc-8f5d-0120cfcade84 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:11:52.002314 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1412/2787] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 18 22:11:51 2022] POST /identity/v3/users => generated 293 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 22:11:52.006466 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa04dd45-addb-4008-947b-d3feeb5e8ee5 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:11:52.016926 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa04dd45-addb-4008-947b-d3feeb5e8ee5 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:11:52.021999 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402f5c2b-325d-456e-8341-42a5da8a4e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:11:52.022603 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402f5c2b-325d-456e-8341-42a5da8a4e87 admin admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:11:52.022930 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402f5c2b-325d-456e-8341-42a5da8a4e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:11:52.023303 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402f5c2b-325d-456e-8341-42a5da8a4e87 admin admin] PATH_INFO: `/v3/roles` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:11:52.023978 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402f5c2b-325d-456e-8341-42a5da8a4e87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:11:52.025703 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402f5c2b-325d-456e-8341-42a5da8a4e87 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:11:52.036122 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1376/2788] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:11:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:11:52.039894 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c24a42-5425-41dc-8f5d-0120cfcade84 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:11:52.050816 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c24a42-5425-41dc-8f5d-0120cfcade84 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:11:52.055509 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ba25a6-d1c9-47ff-9306-b2ba4a6c94fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:11:52.056101 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ba25a6-d1c9-47ff-9306-b2ba4a6c94fa admin admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:11:52.056382 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ba25a6-d1c9-47ff-9306-b2ba4a6c94fa admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:11:52.056697 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ba25a6-d1c9-47ff-9306-b2ba4a6c94fa admin admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:11:52.057344 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ba25a6-d1c9-47ff-9306-b2ba4a6c94fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:11:52.058930 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ba25a6-d1c9-47ff-9306-b2ba4a6c94fa admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:11:52.070004 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1413/2789] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:11:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:11:52.074062 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402f5c2b-325d-456e-8341-42a5da8a4e87 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:11:52.084343 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402f5c2b-325d-456e-8341-42a5da8a4e87 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:11:52.089007 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c8e0cb-37dc-4824-8fcd-902ef78a4730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:11:52.089651 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c8e0cb-37dc-4824-8fcd-902ef78a4730 admin admin] REQUEST_METHOD: `PUT` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:11:52.089932 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c8e0cb-37dc-4824-8fcd-902ef78a4730 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:11:52.090205 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c8e0cb-37dc-4824-8fcd-902ef78a4730 admin admin] PATH_INFO: `/v3/projects/da9a006bf1394d1b8f60c325a3965204/users/3135c9cc589a4089bf34a8a234f04f2f/roles/de8f2438056f4af9879423f8a59e0e0b` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:11:52.104895 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c8e0cb-37dc-4824-8fcd-902ef78a4730 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da9a006bf1394d1b8f60c325a3965204, user_id=3135c9cc589a4089bf34a8a234f04f2f, role_id=de8f2438056f4af9879423f8a59e0e0b)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:11:52.108130 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c8e0cb-37dc-4824-8fcd-902ef78a4730 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:11:52.173370 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1377/2790] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 18 22:11:52 2022] PUT /identity/v3/projects/da9a006bf1394d1b8f60c325a3965204/users/3135c9cc589a4089bf34a8a234f04f2f/roles/de8f2438056f4af9879423f8a59e0e0b => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:11:52.183914 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25783b8-bcfe-4537-8abe-f5dc4fde03a5 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:11:52.184192 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25783b8-bcfe-4537-8abe-f5dc4fde03a5 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:11:52.184464 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25783b8-bcfe-4537-8abe-f5dc4fde03a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:11:52.212821 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-c25783b8-bcfe-4537-8abe-f5dc4fde03a5 None None] MFA Rules not processed for user `3135c9cc589a4089bf34a8a234f04f2f`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:11:52.214019 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-c25783b8-bcfe-4537-8abe-f5dc4fde03a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:11:52.277325 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1414/2791] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:11:52 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:11:52.282098 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c8e0cb-37dc-4824-8fcd-902ef78a4730 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:11:52.343431 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c8e0cb-37dc-4824-8fcd-902ef78a4730 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:11:52.347995 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adda6e6-e073-474b-82b8-be0052d772b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:11:52.348603 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adda6e6-e073-474b-82b8-be0052d772b0 admin admin] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:11:52.348892 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adda6e6-e073-474b-82b8-be0052d772b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:11:52.349159 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adda6e6-e073-474b-82b8-be0052d772b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:11:52.349766 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adda6e6-e073-474b-82b8-be0052d772b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:11:52.351728 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adda6e6-e073-474b-82b8-be0052d772b0 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:11:52.457040 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1378/2792] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 18 22:11:52 2022] POST /identity/v3/projects => generated 383 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 22:11:52.461130 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25783b8-bcfe-4537-8abe-f5dc4fde03a5 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:11:52.472155 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25783b8-bcfe-4537-8abe-f5dc4fde03a5 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:11:52.501504 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:11:52.526543 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cc34d3-cdd4-4278-b245-c3ae4164c043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:11:52.527141 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cc34d3-cdd4-4278-b245-c3ae4164c043 admin admin] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:11:52.527472 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cc34d3-cdd4-4278-b245-c3ae4164c043 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:11:52.527697 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cc34d3-cdd4-4278-b245-c3ae4164c043 admin admin] PATH_INFO: `/v3/users` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:11:52.528331 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cc34d3-cdd4-4278-b245-c3ae4164c043 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:11:52.531247 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cc34d3-cdd4-4278-b245-c3ae4164c043 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:11:52.618504 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1415/2793] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 18 22:11:52 2022] POST /identity/v3/users => generated 298 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 22:11:52.622773 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adda6e6-e073-474b-82b8-be0052d772b0 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:11:52.633285 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adda6e6-e073-474b-82b8-be0052d772b0 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:11:52.637883 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d7440d-387b-4624-b384-c29b6c5e7c66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:11:52.638522 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d7440d-387b-4624-b384-c29b6c5e7c66 admin admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:11:52.638784 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d7440d-387b-4624-b384-c29b6c5e7c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:11:52.639053 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d7440d-387b-4624-b384-c29b6c5e7c66 admin admin] PATH_INFO: `/v3/roles` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:11:52.639682 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d7440d-387b-4624-b384-c29b6c5e7c66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:11:52.641344 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d7440d-387b-4624-b384-c29b6c5e7c66 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:11:52.651563 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1379/2794] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:11:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:11:52.656424 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cc34d3-cdd4-4278-b245-c3ae4164c043 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:11:52.666468 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cc34d3-cdd4-4278-b245-c3ae4164c043 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:11:52.671756 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c712bbd6-e3ab-4ca3-84d9-676c704170cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:11:52.672399 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c712bbd6-e3ab-4ca3-84d9-676c704170cd admin admin] REQUEST_METHOD: `PUT` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:11:52.672713 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c712bbd6-e3ab-4ca3-84d9-676c704170cd admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:11:52.672994 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c712bbd6-e3ab-4ca3-84d9-676c704170cd admin admin] PATH_INFO: `/v3/projects/ac1c66d03a314de1af40756bb9809c6c/users/132f6f81213d4e81b2706b98311a3a22/roles/0833202e2a3d47d1b6b3af57006641b1` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:11:52.688131 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c712bbd6-e3ab-4ca3-84d9-676c704170cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac1c66d03a314de1af40756bb9809c6c, user_id=132f6f81213d4e81b2706b98311a3a22, role_id=0833202e2a3d47d1b6b3af57006641b1)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:11:52.690836 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c712bbd6-e3ab-4ca3-84d9-676c704170cd admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:11:52.784625 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1416/2795] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 18 22:11:52 2022] PUT /identity/v3/projects/ac1c66d03a314de1af40756bb9809c6c/users/132f6f81213d4e81b2706b98311a3a22/roles/0833202e2a3d47d1b6b3af57006641b1 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:11:52.788580 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d7440d-387b-4624-b384-c29b6c5e7c66 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:11:52.799558 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d7440d-387b-4624-b384-c29b6c5e7c66 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:11:52.855687 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861ce139-00c6-4c66-be7a-f5f468ffaa7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:11:52.856296 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861ce139-00c6-4c66-be7a-f5f468ffaa7b admin admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:11:52.856574 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861ce139-00c6-4c66-be7a-f5f468ffaa7b admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:11:52.856876 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861ce139-00c6-4c66-be7a-f5f468ffaa7b admin admin] PATH_INFO: `/v3/roles` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:11:52.858114 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861ce139-00c6-4c66-be7a-f5f468ffaa7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:11:52.860064 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861ce139-00c6-4c66-be7a-f5f468ffaa7b admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:11:52.869987 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1380/2796] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:11:52 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:11:52.874970 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c712bbd6-e3ab-4ca3-84d9-676c704170cd admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:11:52.885869 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c712bbd6-e3ab-4ca3-84d9-676c704170cd admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:11:52.890656 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e025aa-271a-40a4-9d9c-f5ea2721b1a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:11:52.891303 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e025aa-271a-40a4-9d9c-f5ea2721b1a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:11:52.891607 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e025aa-271a-40a4-9d9c-f5ea2721b1a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:11:52.891860 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e025aa-271a-40a4-9d9c-f5ea2721b1a1 admin admin] PATH_INFO: `/v3/projects/ac1c66d03a314de1af40756bb9809c6c/users/132f6f81213d4e81b2706b98311a3a22/roles/0833202e2a3d47d1b6b3af57006641b1` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:11:52.893816 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e025aa-271a-40a4-9d9c-f5ea2721b1a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac1c66d03a314de1af40756bb9809c6c, user_id=132f6f81213d4e81b2706b98311a3a22, role_id=0833202e2a3d47d1b6b3af57006641b1)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:11:52.896440 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e025aa-271a-40a4-9d9c-f5ea2721b1a1 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:11:52.906841 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1417/2797] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 18 22:11:52 2022] PUT /identity/v3/projects/ac1c66d03a314de1af40756bb9809c6c/users/132f6f81213d4e81b2706b98311a3a22/roles/0833202e2a3d47d1b6b3af57006641b1 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:11:52.918446 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3247627-9478-404c-82ff-8644d88058f1 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:11:52.918736 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3247627-9478-404c-82ff-8644d88058f1 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:11:52.919016 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3247627-9478-404c-82ff-8644d88058f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:11:52.948026 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-e3247627-9478-404c-82ff-8644d88058f1 None None] MFA Rules not processed for user `132f6f81213d4e81b2706b98311a3a22`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:11:52.949267 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-e3247627-9478-404c-82ff-8644d88058f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:11:52.954934 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:11:53.018615 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1381/2798] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:11:52 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 22:11:53.029423 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e025aa-271a-40a4-9d9c-f5ea2721b1a1 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:11:53.031161 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-20e025aa-271a-40a4-9d9c-f5ea2721b1a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:11:53.088193 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e025aa-271a-40a4-9d9c-f5ea2721b1a1 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:11:53.092506 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2a0939-2229-4259-a010-bf7e0d6c1287 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22b6a7c36f8a4795a75271b8079821c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:11:53.093162 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2a0939-2229-4259-a010-bf7e0d6c1287 service cinder] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:11:53.093445 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2a0939-2229-4259-a010-bf7e0d6c1287 service cinder] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:11:53.093749 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2a0939-2229-4259-a010-bf7e0d6c1287 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:11:53.149841 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2a0939-2229-4259-a010-bf7e0d6c1287 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:11:53.151269 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2a0939-2229-4259-a010-bf7e0d6c1287 service cinder] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:11:53.160563 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1418/2799] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:11:53 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:11:58.241158 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3247627-9478-404c-82ff-8644d88058f1 None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:11:58.242665 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-e3247627-9478-404c-82ff-8644d88058f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:11:58.255004 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3247627-9478-404c-82ff-8644d88058f1 None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:11:58.258794 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab09ded-2ec1-430f-8f38-a204f23986e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22b6a7c36f8a4795a75271b8079821c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:11:58.259386 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab09ded-2ec1-430f-8f38-a204f23986e8 service cinder] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:11:58.259663 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab09ded-2ec1-430f-8f38-a204f23986e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:11:58.259939 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab09ded-2ec1-430f-8f38-a204f23986e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:11:58.269080 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab09ded-2ec1-430f-8f38-a204f23986e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:11:58.270498 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab09ded-2ec1-430f-8f38-a204f23986e8 service cinder] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:11:58.279754 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1382/2800] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:11:58 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:12:03.156676 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=77,keystone:INSERT=5 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:12:04.013801 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2a0939-2229-4259-a010-bf7e0d6c1287 service cinder] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:12:04.074989 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2a0939-2229-4259-a010-bf7e0d6c1287 service cinder] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:12:04.079853 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21deb97-f362-48e2-9404-14ea6263839a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:12:04.080478 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21deb97-f362-48e2-9404-14ea6263839a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:12:04.080792 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21deb97-f362-48e2-9404-14ea6263839a admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:12:04.081094 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21deb97-f362-48e2-9404-14ea6263839a admin admin] PATH_INFO: `/v3/users/3135c9cc589a4089bf34a8a234f04f2f` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:12:04.082217 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21deb97-f362-48e2-9404-14ea6263839a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3135c9cc589a4089bf34a8a234f04f2f)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:12:04.084174 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21deb97-f362-48e2-9404-14ea6263839a admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:12:04.267011 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-c21deb97-f362-48e2-9404-14ea6263839a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3135c9cc589a4089bf34a8a234f04f2f'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:12:04.274000 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-c21deb97-f362-48e2-9404-14ea6263839a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3135c9cc589a4089bf34a8a234f04f2f'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:12:04.274755 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-c21deb97-f362-48e2-9404-14ea6263839a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3135c9cc589a4089bf34a8a234f04f2f'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:12:04.287374 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-c21deb97-f362-48e2-9404-14ea6263839a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3135c9cc589a4089bf34a8a234f04f2f'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:12:04.352658 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-c21deb97-f362-48e2-9404-14ea6263839a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3135c9cc589a4089bf34a8a234f04f2f'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:12:04.358740 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1419/2801] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 18 22:12:04 2022] DELETE /identity/v3/users/3135c9cc589a4089bf34a8a234f04f2f => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:12:04.364038 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a773330b-1eab-42d4-87e8-a231fd773db9 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:12:04.367734 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a773330b-1eab-42d4-87e8-a231fd773db9 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:12:04.367734 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a773330b-1eab-42d4-87e8-a231fd773db9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:12:04.383248 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-a773330b-1eab-42d4-87e8-a231fd773db9 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:12:04.384435 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-a773330b-1eab-42d4-87e8-a231fd773db9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:12:04.441569 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1383/2802] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:12:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:12:04.451307 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21deb97-f362-48e2-9404-14ea6263839a admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:12:04.452760 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-c21deb97-f362-48e2-9404-14ea6263839a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:12:04.509434 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21deb97-f362-48e2-9404-14ea6263839a admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:12:04.513098 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e394940-7f9a-412e-b231-0fcb86f14606 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a937971ad1a4b0c8697c764f214d446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:12:04.513695 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e394940-7f9a-412e-b231-0fcb86f14606 service neutron] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:12:04.513976 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e394940-7f9a-412e-b231-0fcb86f14606 service neutron] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:12:04.514250 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e394940-7f9a-412e-b231-0fcb86f14606 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:12:04.523787 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e394940-7f9a-412e-b231-0fcb86f14606 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:12:04.525105 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e394940-7f9a-412e-b231-0fcb86f14606 service neutron] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:12:04.535194 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1420/2803] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:12:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:12:04.940044 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a773330b-1eab-42d4-87e8-a231fd773db9 None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:12:04.941533 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-a773330b-1eab-42d4-87e8-a231fd773db9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:12:04.953577 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a773330b-1eab-42d4-87e8-a231fd773db9 None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:12:04.959909 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d70c9c-3136-4916-ab86-43f60a6d2d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:12:04.960552 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d70c9c-3136-4916-ab86-43f60a6d2d7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:12:04.960960 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d70c9c-3136-4916-ab86-43f60a6d2d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:12:04.961238 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d70c9c-3136-4916-ab86-43f60a6d2d7c admin admin] PATH_INFO: `/v3/projects/da9a006bf1394d1b8f60c325a3965204` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:12:04.962506 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d70c9c-3136-4916-ab86-43f60a6d2d7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=da9a006bf1394d1b8f60c325a3965204)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:12:04.964481 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d70c9c-3136-4916-ab86-43f60a6d2d7c admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:12:05.059577 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-a6d70c9c-3136-4916-ab86-43f60a6d2d7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da9a006bf1394d1b8f60c325a3965204', 'request_id': 'req-a6d70c9c-3136-4916-ab86-43f60a6d2d7c'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:12:05.065757 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-a6d70c9c-3136-4916-ab86-43f60a6d2d7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da9a006bf1394d1b8f60c325a3965204', 'request_id': 'req-a6d70c9c-3136-4916-ab86-43f60a6d2d7c'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:12:05.141084 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-a6d70c9c-3136-4916-ab86-43f60a6d2d7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da9a006bf1394d1b8f60c325a3965204', 'request_id': 'req-a6d70c9c-3136-4916-ab86-43f60a6d2d7c'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:12:05.153082 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-a6d70c9c-3136-4916-ab86-43f60a6d2d7c admin admin] The token cache is being invalidate because project da9a006bf1394d1b8f60c325a3965204 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88096) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 22:12:05.153373 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-a6d70c9c-3136-4916-ab86-43f60a6d2d7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:12:05.154021 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-a6d70c9c-3136-4916-ab86-43f60a6d2d7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:12:05.155623 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1384/2804] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 18 22:12:04 2022] DELETE /identity/v3/projects/da9a006bf1394d1b8f60c325a3965204 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:12:05.159681 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e394940-7f9a-412e-b231-0fcb86f14606 service neutron] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:12:05.169440 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e394940-7f9a-412e-b231-0fcb86f14606 service neutron] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:12:05.187115 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:12:05.226557 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f47670b-8d74-4bd7-87ee-0eb78c360d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:12:05.227178 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f47670b-8d74-4bd7-87ee-0eb78c360d52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:12:05.227459 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f47670b-8d74-4bd7-87ee-0eb78c360d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:12:05.227732 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f47670b-8d74-4bd7-87ee-0eb78c360d52 admin admin] PATH_INFO: `/v3/users/132f6f81213d4e81b2706b98311a3a22` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:12:05.228901 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f47670b-8d74-4bd7-87ee-0eb78c360d52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=132f6f81213d4e81b2706b98311a3a22)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:12:05.230867 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f47670b-8d74-4bd7-87ee-0eb78c360d52 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:12:05.426672 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-8f47670b-8d74-4bd7-87ee-0eb78c360d52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '132f6f81213d4e81b2706b98311a3a22'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:12:05.433534 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-8f47670b-8d74-4bd7-87ee-0eb78c360d52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '132f6f81213d4e81b2706b98311a3a22'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:12:05.434197 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-8f47670b-8d74-4bd7-87ee-0eb78c360d52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '132f6f81213d4e81b2706b98311a3a22'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:12:05.446750 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-8f47670b-8d74-4bd7-87ee-0eb78c360d52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '132f6f81213d4e81b2706b98311a3a22'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:12:05.535525 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-8f47670b-8d74-4bd7-87ee-0eb78c360d52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '132f6f81213d4e81b2706b98311a3a22'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:12:05.541781 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1421/2805] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 18 22:12:05 2022] DELETE /identity/v3/users/132f6f81213d4e81b2706b98311a3a22 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:12:05.917393 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d70c9c-3136-4916-ab86-43f60a6d2d7c admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:12:05.918857 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-a6d70c9c-3136-4916-ab86-43f60a6d2d7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:12:05.936259 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d70c9c-3136-4916-ab86-43f60a6d2d7c admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:12:05.949015 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:12:05.995087 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f76f885-d7ee-43ae-ae23-98c55c9cb6e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:12:05.995721 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f76f885-d7ee-43ae-ae23-98c55c9cb6e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:12:05.996002 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f76f885-d7ee-43ae-ae23-98c55c9cb6e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:12:05.996311 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f76f885-d7ee-43ae-ae23-98c55c9cb6e0 admin admin] PATH_INFO: `/v3/projects/ac1c66d03a314de1af40756bb9809c6c` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:12:05.997477 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f76f885-d7ee-43ae-ae23-98c55c9cb6e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac1c66d03a314de1af40756bb9809c6c)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:12:05.999375 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f76f885-d7ee-43ae-ae23-98c55c9cb6e0 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:12:06.133281 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-3f76f885-d7ee-43ae-ae23-98c55c9cb6e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac1c66d03a314de1af40756bb9809c6c', 'request_id': 'req-3f76f885-d7ee-43ae-ae23-98c55c9cb6e0'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:12:06.138571 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-3f76f885-d7ee-43ae-ae23-98c55c9cb6e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac1c66d03a314de1af40756bb9809c6c', 'request_id': 'req-3f76f885-d7ee-43ae-ae23-98c55c9cb6e0'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:12:06.209797 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-3f76f885-d7ee-43ae-ae23-98c55c9cb6e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac1c66d03a314de1af40756bb9809c6c', 'request_id': 'req-3f76f885-d7ee-43ae-ae23-98c55c9cb6e0'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:12:06.222005 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-3f76f885-d7ee-43ae-ae23-98c55c9cb6e0 admin admin] The token cache is being invalidate because project ac1c66d03a314de1af40756bb9809c6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88096) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 22:12:06.222298 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-3f76f885-d7ee-43ae-ae23-98c55c9cb6e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:12:06.222939 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-3f76f885-d7ee-43ae-ae23-98c55c9cb6e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:12:06.224431 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1385/2806] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 18 22:12:05 2022] DELETE /identity/v3/projects/ac1c66d03a314de1af40756bb9809c6c => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:12:06.230377 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdfc72b-ef24-4568-bec4-1e7f4e9b96d9 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:12:06.230667 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdfc72b-ef24-4568-bec4-1e7f4e9b96d9 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:12:06.230942 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdfc72b-ef24-4568-bec4-1e7f4e9b96d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:12:06.250262 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-9bdfc72b-ef24-4568-bec4-1e7f4e9b96d9 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:12:06.251484 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-9bdfc72b-ef24-4568-bec4-1e7f4e9b96d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:12:06.310891 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1422/2807] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:12:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:12:06.319539 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a49753-5a6c-42a7-9764-40f29d540e09 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:12:06.319870 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a49753-5a6c-42a7-9764-40f29d540e09 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:12:06.320149 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a49753-5a6c-42a7-9764-40f29d540e09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:12:06.339892 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-f7a49753-5a6c-42a7-9764-40f29d540e09 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:12:06.341139 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-f7a49753-5a6c-42a7-9764-40f29d540e09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:12:06.349679 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1386/2808] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:12:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:12:06.353905 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdfc72b-ef24-4568-bec4-1e7f4e9b96d9 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:12:06.364438 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdfc72b-ef24-4568-bec4-1e7f4e9b96d9 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:12:06.369649 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822be503-52ef-4228-9dff-73cb0ebac792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:12:06.370245 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822be503-52ef-4228-9dff-73cb0ebac792 admin admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:12:06.370524 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822be503-52ef-4228-9dff-73cb0ebac792 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:12:06.370797 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822be503-52ef-4228-9dff-73cb0ebac792 admin admin] PATH_INFO: `/v3/domains` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:12:06.371451 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822be503-52ef-4228-9dff-73cb0ebac792 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 22:12:06.371826 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822be503-52ef-4228-9dff-73cb0ebac792 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:12:06.373801 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822be503-52ef-4228-9dff-73cb0ebac792 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:12:06.385807 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1423/2809] 10.222.0.27 () {58 vars in 1153 bytes} [Thu Aug 18 22:12:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 22:12:06.390254 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a49753-5a6c-42a7-9764-40f29d540e09 None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:12:06.400105 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a49753-5a6c-42a7-9764-40f29d540e09 None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:12:06.404743 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c555be-3339-46c1-825c-d7c5317dd84a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:12:06.405336 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c555be-3339-46c1-825c-d7c5317dd84a admin admin] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:12:06.405615 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c555be-3339-46c1-825c-d7c5317dd84a admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:12:06.405885 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c555be-3339-46c1-825c-d7c5317dd84a admin admin] PATH_INFO: `/v3/projects` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:12:06.406509 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c555be-3339-46c1-825c-d7c5317dd84a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:12:06.409107 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c555be-3339-46c1-825c-d7c5317dd84a admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:12:06.502475 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1387/2810] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 18 22:12:06 2022] POST /identity/v3/projects => generated 385 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 22:12:06.506573 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822be503-52ef-4228-9dff-73cb0ebac792 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:12:06.517647 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822be503-52ef-4228-9dff-73cb0ebac792 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:12:06.544446 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:12:06.574497 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4e8f2b-5031-460a-8f67-21ff54fdc422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:12:06.575283 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4e8f2b-5031-460a-8f67-21ff54fdc422 admin admin] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:12:06.575625 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4e8f2b-5031-460a-8f67-21ff54fdc422 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:12:06.576105 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4e8f2b-5031-460a-8f67-21ff54fdc422 admin admin] PATH_INFO: `/v3/users` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:12:06.577221 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4e8f2b-5031-460a-8f67-21ff54fdc422 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:12:06.579885 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4e8f2b-5031-460a-8f67-21ff54fdc422 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:12:06.650024 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1424/2811] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 18 22:12:06 2022] POST /identity/v3/users => generated 293 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 22:12:06.654124 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c555be-3339-46c1-825c-d7c5317dd84a admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:12:06.664966 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c555be-3339-46c1-825c-d7c5317dd84a admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:12:06.669540 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f2f6ff-6f23-4183-8617-2d337a24656d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:12:06.670127 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f2f6ff-6f23-4183-8617-2d337a24656d admin admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:12:06.670401 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f2f6ff-6f23-4183-8617-2d337a24656d admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:12:06.670669 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f2f6ff-6f23-4183-8617-2d337a24656d admin admin] PATH_INFO: `/v3/roles` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:12:06.671303 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f2f6ff-6f23-4183-8617-2d337a24656d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:12:06.673583 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f2f6ff-6f23-4183-8617-2d337a24656d admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:12:06.683651 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1388/2812] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:12:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:12:06.687657 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4e8f2b-5031-460a-8f67-21ff54fdc422 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:12:06.698344 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4e8f2b-5031-460a-8f67-21ff54fdc422 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:12:06.703004 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9e96f0-7ade-4499-98c7-eeb56394b0e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:12:06.703596 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9e96f0-7ade-4499-98c7-eeb56394b0e1 admin admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:12:06.703874 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9e96f0-7ade-4499-98c7-eeb56394b0e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:12:06.704766 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9e96f0-7ade-4499-98c7-eeb56394b0e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:12:06.705418 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9e96f0-7ade-4499-98c7-eeb56394b0e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:12:06.707009 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9e96f0-7ade-4499-98c7-eeb56394b0e1 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:12:06.717438 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1425/2813] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:12:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:12:06.721778 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f2f6ff-6f23-4183-8617-2d337a24656d admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:12:06.731534 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f2f6ff-6f23-4183-8617-2d337a24656d admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:12:06.736144 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b551e2b4-55e7-4403-b147-fb6d1213fceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:12:06.736806 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b551e2b4-55e7-4403-b147-fb6d1213fceb admin admin] REQUEST_METHOD: `PUT` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:12:06.737086 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b551e2b4-55e7-4403-b147-fb6d1213fceb admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:12:06.737357 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b551e2b4-55e7-4403-b147-fb6d1213fceb admin admin] PATH_INFO: `/v3/projects/f958c5ee7f564713a2c02e1835250f46/users/08d3a89c67954c0bae633b963a1ea57c/roles/de8f2438056f4af9879423f8a59e0e0b` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:12:06.751855 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b551e2b4-55e7-4403-b147-fb6d1213fceb admin admin] RBAC: Authorizing `identity:create_grant(project_id=f958c5ee7f564713a2c02e1835250f46, user_id=08d3a89c67954c0bae633b963a1ea57c, role_id=de8f2438056f4af9879423f8a59e0e0b)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:12:06.754645 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b551e2b4-55e7-4403-b147-fb6d1213fceb admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:12:06.836235 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1389/2814] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 18 22:12:06 2022] PUT /identity/v3/projects/f958c5ee7f564713a2c02e1835250f46/users/08d3a89c67954c0bae633b963a1ea57c/roles/de8f2438056f4af9879423f8a59e0e0b => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:12:06.847876 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb565e6c-5fef-40d7-bf08-4b1334fe338e None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:12:06.848165 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb565e6c-5fef-40d7-bf08-4b1334fe338e None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:12:06.848441 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb565e6c-5fef-40d7-bf08-4b1334fe338e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:12:06.876106 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-eb565e6c-5fef-40d7-bf08-4b1334fe338e None None] MFA Rules not processed for user `08d3a89c67954c0bae633b963a1ea57c`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:12:06.877348 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-eb565e6c-5fef-40d7-bf08-4b1334fe338e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:12:06.941560 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1426/2815] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:12:06 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:12:06.946237 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b551e2b4-55e7-4403-b147-fb6d1213fceb admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:12:06.989300 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:12:07.008677 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b551e2b4-55e7-4403-b147-fb6d1213fceb admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:12:07.013265 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12551d92-e025-4514-b8de-273c9374b934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:12:07.013874 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12551d92-e025-4514-b8de-273c9374b934 admin admin] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:12:07.014201 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12551d92-e025-4514-b8de-273c9374b934 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:12:07.014468 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12551d92-e025-4514-b8de-273c9374b934 admin admin] PATH_INFO: `/v3/projects` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:12:07.015086 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12551d92-e025-4514-b8de-273c9374b934 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:12:07.017539 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12551d92-e025-4514-b8de-273c9374b934 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:12:07.125266 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1390/2816] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 18 22:12:06 2022] POST /identity/v3/projects => generated 383 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 22:12:07.129499 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb565e6c-5fef-40d7-bf08-4b1334fe338e None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:12:07.140448 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb565e6c-5fef-40d7-bf08-4b1334fe338e None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:12:07.197019 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f97892-eec6-4edb-94c9-028c55ee2d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:12:07.197614 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f97892-eec6-4edb-94c9-028c55ee2d62 admin admin] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:12:07.197895 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f97892-eec6-4edb-94c9-028c55ee2d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:12:07.198162 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f97892-eec6-4edb-94c9-028c55ee2d62 admin admin] PATH_INFO: `/v3/users` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:12:07.198799 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f97892-eec6-4edb-94c9-028c55ee2d62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:12:07.200696 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f97892-eec6-4edb-94c9-028c55ee2d62 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:12:07.319081 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1427/2817] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 18 22:12:07 2022] POST /identity/v3/users => generated 292 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 22:12:07.323316 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12551d92-e025-4514-b8de-273c9374b934 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:12:07.334264 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12551d92-e025-4514-b8de-273c9374b934 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:12:07.338913 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0d9b00-a06b-41f9-84dc-c1347da4a75e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:12:07.339506 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0d9b00-a06b-41f9-84dc-c1347da4a75e admin admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:12:07.339781 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0d9b00-a06b-41f9-84dc-c1347da4a75e admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:12:07.340052 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0d9b00-a06b-41f9-84dc-c1347da4a75e admin admin] PATH_INFO: `/v3/roles` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:12:07.340716 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0d9b00-a06b-41f9-84dc-c1347da4a75e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:12:07.342287 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0d9b00-a06b-41f9-84dc-c1347da4a75e admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:12:07.352010 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1391/2818] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:12:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:12:07.355941 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f97892-eec6-4edb-94c9-028c55ee2d62 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:12:07.365967 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f97892-eec6-4edb-94c9-028c55ee2d62 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:12:07.370513 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494b2189-b9d9-4a0e-9cb2-fb91b018dbeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:12:07.371093 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494b2189-b9d9-4a0e-9cb2-fb91b018dbeb admin admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:12:07.371372 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494b2189-b9d9-4a0e-9cb2-fb91b018dbeb admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:12:07.371642 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494b2189-b9d9-4a0e-9cb2-fb91b018dbeb admin admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:12:07.372275 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494b2189-b9d9-4a0e-9cb2-fb91b018dbeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:12:07.373923 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494b2189-b9d9-4a0e-9cb2-fb91b018dbeb admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:12:07.384539 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1428/2819] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:12:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:12:07.388698 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0d9b00-a06b-41f9-84dc-c1347da4a75e admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:12:07.399124 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0d9b00-a06b-41f9-84dc-c1347da4a75e admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:12:07.403620 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d976ddb-a52b-4321-a773-74b38ffc8449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:12:07.404253 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d976ddb-a52b-4321-a773-74b38ffc8449 admin admin] REQUEST_METHOD: `PUT` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:12:07.404529 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d976ddb-a52b-4321-a773-74b38ffc8449 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:12:07.404829 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d976ddb-a52b-4321-a773-74b38ffc8449 admin admin] PATH_INFO: `/v3/projects/abd9c9ddf892475b9c83bba11d0b794a/users/ca5e240824264c979d98aa05d72d7226/roles/de8f2438056f4af9879423f8a59e0e0b` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:12:07.420310 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d976ddb-a52b-4321-a773-74b38ffc8449 admin admin] RBAC: Authorizing `identity:create_grant(project_id=abd9c9ddf892475b9c83bba11d0b794a, user_id=ca5e240824264c979d98aa05d72d7226, role_id=de8f2438056f4af9879423f8a59e0e0b)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:12:07.422976 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d976ddb-a52b-4321-a773-74b38ffc8449 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:12:07.501588 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1392/2820] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 18 22:12:07 2022] PUT /identity/v3/projects/abd9c9ddf892475b9c83bba11d0b794a/users/ca5e240824264c979d98aa05d72d7226/roles/de8f2438056f4af9879423f8a59e0e0b => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 22:12:07.565211 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5338d22-f16d-40df-b0a4-8b173028b59e None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:12:07.565758 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5338d22-f16d-40df-b0a4-8b173028b59e None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:12:07.565758 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5338d22-f16d-40df-b0a4-8b173028b59e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:12:07.593523 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-b5338d22-f16d-40df-b0a4-8b173028b59e None None] MFA Rules not processed for user `ca5e240824264c979d98aa05d72d7226`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:12:07.594758 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-b5338d22-f16d-40df-b0a4-8b173028b59e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:12:07.598642 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:12:07.659768 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1429/2821] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:12:07 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:12:07.664491 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d976ddb-a52b-4321-a773-74b38ffc8449 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:12:07.726954 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d976ddb-a52b-4321-a773-74b38ffc8449 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:12:07.731691 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb469472-8090-4815-9b42-47ebe6633f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:12:07.732292 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb469472-8090-4815-9b42-47ebe6633f8b admin admin] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:12:07.732574 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb469472-8090-4815-9b42-47ebe6633f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:12:07.732882 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb469472-8090-4815-9b42-47ebe6633f8b admin admin] PATH_INFO: `/v3/projects` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:12:07.733500 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb469472-8090-4815-9b42-47ebe6633f8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:12:07.735904 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb469472-8090-4815-9b42-47ebe6633f8b admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:12:07.805851 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1393/2822] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 18 22:12:07 2022] POST /identity/v3/projects => generated 385 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 22:12:07.809941 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5338d22-f16d-40df-b0a4-8b173028b59e None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:12:07.821480 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5338d22-f16d-40df-b0a4-8b173028b59e None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:12:07.877170 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc63793d-0bef-4bee-b8bf-6c23a358dbbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:12:07.877880 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc63793d-0bef-4bee-b8bf-6c23a358dbbd admin admin] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:12:07.878165 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc63793d-0bef-4bee-b8bf-6c23a358dbbd admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:12:07.878443 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc63793d-0bef-4bee-b8bf-6c23a358dbbd admin admin] PATH_INFO: `/v3/users` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:12:07.879079 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc63793d-0bef-4bee-b8bf-6c23a358dbbd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:12:07.881090 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc63793d-0bef-4bee-b8bf-6c23a358dbbd admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:12:08.005276 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1430/2823] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 18 22:12:07 2022] POST /identity/v3/users => generated 299 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 22:12:08.009590 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb469472-8090-4815-9b42-47ebe6633f8b admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:12:08.019956 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb469472-8090-4815-9b42-47ebe6633f8b admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:12:08.024572 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d685e76c-4024-491d-b312-78d1e6122915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:12:08.025200 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d685e76c-4024-491d-b312-78d1e6122915 admin admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:12:08.025478 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d685e76c-4024-491d-b312-78d1e6122915 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:12:08.025747 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d685e76c-4024-491d-b312-78d1e6122915 admin admin] PATH_INFO: `/v3/roles` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:12:08.026382 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d685e76c-4024-491d-b312-78d1e6122915 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:12:08.027986 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d685e76c-4024-491d-b312-78d1e6122915 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:12:08.039254 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1394/2824] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:12:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:12:08.043574 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc63793d-0bef-4bee-b8bf-6c23a358dbbd admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:12:08.054398 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc63793d-0bef-4bee-b8bf-6c23a358dbbd admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:12:08.059055 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab74ad52-b321-4371-bd6d-88d95b3bd269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:12:08.059701 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab74ad52-b321-4371-bd6d-88d95b3bd269 admin admin] REQUEST_METHOD: `PUT` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:12:08.059983 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab74ad52-b321-4371-bd6d-88d95b3bd269 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:12:08.060258 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab74ad52-b321-4371-bd6d-88d95b3bd269 admin admin] PATH_INFO: `/v3/projects/e88c42e614b14cf4a6810ced19eb2fde/users/f60443c1c7954b0aafa0e858bacc4659/roles/0833202e2a3d47d1b6b3af57006641b1` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:12:08.074787 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab74ad52-b321-4371-bd6d-88d95b3bd269 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e88c42e614b14cf4a6810ced19eb2fde, user_id=f60443c1c7954b0aafa0e858bacc4659, role_id=0833202e2a3d47d1b6b3af57006641b1)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:12:08.077433 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab74ad52-b321-4371-bd6d-88d95b3bd269 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:12:08.147019 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1431/2825] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 18 22:12:08 2022] PUT /identity/v3/projects/e88c42e614b14cf4a6810ced19eb2fde/users/f60443c1c7954b0aafa0e858bacc4659/roles/0833202e2a3d47d1b6b3af57006641b1 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:12:08.151151 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d685e76c-4024-491d-b312-78d1e6122915 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:12:08.161980 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d685e76c-4024-491d-b312-78d1e6122915 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:12:08.216967 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6a8f9d-fc1e-4470-be1c-eb471fcabd3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:12:08.217551 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6a8f9d-fc1e-4470-be1c-eb471fcabd3b admin admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:12:08.217828 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6a8f9d-fc1e-4470-be1c-eb471fcabd3b admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:12:08.218098 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6a8f9d-fc1e-4470-be1c-eb471fcabd3b admin admin] PATH_INFO: `/v3/roles` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:12:08.218734 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6a8f9d-fc1e-4470-be1c-eb471fcabd3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:12:08.220881 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6a8f9d-fc1e-4470-be1c-eb471fcabd3b admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:12:08.225832 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:12:08.230661 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1395/2826] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:12:08 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:12:08.236629 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab74ad52-b321-4371-bd6d-88d95b3bd269 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:12:08.245980 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab74ad52-b321-4371-bd6d-88d95b3bd269 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:12:08.250636 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd4d0a6-31df-4805-9122-5af41608fa2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:12:08.251283 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd4d0a6-31df-4805-9122-5af41608fa2a admin admin] REQUEST_METHOD: `PUT` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:12:08.251567 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd4d0a6-31df-4805-9122-5af41608fa2a admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:12:08.251837 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd4d0a6-31df-4805-9122-5af41608fa2a admin admin] PATH_INFO: `/v3/projects/e88c42e614b14cf4a6810ced19eb2fde/users/f60443c1c7954b0aafa0e858bacc4659/roles/0833202e2a3d47d1b6b3af57006641b1` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:12:08.253844 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd4d0a6-31df-4805-9122-5af41608fa2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e88c42e614b14cf4a6810ced19eb2fde, user_id=f60443c1c7954b0aafa0e858bacc4659, role_id=0833202e2a3d47d1b6b3af57006641b1)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:12:08.256462 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd4d0a6-31df-4805-9122-5af41608fa2a admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:12:08.267297 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1432/2827] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 18 22:12:08 2022] PUT /identity/v3/projects/e88c42e614b14cf4a6810ced19eb2fde/users/f60443c1c7954b0aafa0e858bacc4659/roles/0833202e2a3d47d1b6b3af57006641b1 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:12:08.277342 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b648c04-6a97-415c-ba38-7cc0c891a141 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:12:08.277630 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b648c04-6a97-415c-ba38-7cc0c891a141 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:12:08.277905 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b648c04-6a97-415c-ba38-7cc0c891a141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:12:08.306008 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-5b648c04-6a97-415c-ba38-7cc0c891a141 None None] MFA Rules not processed for user `f60443c1c7954b0aafa0e858bacc4659`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:12:08.307205 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-5b648c04-6a97-415c-ba38-7cc0c891a141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:12:08.374547 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1396/2828] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:12:08 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:12:08.386475 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd4d0a6-31df-4805-9122-5af41608fa2a admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:12:08.388231 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-dbd4d0a6-31df-4805-9122-5af41608fa2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:12:08.445006 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd4d0a6-31df-4805-9122-5af41608fa2a admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:12:08.449190 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e366c5-0cb1-4cc4-9654-be3be337153e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22b6a7c36f8a4795a75271b8079821c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:12:08.449791 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e366c5-0cb1-4cc4-9654-be3be337153e service cinder] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:12:08.450070 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e366c5-0cb1-4cc4-9654-be3be337153e service cinder] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:12:08.450348 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e366c5-0cb1-4cc4-9654-be3be337153e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:12:08.459979 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:12:08.505643 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e366c5-0cb1-4cc4-9654-be3be337153e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:12:08.507090 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e366c5-0cb1-4cc4-9654-be3be337153e service cinder] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:12:08.516083 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1433/2829] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:12:08 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:12:10.437804 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b648c04-6a97-415c-ba38-7cc0c891a141 None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:12:10.439330 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-5b648c04-6a97-415c-ba38-7cc0c891a141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:12:10.451231 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b648c04-6a97-415c-ba38-7cc0c891a141 None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:12:10.454921 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9214563-7ed8-4b7b-8313-09e482f40b2b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22b6a7c36f8a4795a75271b8079821c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:12:10.455506 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9214563-7ed8-4b7b-8313-09e482f40b2b service cinder] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:12:10.455785 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9214563-7ed8-4b7b-8313-09e482f40b2b service cinder] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:12:10.456052 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9214563-7ed8-4b7b-8313-09e482f40b2b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:12:10.512072 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9214563-7ed8-4b7b-8313-09e482f40b2b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:12:10.513547 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9214563-7ed8-4b7b-8313-09e482f40b2b service cinder] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:12:10.522424 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1397/2830] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:12:10 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:12:11.908781 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e366c5-0cb1-4cc4-9654-be3be337153e service cinder] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:12:11.917535 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e366c5-0cb1-4cc4-9654-be3be337153e service cinder] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:12:11.921321 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae89a07-952e-450d-a125-6c99c1f07968 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22b6a7c36f8a4795a75271b8079821c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:12:11.921911 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae89a07-952e-450d-a125-6c99c1f07968 service cinder] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:12:11.922186 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae89a07-952e-450d-a125-6c99c1f07968 service cinder] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:12:11.922528 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae89a07-952e-450d-a125-6c99c1f07968 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:12:11.933512 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae89a07-952e-450d-a125-6c99c1f07968 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:12:11.935062 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae89a07-952e-450d-a125-6c99c1f07968 service cinder] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:12:11.944646 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1434/2831] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:12:11 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:12:16.514696 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9214563-7ed8-4b7b-8313-09e482f40b2b service cinder] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:12:16.578506 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9214563-7ed8-4b7b-8313-09e482f40b2b service cinder] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:12:16.583130 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e29e21-8997-4153-867e-f8989ddf65fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:12:16.583746 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e29e21-8997-4153-867e-f8989ddf65fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:12:16.584029 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e29e21-8997-4153-867e-f8989ddf65fa admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:12:16.584301 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e29e21-8997-4153-867e-f8989ddf65fa admin admin] PATH_INFO: `/v3/users/08d3a89c67954c0bae633b963a1ea57c` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:12:16.585542 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e29e21-8997-4153-867e-f8989ddf65fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=08d3a89c67954c0bae633b963a1ea57c)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:12:16.587447 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e29e21-8997-4153-867e-f8989ddf65fa admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:12:16.687643 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:12:16.782917 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-99e29e21-8997-4153-867e-f8989ddf65fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08d3a89c67954c0bae633b963a1ea57c'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:12:16.790402 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-99e29e21-8997-4153-867e-f8989ddf65fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08d3a89c67954c0bae633b963a1ea57c'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:12:16.791067 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-99e29e21-8997-4153-867e-f8989ddf65fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08d3a89c67954c0bae633b963a1ea57c'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:12:16.791683 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-99e29e21-8997-4153-867e-f8989ddf65fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08d3a89c67954c0bae633b963a1ea57c'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:12:16.803942 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-99e29e21-8997-4153-867e-f8989ddf65fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08d3a89c67954c0bae633b963a1ea57c'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:12:16.872097 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1398/2832] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 18 22:12:16 2022] DELETE /identity/v3/users/08d3a89c67954c0bae633b963a1ea57c => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:12:16.876696 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca45732-572d-47ef-9ef7-6d5098f4b306 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:12:16.877205 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca45732-572d-47ef-9ef7-6d5098f4b306 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:12:16.877383 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca45732-572d-47ef-9ef7-6d5098f4b306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:12:16.896949 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-8ca45732-572d-47ef-9ef7-6d5098f4b306 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:12:16.899265 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-8ca45732-572d-47ef-9ef7-6d5098f4b306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:12:16.956574 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1435/2833] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:12:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:12:16.966273 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e29e21-8997-4153-867e-f8989ddf65fa admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:12:16.967695 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-99e29e21-8997-4153-867e-f8989ddf65fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:12:17.027171 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e29e21-8997-4153-867e-f8989ddf65fa admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:12:17.030847 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a249667-01f4-4586-846c-114990d5fea1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a937971ad1a4b0c8697c764f214d446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:12:17.031448 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a249667-01f4-4586-846c-114990d5fea1 service neutron] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:12:17.031725 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a249667-01f4-4586-846c-114990d5fea1 service neutron] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:12:17.031999 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a249667-01f4-4586-846c-114990d5fea1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:12:17.041147 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a249667-01f4-4586-846c-114990d5fea1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:12:17.042580 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a249667-01f4-4586-846c-114990d5fea1 service neutron] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:12:17.052278 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1399/2834] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:12:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:12:17.451109 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca45732-572d-47ef-9ef7-6d5098f4b306 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:12:17.452731 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-8ca45732-572d-47ef-9ef7-6d5098f4b306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:12:17.467118 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca45732-572d-47ef-9ef7-6d5098f4b306 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:12:17.472113 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd950b4c-6f82-4611-b3de-8c8842759c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:12:17.473311 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd950b4c-6f82-4611-b3de-8c8842759c6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:12:17.473604 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd950b4c-6f82-4611-b3de-8c8842759c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:12:17.474055 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd950b4c-6f82-4611-b3de-8c8842759c6d admin admin] PATH_INFO: `/v3/projects/f958c5ee7f564713a2c02e1835250f46` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:12:17.475302 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd950b4c-6f82-4611-b3de-8c8842759c6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f958c5ee7f564713a2c02e1835250f46)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:12:17.477293 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd950b4c-6f82-4611-b3de-8c8842759c6d admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:12:17.627807 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-cd950b4c-6f82-4611-b3de-8c8842759c6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f958c5ee7f564713a2c02e1835250f46', 'request_id': 'req-cd950b4c-6f82-4611-b3de-8c8842759c6d'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:12:17.633771 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-cd950b4c-6f82-4611-b3de-8c8842759c6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f958c5ee7f564713a2c02e1835250f46', 'request_id': 'req-cd950b4c-6f82-4611-b3de-8c8842759c6d'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:12:17.712454 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-cd950b4c-6f82-4611-b3de-8c8842759c6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f958c5ee7f564713a2c02e1835250f46', 'request_id': 'req-cd950b4c-6f82-4611-b3de-8c8842759c6d'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:12:17.724200 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-cd950b4c-6f82-4611-b3de-8c8842759c6d admin admin] The token cache is being invalidate because project f958c5ee7f564713a2c02e1835250f46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88097) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 22:12:17.724491 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-cd950b4c-6f82-4611-b3de-8c8842759c6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:12:17.730859 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-cd950b4c-6f82-4611-b3de-8c8842759c6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:12:17.730859 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1436/2835] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 18 22:12:17 2022] DELETE /identity/v3/projects/f958c5ee7f564713a2c02e1835250f46 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:12:17.731057 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a249667-01f4-4586-846c-114990d5fea1 service neutron] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:12:17.741353 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a249667-01f4-4586-846c-114990d5fea1 service neutron] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:12:17.797285 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a631ad48-5f72-4c0b-8ffa-bd88432976d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:12:17.797942 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a631ad48-5f72-4c0b-8ffa-bd88432976d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:12:17.798227 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a631ad48-5f72-4c0b-8ffa-bd88432976d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:12:17.798536 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a631ad48-5f72-4c0b-8ffa-bd88432976d2 admin admin] PATH_INFO: `/v3/users/ca5e240824264c979d98aa05d72d7226` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:12:17.800485 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a631ad48-5f72-4c0b-8ffa-bd88432976d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca5e240824264c979d98aa05d72d7226)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:12:17.802445 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a631ad48-5f72-4c0b-8ffa-bd88432976d2 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:12:18.009331 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-a631ad48-5f72-4c0b-8ffa-bd88432976d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca5e240824264c979d98aa05d72d7226'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:12:18.010460 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:12:18.016658 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-a631ad48-5f72-4c0b-8ffa-bd88432976d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca5e240824264c979d98aa05d72d7226'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:12:18.017311 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-a631ad48-5f72-4c0b-8ffa-bd88432976d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca5e240824264c979d98aa05d72d7226'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:12:18.017991 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-a631ad48-5f72-4c0b-8ffa-bd88432976d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca5e240824264c979d98aa05d72d7226'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:12:18.029955 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-a631ad48-5f72-4c0b-8ffa-bd88432976d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca5e240824264c979d98aa05d72d7226'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:12:18.103512 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1400/2836] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 18 22:12:17 2022] DELETE /identity/v3/users/ca5e240824264c979d98aa05d72d7226 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:12:18.503370 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd950b4c-6f82-4611-b3de-8c8842759c6d admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:12:18.505330 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-cd950b4c-6f82-4611-b3de-8c8842759c6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:12:18.526273 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd950b4c-6f82-4611-b3de-8c8842759c6d admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:12:18.546257 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:12:18.586359 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e19c6c5-6ebe-48ad-bfa3-e544d580f2fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:12:18.587001 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e19c6c5-6ebe-48ad-bfa3-e544d580f2fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:12:18.587284 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e19c6c5-6ebe-48ad-bfa3-e544d580f2fa admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:12:18.587705 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e19c6c5-6ebe-48ad-bfa3-e544d580f2fa admin admin] PATH_INFO: `/v3/projects/abd9c9ddf892475b9c83bba11d0b794a` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:12:18.588888 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e19c6c5-6ebe-48ad-bfa3-e544d580f2fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=abd9c9ddf892475b9c83bba11d0b794a)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:12:18.590801 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e19c6c5-6ebe-48ad-bfa3-e544d580f2fa admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:12:18.742929 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-8e19c6c5-6ebe-48ad-bfa3-e544d580f2fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abd9c9ddf892475b9c83bba11d0b794a', 'request_id': 'req-8e19c6c5-6ebe-48ad-bfa3-e544d580f2fa'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:12:18.748341 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-8e19c6c5-6ebe-48ad-bfa3-e544d580f2fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abd9c9ddf892475b9c83bba11d0b794a', 'request_id': 'req-8e19c6c5-6ebe-48ad-bfa3-e544d580f2fa'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:12:18.821330 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-8e19c6c5-6ebe-48ad-bfa3-e544d580f2fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abd9c9ddf892475b9c83bba11d0b794a', 'request_id': 'req-8e19c6c5-6ebe-48ad-bfa3-e544d580f2fa'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:12:18.833019 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-8e19c6c5-6ebe-48ad-bfa3-e544d580f2fa admin admin] The token cache is being invalidate because project abd9c9ddf892475b9c83bba11d0b794a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88097) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 22:12:18.833289 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-8e19c6c5-6ebe-48ad-bfa3-e544d580f2fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:12:18.833995 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-8e19c6c5-6ebe-48ad-bfa3-e544d580f2fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:12:18.835550 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1437/2837] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 18 22:12:18 2022] DELETE /identity/v3/projects/abd9c9ddf892475b9c83bba11d0b794a => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:12:18.839642 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a631ad48-5f72-4c0b-8ffa-bd88432976d2 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:12:18.841112 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-a631ad48-5f72-4c0b-8ffa-bd88432976d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:12:18.854966 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a631ad48-5f72-4c0b-8ffa-bd88432976d2 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:12:18.915578 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cbf168-f5a0-40cd-9c53-d0dad53b9597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:12:18.916209 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cbf168-f5a0-40cd-9c53-d0dad53b9597 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:12:18.916487 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cbf168-f5a0-40cd-9c53-d0dad53b9597 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:12:18.916789 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cbf168-f5a0-40cd-9c53-d0dad53b9597 admin admin] PATH_INFO: `/v3/users/f60443c1c7954b0aafa0e858bacc4659` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:12:18.920511 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cbf168-f5a0-40cd-9c53-d0dad53b9597 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f60443c1c7954b0aafa0e858bacc4659)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:12:18.920511 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cbf168-f5a0-40cd-9c53-d0dad53b9597 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:12:19.063166 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-e2cbf168-f5a0-40cd-9c53-d0dad53b9597 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f60443c1c7954b0aafa0e858bacc4659'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:12:19.070096 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-e2cbf168-f5a0-40cd-9c53-d0dad53b9597 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f60443c1c7954b0aafa0e858bacc4659'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:12:19.070760 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-e2cbf168-f5a0-40cd-9c53-d0dad53b9597 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f60443c1c7954b0aafa0e858bacc4659'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:12:19.071421 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-e2cbf168-f5a0-40cd-9c53-d0dad53b9597 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f60443c1c7954b0aafa0e858bacc4659'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:12:19.083830 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-e2cbf168-f5a0-40cd-9c53-d0dad53b9597 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f60443c1c7954b0aafa0e858bacc4659'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:12:19.180887 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1401/2838] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 18 22:12:18 2022] DELETE /identity/v3/users/f60443c1c7954b0aafa0e858bacc4659 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:12:19.594148 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e19c6c5-6ebe-48ad-bfa3-e544d580f2fa admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:12:19.595632 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-8e19c6c5-6ebe-48ad-bfa3-e544d580f2fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:12:19.616083 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e19c6c5-6ebe-48ad-bfa3-e544d580f2fa admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:12:19.673589 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c48f8fd-07d6-404b-bd5e-a00138308a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:12:19.674318 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c48f8fd-07d6-404b-bd5e-a00138308a1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:12:19.674619 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c48f8fd-07d6-404b-bd5e-a00138308a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:12:19.674895 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c48f8fd-07d6-404b-bd5e-a00138308a1a admin admin] PATH_INFO: `/v3/projects/e88c42e614b14cf4a6810ced19eb2fde` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:12:19.676009 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c48f8fd-07d6-404b-bd5e-a00138308a1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e88c42e614b14cf4a6810ced19eb2fde)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:12:19.677959 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c48f8fd-07d6-404b-bd5e-a00138308a1a admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:12:19.765065 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-1c48f8fd-07d6-404b-bd5e-a00138308a1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e88c42e614b14cf4a6810ced19eb2fde', 'request_id': 'req-1c48f8fd-07d6-404b-bd5e-a00138308a1a'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:12:19.769570 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:12:19.771758 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-1c48f8fd-07d6-404b-bd5e-a00138308a1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e88c42e614b14cf4a6810ced19eb2fde', 'request_id': 'req-1c48f8fd-07d6-404b-bd5e-a00138308a1a'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:12:19.826378 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-1c48f8fd-07d6-404b-bd5e-a00138308a1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e88c42e614b14cf4a6810ced19eb2fde', 'request_id': 'req-1c48f8fd-07d6-404b-bd5e-a00138308a1a'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:12:19.838899 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-1c48f8fd-07d6-404b-bd5e-a00138308a1a admin admin] The token cache is being invalidate because project e88c42e614b14cf4a6810ced19eb2fde was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88097) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 22:12:19.839444 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-1c48f8fd-07d6-404b-bd5e-a00138308a1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:12:19.840502 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-1c48f8fd-07d6-404b-bd5e-a00138308a1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:12:19.842052 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1438/2839] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 18 22:12:19 2022] DELETE /identity/v3/projects/e88c42e614b14cf4a6810ced19eb2fde => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:12:19.848014 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21fc245-e1a4-47aa-a564-61adaeef5985 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:12:19.848535 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21fc245-e1a4-47aa-a564-61adaeef5985 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:12:19.848682 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21fc245-e1a4-47aa-a564-61adaeef5985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:12:19.872109 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-e21fc245-e1a4-47aa-a564-61adaeef5985 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:12:19.873378 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-e21fc245-e1a4-47aa-a564-61adaeef5985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:12:19.914237 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:12:19.932174 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1402/2840] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:12:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 22:12:19.940244 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ce8cf3-6769-4cf6-acf1-31ba610f3a0b None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:12:19.940530 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ce8cf3-6769-4cf6-acf1-31ba610f3a0b None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:12:19.940860 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ce8cf3-6769-4cf6-acf1-31ba610f3a0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:12:19.961314 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-96ce8cf3-6769-4cf6-acf1-31ba610f3a0b None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:12:19.962549 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-96ce8cf3-6769-4cf6-acf1-31ba610f3a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:12:19.970702 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1439/2841] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:12:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:12:19.975644 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21fc245-e1a4-47aa-a564-61adaeef5985 None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:12:19.985232 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21fc245-e1a4-47aa-a564-61adaeef5985 None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:12:19.990019 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4b00c7-580b-4c58-a62c-8dc5f5f7d269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:12:19.990617 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4b00c7-580b-4c58-a62c-8dc5f5f7d269 admin admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:12:19.990891 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4b00c7-580b-4c58-a62c-8dc5f5f7d269 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:12:19.991157 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4b00c7-580b-4c58-a62c-8dc5f5f7d269 admin admin] PATH_INFO: `/v3/domains` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:12:19.991828 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4b00c7-580b-4c58-a62c-8dc5f5f7d269 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 22:12:19.992124 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4b00c7-580b-4c58-a62c-8dc5f5f7d269 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:12:19.993742 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4b00c7-580b-4c58-a62c-8dc5f5f7d269 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:12:20.006577 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1403/2842] 10.222.0.27 () {58 vars in 1153 bytes} [Thu Aug 18 22:12:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 22:12:20.011379 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ce8cf3-6769-4cf6-acf1-31ba610f3a0b None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:12:20.021714 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ce8cf3-6769-4cf6-acf1-31ba610f3a0b None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:12:20.026497 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17650b2-63a4-43f0-9b02-4917518d649b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:12:20.027088 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17650b2-63a4-43f0-9b02-4917518d649b admin admin] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:12:20.027360 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17650b2-63a4-43f0-9b02-4917518d649b admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:12:20.027627 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17650b2-63a4-43f0-9b02-4917518d649b admin admin] PATH_INFO: `/v3/projects` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:12:20.028245 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17650b2-63a4-43f0-9b02-4917518d649b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:12:20.030152 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17650b2-63a4-43f0-9b02-4917518d649b admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:12:20.146581 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1440/2843] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 18 22:12:20 2022] POST /identity/v3/projects => generated 365 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 22:12:20.152219 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4b00c7-580b-4c58-a62c-8dc5f5f7d269 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:12:20.162396 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4b00c7-580b-4c58-a62c-8dc5f5f7d269 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:12:20.217858 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087fd53a-a19d-4b0d-842d-cf6d4a8facd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:12:20.218454 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087fd53a-a19d-4b0d-842d-cf6d4a8facd4 admin admin] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:12:20.218732 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087fd53a-a19d-4b0d-842d-cf6d4a8facd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:12:20.219005 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087fd53a-a19d-4b0d-842d-cf6d4a8facd4 admin admin] PATH_INFO: `/v3/users` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:12:20.219624 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087fd53a-a19d-4b0d-842d-cf6d4a8facd4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:12:20.221762 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087fd53a-a19d-4b0d-842d-cf6d4a8facd4 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:12:20.324500 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1404/2844] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 18 22:12:20 2022] POST /identity/v3/users => generated 283 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 22:12:20.328534 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17650b2-63a4-43f0-9b02-4917518d649b admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:12:20.339606 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17650b2-63a4-43f0-9b02-4917518d649b admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:12:20.344195 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea780424-1e01-4dc2-ab4e-e6eb8b236b7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:12:20.344820 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea780424-1e01-4dc2-ab4e-e6eb8b236b7f admin admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:12:20.345101 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea780424-1e01-4dc2-ab4e-e6eb8b236b7f admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:12:20.345375 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea780424-1e01-4dc2-ab4e-e6eb8b236b7f admin admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:12:20.346056 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea780424-1e01-4dc2-ab4e-e6eb8b236b7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:12:20.347649 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea780424-1e01-4dc2-ab4e-e6eb8b236b7f admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:12:20.357395 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1441/2845] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:12:20 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:12:20.361256 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087fd53a-a19d-4b0d-842d-cf6d4a8facd4 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:12:20.371712 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087fd53a-a19d-4b0d-842d-cf6d4a8facd4 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:12:20.376304 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dd4f8a-d892-47a2-9a6c-3e56eccebf1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:12:20.376937 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dd4f8a-d892-47a2-9a6c-3e56eccebf1d admin admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:12:20.378338 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dd4f8a-d892-47a2-9a6c-3e56eccebf1d admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:12:20.378338 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dd4f8a-d892-47a2-9a6c-3e56eccebf1d admin admin] PATH_INFO: `/v3/roles` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:12:20.378962 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dd4f8a-d892-47a2-9a6c-3e56eccebf1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:12:20.380540 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dd4f8a-d892-47a2-9a6c-3e56eccebf1d admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:12:20.391454 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1405/2846] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:12:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 22:12:20.395510 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea780424-1e01-4dc2-ab4e-e6eb8b236b7f admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:12:20.405497 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea780424-1e01-4dc2-ab4e-e6eb8b236b7f admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:12:20.410196 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663ebc26-6882-435e-9702-40a26f7d18bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:12:20.410862 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663ebc26-6882-435e-9702-40a26f7d18bc admin admin] REQUEST_METHOD: `PUT` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:12:20.411139 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663ebc26-6882-435e-9702-40a26f7d18bc admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:12:20.411436 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663ebc26-6882-435e-9702-40a26f7d18bc admin admin] PATH_INFO: `/v3/projects/a05d88a524cd4afaa13db80df338f31c/users/42c34ef80ea84d1798cf7524b44bb131/roles/de8f2438056f4af9879423f8a59e0e0b` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:12:20.426361 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663ebc26-6882-435e-9702-40a26f7d18bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=a05d88a524cd4afaa13db80df338f31c, user_id=42c34ef80ea84d1798cf7524b44bb131, role_id=de8f2438056f4af9879423f8a59e0e0b)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:12:20.429092 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663ebc26-6882-435e-9702-40a26f7d18bc admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:12:20.521354 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1442/2847] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 18 22:12:20 2022] PUT /identity/v3/projects/a05d88a524cd4afaa13db80df338f31c/users/42c34ef80ea84d1798cf7524b44bb131/roles/de8f2438056f4af9879423f8a59e0e0b => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:12:20.531455 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c32d4e5-5e9f-49d7-850a-4b84bee731ba None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:12:20.531743 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c32d4e5-5e9f-49d7-850a-4b84bee731ba None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:12:20.532040 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c32d4e5-5e9f-49d7-850a-4b84bee731ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:12:20.559997 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-1c32d4e5-5e9f-49d7-850a-4b84bee731ba None None] MFA Rules not processed for user `42c34ef80ea84d1798cf7524b44bb131`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:12:20.561238 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-1c32d4e5-5e9f-49d7-850a-4b84bee731ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:12:20.626181 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1406/2848] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:12:20 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:12:20.638818 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663ebc26-6882-435e-9702-40a26f7d18bc admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:12:20.640526 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-663ebc26-6882-435e-9702-40a26f7d18bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:12:20.698989 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663ebc26-6882-435e-9702-40a26f7d18bc admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:12:20.702597 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862e0275-348f-4343-8bb6-2858c54c6a85 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22b6a7c36f8a4795a75271b8079821c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:12:20.703197 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862e0275-348f-4343-8bb6-2858c54c6a85 service cinder] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:12:20.703478 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862e0275-348f-4343-8bb6-2858c54c6a85 service cinder] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:12:20.703753 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862e0275-348f-4343-8bb6-2858c54c6a85 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:12:20.712180 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862e0275-348f-4343-8bb6-2858c54c6a85 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:12:20.713642 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862e0275-348f-4343-8bb6-2858c54c6a85 service cinder] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:12:20.722650 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1443/2849] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:12:20 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:12:30.623214 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=79,keystone:INSERT=3 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:12:30.718386 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:DELETE=2,keystone:SELECT=58,keystone:INSERT=3 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:12:54.153875 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c32d4e5-5e9f-49d7-850a-4b84bee731ba None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:12:54.215057 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c32d4e5-5e9f-49d7-850a-4b84bee731ba None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:12:54.219550 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78488e9c-7371-4ba4-b4b4-3af31273d09a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:12:54.220171 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78488e9c-7371-4ba4-b4b4-3af31273d09a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:12:54.220452 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78488e9c-7371-4ba4-b4b4-3af31273d09a admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:12:54.220759 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78488e9c-7371-4ba4-b4b4-3af31273d09a admin admin] PATH_INFO: `/v3/users/42c34ef80ea84d1798cf7524b44bb131` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:12:54.221875 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78488e9c-7371-4ba4-b4b4-3af31273d09a admin admin] RBAC: Authorizing `identity:delete_user(user_id=42c34ef80ea84d1798cf7524b44bb131)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:12:54.223771 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78488e9c-7371-4ba4-b4b4-3af31273d09a admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:12:54.398767 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-78488e9c-7371-4ba4-b4b4-3af31273d09a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42c34ef80ea84d1798cf7524b44bb131'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:12:54.406189 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-78488e9c-7371-4ba4-b4b4-3af31273d09a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42c34ef80ea84d1798cf7524b44bb131'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:12:54.406863 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-78488e9c-7371-4ba4-b4b4-3af31273d09a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42c34ef80ea84d1798cf7524b44bb131'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:12:54.407480 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-78488e9c-7371-4ba4-b4b4-3af31273d09a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42c34ef80ea84d1798cf7524b44bb131'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:12:54.419805 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-78488e9c-7371-4ba4-b4b4-3af31273d09a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42c34ef80ea84d1798cf7524b44bb131'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:12:54.483861 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1407/2850] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 18 22:12:54 2022] DELETE /identity/v3/users/42c34ef80ea84d1798cf7524b44bb131 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:12:54.488278 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9713e043-265b-4082-b1d0-7d0e540d3be9 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:12:54.488804 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9713e043-265b-4082-b1d0-7d0e540d3be9 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:12:54.488913 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9713e043-265b-4082-b1d0-7d0e540d3be9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:12:54.508605 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-9713e043-265b-4082-b1d0-7d0e540d3be9 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:12:54.509834 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-9713e043-265b-4082-b1d0-7d0e540d3be9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:12:54.567654 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1444/2851] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:12:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:12:54.577533 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78488e9c-7371-4ba4-b4b4-3af31273d09a admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:12:54.578925 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-78488e9c-7371-4ba4-b4b4-3af31273d09a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:12:54.635554 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78488e9c-7371-4ba4-b4b4-3af31273d09a admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:12:54.639525 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71229bd1-fc69-4cdb-ad1b-4b23844cbc71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a937971ad1a4b0c8697c764f214d446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:12:54.640133 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71229bd1-fc69-4cdb-ad1b-4b23844cbc71 service neutron] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:12:54.640410 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71229bd1-fc69-4cdb-ad1b-4b23844cbc71 service neutron] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:12:54.640710 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71229bd1-fc69-4cdb-ad1b-4b23844cbc71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:12:54.649559 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71229bd1-fc69-4cdb-ad1b-4b23844cbc71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:12:54.650984 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71229bd1-fc69-4cdb-ad1b-4b23844cbc71 service neutron] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:12:54.661037 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1408/2852] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:12:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 22:12:55.101313 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9713e043-265b-4082-b1d0-7d0e540d3be9 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:12:55.101313 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-9713e043-265b-4082-b1d0-7d0e540d3be9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:12:55.114471 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9713e043-265b-4082-b1d0-7d0e540d3be9 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:12:55.119107 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97587e1-3b68-4ba5-8dbd-3c8704c6965b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:12:55.119741 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97587e1-3b68-4ba5-8dbd-3c8704c6965b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:12:55.120023 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97587e1-3b68-4ba5-8dbd-3c8704c6965b admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:12:55.120319 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97587e1-3b68-4ba5-8dbd-3c8704c6965b admin admin] PATH_INFO: `/v3/projects/a05d88a524cd4afaa13db80df338f31c` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:12:55.122519 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97587e1-3b68-4ba5-8dbd-3c8704c6965b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a05d88a524cd4afaa13db80df338f31c)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:12:55.124565 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97587e1-3b68-4ba5-8dbd-3c8704c6965b admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:12:55.226406 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-e97587e1-3b68-4ba5-8dbd-3c8704c6965b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a05d88a524cd4afaa13db80df338f31c', 'request_id': 'req-e97587e1-3b68-4ba5-8dbd-3c8704c6965b'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:12:55.232404 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-e97587e1-3b68-4ba5-8dbd-3c8704c6965b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a05d88a524cd4afaa13db80df338f31c', 'request_id': 'req-e97587e1-3b68-4ba5-8dbd-3c8704c6965b'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:12:55.317712 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-e97587e1-3b68-4ba5-8dbd-3c8704c6965b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a05d88a524cd4afaa13db80df338f31c', 'request_id': 'req-e97587e1-3b68-4ba5-8dbd-3c8704c6965b'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:12:55.329202 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-e97587e1-3b68-4ba5-8dbd-3c8704c6965b admin admin] The token cache is being invalidate because project a05d88a524cd4afaa13db80df338f31c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88097) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 22:12:55.329491 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-e97587e1-3b68-4ba5-8dbd-3c8704c6965b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:12:55.330150 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-e97587e1-3b68-4ba5-8dbd-3c8704c6965b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:12:55.334400 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1445/2853] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 18 22:12:55 2022] DELETE /identity/v3/projects/a05d88a524cd4afaa13db80df338f31c => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:12:55.336846 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6af371d-c322-44e7-9262-03fc3c218dcb None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:12:55.337324 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6af371d-c322-44e7-9262-03fc3c218dcb None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:12:55.337431 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6af371d-c322-44e7-9262-03fc3c218dcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:12:55.357024 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-d6af371d-c322-44e7-9262-03fc3c218dcb None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:12:55.358159 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-d6af371d-c322-44e7-9262-03fc3c218dcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:12:55.375761 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:12:55.419232 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1409/2854] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:12:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:12:55.427133 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71efdeb-b53b-4bc1-a455-665e74edfba1 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:12:55.427422 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71efdeb-b53b-4bc1-a455-665e74edfba1 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:12:55.427698 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71efdeb-b53b-4bc1-a455-665e74edfba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:12:55.447634 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-a71efdeb-b53b-4bc1-a455-665e74edfba1 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:12:55.448918 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-a71efdeb-b53b-4bc1-a455-665e74edfba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:12:55.456883 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1446/2855] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:12:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:12:55.461036 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6af371d-c322-44e7-9262-03fc3c218dcb None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:12:55.471252 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6af371d-c322-44e7-9262-03fc3c218dcb None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:12:55.475825 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f79cf5-0210-411d-b823-0551c315d4c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:12:55.476419 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f79cf5-0210-411d-b823-0551c315d4c9 admin admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:12:55.476738 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f79cf5-0210-411d-b823-0551c315d4c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:12:55.477016 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f79cf5-0210-411d-b823-0551c315d4c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:12:55.477661 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f79cf5-0210-411d-b823-0551c315d4c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 22:12:55.477965 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f79cf5-0210-411d-b823-0551c315d4c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:12:55.479555 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f79cf5-0210-411d-b823-0551c315d4c9 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:12:55.491693 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1410/2856] 10.222.0.27 () {58 vars in 1153 bytes} [Thu Aug 18 22:12:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 22:12:55.495781 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71efdeb-b53b-4bc1-a455-665e74edfba1 None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:12:55.505079 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71efdeb-b53b-4bc1-a455-665e74edfba1 None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:12:55.510005 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cb33a5-4505-4d36-8e5d-0e591fad2f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:12:55.510598 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cb33a5-4505-4d36-8e5d-0e591fad2f14 admin admin] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:12:55.510875 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cb33a5-4505-4d36-8e5d-0e591fad2f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:12:55.511144 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cb33a5-4505-4d36-8e5d-0e591fad2f14 admin admin] PATH_INFO: `/v3/projects` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:12:55.511851 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cb33a5-4505-4d36-8e5d-0e591fad2f14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:12:55.513796 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cb33a5-4505-4d36-8e5d-0e591fad2f14 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:12:55.613989 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1447/2857] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 18 22:12:55 2022] POST /identity/v3/projects => generated 385 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 22:12:55.618052 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f79cf5-0210-411d-b823-0551c315d4c9 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:12:55.628060 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f79cf5-0210-411d-b823-0551c315d4c9 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:12:55.685096 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9376ee-17af-4917-ac21-571c150672ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:12:55.685697 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9376ee-17af-4917-ac21-571c150672ed admin admin] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:12:55.686006 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9376ee-17af-4917-ac21-571c150672ed admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:12:55.686277 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9376ee-17af-4917-ac21-571c150672ed admin admin] PATH_INFO: `/v3/users` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:12:55.686906 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9376ee-17af-4917-ac21-571c150672ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:12:55.688834 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9376ee-17af-4917-ac21-571c150672ed admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:12:55.778557 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1411/2858] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 18 22:12:55 2022] POST /identity/v3/users => generated 293 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 22:12:55.782605 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cb33a5-4505-4d36-8e5d-0e591fad2f14 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:12:55.793306 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cb33a5-4505-4d36-8e5d-0e591fad2f14 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:12:55.797985 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1751dfd5-819e-472f-bde4-e605011f371e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:12:55.798581 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1751dfd5-819e-472f-bde4-e605011f371e admin admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:12:55.798882 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1751dfd5-819e-472f-bde4-e605011f371e admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:12:55.799156 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1751dfd5-819e-472f-bde4-e605011f371e admin admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:12:55.799816 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1751dfd5-819e-472f-bde4-e605011f371e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:12:55.801446 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1751dfd5-819e-472f-bde4-e605011f371e admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:12:55.811598 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1448/2859] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:12:55 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:12:55.815438 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9376ee-17af-4917-ac21-571c150672ed admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:12:55.825987 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9376ee-17af-4917-ac21-571c150672ed admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:12:55.830791 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0d4eb5-ced6-43b8-9fc8-e99f2f752673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:12:55.831389 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0d4eb5-ced6-43b8-9fc8-e99f2f752673 admin admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:12:55.831668 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0d4eb5-ced6-43b8-9fc8-e99f2f752673 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:12:55.831941 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0d4eb5-ced6-43b8-9fc8-e99f2f752673 admin admin] PATH_INFO: `/v3/roles` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:12:55.832580 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0d4eb5-ced6-43b8-9fc8-e99f2f752673 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:12:55.834235 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0d4eb5-ced6-43b8-9fc8-e99f2f752673 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:12:55.846471 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1412/2860] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:12:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:12:55.850478 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1751dfd5-819e-472f-bde4-e605011f371e admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:12:55.860404 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1751dfd5-819e-472f-bde4-e605011f371e admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:12:55.865168 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a2ff38-e377-438e-82be-bc8d3b2b2a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:12:55.865751 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a2ff38-e377-438e-82be-bc8d3b2b2a7d admin admin] REQUEST_METHOD: `PUT` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:12:55.866028 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a2ff38-e377-438e-82be-bc8d3b2b2a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:12:55.866302 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a2ff38-e377-438e-82be-bc8d3b2b2a7d admin admin] PATH_INFO: `/v3/projects/bc366ceca26c45b491bf7136c3e42a58/users/4897f08a3b834ab1be0e8628ab50dc13/roles/de8f2438056f4af9879423f8a59e0e0b` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:12:55.882107 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a2ff38-e377-438e-82be-bc8d3b2b2a7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc366ceca26c45b491bf7136c3e42a58, user_id=4897f08a3b834ab1be0e8628ab50dc13, role_id=de8f2438056f4af9879423f8a59e0e0b)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:12:55.885152 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a2ff38-e377-438e-82be-bc8d3b2b2a7d admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:12:55.955364 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1449/2861] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 18 22:12:55 2022] PUT /identity/v3/projects/bc366ceca26c45b491bf7136c3e42a58/users/4897f08a3b834ab1be0e8628ab50dc13/roles/de8f2438056f4af9879423f8a59e0e0b => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:12:55.960613 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5d5263-c3eb-4758-abe4-5289ba2fb0c3 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:12:55.960917 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5d5263-c3eb-4758-abe4-5289ba2fb0c3 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:12:55.961190 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5d5263-c3eb-4758-abe4-5289ba2fb0c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:12:55.980568 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-eb5d5263-c3eb-4758-abe4-5289ba2fb0c3 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:12:55.981803 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-eb5d5263-c3eb-4758-abe4-5289ba2fb0c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:12:56.040941 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1413/2862] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:12:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 22:12:56.052261 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a2ff38-e377-438e-82be-bc8d3b2b2a7d admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:12:56.054101 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-40a2ff38-e377-438e-82be-bc8d3b2b2a7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:12:56.076127 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:12:56.112368 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a2ff38-e377-438e-82be-bc8d3b2b2a7d admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:12:56.116087 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f19c41-d7a2-4135-8599-806d4419529e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a937971ad1a4b0c8697c764f214d446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:12:56.116664 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f19c41-d7a2-4135-8599-806d4419529e service neutron] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:12:56.116952 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f19c41-d7a2-4135-8599-806d4419529e service neutron] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:12:56.117231 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f19c41-d7a2-4135-8599-806d4419529e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:12:56.127576 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f19c41-d7a2-4135-8599-806d4419529e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:12:56.129042 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f19c41-d7a2-4135-8599-806d4419529e service neutron] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:12:56.139493 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1450/2863] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:12:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:13:01.758119 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2ed900-5051-4375-9d28-0fa5cae140cd None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:13:01.759333 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2ed900-5051-4375-9d28-0fa5cae140cd None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:13:01.759815 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2ed900-5051-4375-9d28-0fa5cae140cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:13:01.791330 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-fc2ed900-5051-4375-9d28-0fa5cae140cd None None] MFA Rules not processed for user `4897f08a3b834ab1be0e8628ab50dc13`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:13:01.792529 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-fc2ed900-5051-4375-9d28-0fa5cae140cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:13:01.813104 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:13:01.865454 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1414/2864] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:13:01 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:13:01.869910 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f19c41-d7a2-4135-8599-806d4419529e service neutron] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:13:01.882037 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f19c41-d7a2-4135-8599-806d4419529e service neutron] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:13:01.887807 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e633e775-03bb-4e56-be71-a02ab6fd5dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:13:01.888500 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e633e775-03bb-4e56-be71-a02ab6fd5dca admin admin] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:13:01.890468 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e633e775-03bb-4e56-be71-a02ab6fd5dca admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:13:01.890468 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e633e775-03bb-4e56-be71-a02ab6fd5dca admin admin] PATH_INFO: `/v3/projects` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:13:01.890468 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e633e775-03bb-4e56-be71-a02ab6fd5dca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:13:01.891760 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e633e775-03bb-4e56-be71-a02ab6fd5dca admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:13:01.976467 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1451/2865] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 18 22:13:01 2022] POST /identity/v3/projects => generated 383 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 22:13:01.981576 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2ed900-5051-4375-9d28-0fa5cae140cd None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:13:01.994734 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2ed900-5051-4375-9d28-0fa5cae140cd None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:13:02.055230 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e671f4-febb-434c-8f4e-408b269d7c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:13:02.055849 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e671f4-febb-434c-8f4e-408b269d7c4d admin admin] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:13:02.056130 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e671f4-febb-434c-8f4e-408b269d7c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:13:02.056427 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e671f4-febb-434c-8f4e-408b269d7c4d admin admin] PATH_INFO: `/v3/users` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:13:02.057099 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e671f4-febb-434c-8f4e-408b269d7c4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:13:02.060035 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e671f4-febb-434c-8f4e-408b269d7c4d admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:13:02.159398 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1415/2866] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 18 22:13:01 2022] POST /identity/v3/users => generated 298 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 22:13:02.163461 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e633e775-03bb-4e56-be71-a02ab6fd5dca admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:13:02.174937 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e633e775-03bb-4e56-be71-a02ab6fd5dca admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:13:02.179686 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22acefa9-0498-4bcd-82fa-afe865bd272d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:13:02.180301 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22acefa9-0498-4bcd-82fa-afe865bd272d admin admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:13:02.180585 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22acefa9-0498-4bcd-82fa-afe865bd272d admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:13:02.180894 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22acefa9-0498-4bcd-82fa-afe865bd272d admin admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:13:02.181543 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22acefa9-0498-4bcd-82fa-afe865bd272d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:13:02.183160 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22acefa9-0498-4bcd-82fa-afe865bd272d admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:13:02.200009 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1452/2867] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:13:02 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:13:02.201827 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e671f4-febb-434c-8f4e-408b269d7c4d admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:13:02.212826 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e671f4-febb-434c-8f4e-408b269d7c4d admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:13:02.218638 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3ee1eb-20bd-447a-a87f-bfa515e30129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:13:02.219533 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3ee1eb-20bd-447a-a87f-bfa515e30129 admin admin] REQUEST_METHOD: `PUT` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:13:02.219649 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3ee1eb-20bd-447a-a87f-bfa515e30129 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:13:02.219839 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3ee1eb-20bd-447a-a87f-bfa515e30129 admin admin] PATH_INFO: `/v3/projects/8ce08c47a4f546d78c2b07b4208a65f3/users/2eb1e52d433842aa80e9288ce8896878/roles/0833202e2a3d47d1b6b3af57006641b1` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:13:02.235533 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3ee1eb-20bd-447a-a87f-bfa515e30129 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ce08c47a4f546d78c2b07b4208a65f3, user_id=2eb1e52d433842aa80e9288ce8896878, role_id=0833202e2a3d47d1b6b3af57006641b1)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:13:02.238283 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3ee1eb-20bd-447a-a87f-bfa515e30129 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:13:02.296171 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1416/2868] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 18 22:13:02 2022] PUT /identity/v3/projects/8ce08c47a4f546d78c2b07b4208a65f3/users/2eb1e52d433842aa80e9288ce8896878/roles/0833202e2a3d47d1b6b3af57006641b1 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:13:02.300170 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22acefa9-0498-4bcd-82fa-afe865bd272d admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:13:02.310454 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22acefa9-0498-4bcd-82fa-afe865bd272d admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:13:02.367019 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b77aaa-731f-48b2-937a-2c71a510b4a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:13:02.367622 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b77aaa-731f-48b2-937a-2c71a510b4a7 admin admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:13:02.367900 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b77aaa-731f-48b2-937a-2c71a510b4a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:13:02.368176 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b77aaa-731f-48b2-937a-2c71a510b4a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:13:02.368839 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b77aaa-731f-48b2-937a-2c71a510b4a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:13:02.370433 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b77aaa-731f-48b2-937a-2c71a510b4a7 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:13:02.380469 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1453/2869] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:13:02 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:13:02.385061 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3ee1eb-20bd-447a-a87f-bfa515e30129 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:13:02.395293 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3ee1eb-20bd-447a-a87f-bfa515e30129 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:13:02.399885 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf2b555-0355-414c-a9fb-61d74ded75e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:13:02.400525 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf2b555-0355-414c-a9fb-61d74ded75e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:13:02.400840 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf2b555-0355-414c-a9fb-61d74ded75e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:13:02.401142 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf2b555-0355-414c-a9fb-61d74ded75e2 admin admin] PATH_INFO: `/v3/projects/8ce08c47a4f546d78c2b07b4208a65f3/users/2eb1e52d433842aa80e9288ce8896878/roles/0833202e2a3d47d1b6b3af57006641b1` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:13:02.403794 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf2b555-0355-414c-a9fb-61d74ded75e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ce08c47a4f546d78c2b07b4208a65f3, user_id=2eb1e52d433842aa80e9288ce8896878, role_id=0833202e2a3d47d1b6b3af57006641b1)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:13:02.406478 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf2b555-0355-414c-a9fb-61d74ded75e2 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:13:02.418340 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1417/2870] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 18 22:13:02 2022] PUT /identity/v3/projects/8ce08c47a4f546d78c2b07b4208a65f3/users/2eb1e52d433842aa80e9288ce8896878/roles/0833202e2a3d47d1b6b3af57006641b1 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:13:08.094034 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3f2f9f-9e80-4531-be1b-5fcdd192a880 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:13:08.094549 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3f2f9f-9e80-4531-be1b-5fcdd192a880 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:13:08.094644 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3f2f9f-9e80-4531-be1b-5fcdd192a880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:13:08.137429 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-6b3f2f9f-9e80-4531-be1b-5fcdd192a880 None None] MFA Rules not processed for user `2eb1e52d433842aa80e9288ce8896878`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:13:08.138760 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-6b3f2f9f-9e80-4531-be1b-5fcdd192a880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:13:08.211479 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1454/2871] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:13:08 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:13:08.226357 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf2b555-0355-414c-a9fb-61d74ded75e2 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:13:08.230907 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-cdf2b555-0355-414c-a9fb-61d74ded75e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:13:08.308863 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf2b555-0355-414c-a9fb-61d74ded75e2 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:13:08.312883 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327c523c-ff3c-4615-810e-d9d0209be130 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85dfef6a910547da9706d294e7d40fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:13:08.313059 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327c523c-ff3c-4615-810e-d9d0209be130 service glance] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:13:08.313294 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327c523c-ff3c-4615-810e-d9d0209be130 service glance] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:13:08.313565 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327c523c-ff3c-4615-810e-d9d0209be130 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:13:08.317694 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:13:08.377183 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327c523c-ff3c-4615-810e-d9d0209be130 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:13:08.378846 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327c523c-ff3c-4615-810e-d9d0209be130 service glance] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:13:08.391212 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1418/2872] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:13:08 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:13:08.639332 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbc27a1-8306-4eb6-9285-14c3c53ed0e2 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:13:08.639618 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbc27a1-8306-4eb6-9285-14c3c53ed0e2 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:13:08.639891 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbc27a1-8306-4eb6-9285-14c3c53ed0e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:13:08.657213 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:13:08.702657 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-0dbc27a1-8306-4eb6-9285-14c3c53ed0e2 None None] MFA Rules not processed for user `f079aa6ed5594a4982172b51b93ac54f`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:13:08.703873 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-0dbc27a1-8306-4eb6-9285-14c3c53ed0e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:13:08.771723 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1455/2873] 10.222.0.27 () {58 vars in 1009 bytes} [Thu Aug 18 22:13:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:13:08.920257 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327c523c-ff3c-4615-810e-d9d0209be130 service glance] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:13:08.920257 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-327c523c-ff3c-4615-810e-d9d0209be130 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:13:09.015908 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327c523c-ff3c-4615-810e-d9d0209be130 service glance] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:13:09.021049 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612f6005-0ee1-4b67-aa7c-e73a020056e9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae59e6dca304c949942ae769acedc74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:13:09.021657 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612f6005-0ee1-4b67-aa7c-e73a020056e9 service swift] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:13:09.021981 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612f6005-0ee1-4b67-aa7c-e73a020056e9 service swift] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:13:09.022208 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612f6005-0ee1-4b67-aa7c-e73a020056e9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:13:09.030661 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612f6005-0ee1-4b67-aa7c-e73a020056e9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:13:09.032248 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612f6005-0ee1-4b67-aa7c-e73a020056e9 service swift] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:13:09.040365 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1419/2874] 10.222.0.27 () {60 vars in 1384 bytes} [Thu Aug 18 22:13:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 18 22:13:18.749973 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c399cdba-275b-4880-8521-6fad642fdbdd None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:13:18.750549 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c399cdba-275b-4880-8521-6fad642fdbdd None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:13:18.750688 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c399cdba-275b-4880-8521-6fad642fdbdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:13:18.771085 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-c399cdba-275b-4880-8521-6fad642fdbdd None None] MFA Rules not processed for user `4897f08a3b834ab1be0e8628ab50dc13`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:13:18.772313 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-c399cdba-275b-4880-8521-6fad642fdbdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:13:18.779423 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1456/2875] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:13:18 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:13:19.037120 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=66 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:13:19.041521 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612f6005-0ee1-4b67-aa7c-e73a020056e9 service swift] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:13:19.101725 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612f6005-0ee1-4b67-aa7c-e73a020056e9 service swift] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:13:19.105917 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ff2b17-6b51-4c05-b806-a3fba7aa93a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a937971ad1a4b0c8697c764f214d446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:13:19.110370 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ff2b17-6b51-4c05-b806-a3fba7aa93a1 service neutron] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:13:19.110370 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ff2b17-6b51-4c05-b806-a3fba7aa93a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:13:19.110370 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ff2b17-6b51-4c05-b806-a3fba7aa93a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:13:19.110370 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-f8ff2b17-6b51-4c05-b806-a3fba7aa93a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:13:19.121656 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ff2b17-6b51-4c05-b806-a3fba7aa93a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:13:19.123093 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ff2b17-6b51-4c05-b806-a3fba7aa93a1 service neutron] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:13:19.131137 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1420/2876] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:13:19 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:13:19.556224 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c399cdba-275b-4880-8521-6fad642fdbdd None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:13:19.557663 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-c399cdba-275b-4880-8521-6fad642fdbdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:13:19.634917 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c399cdba-275b-4880-8521-6fad642fdbdd None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:13:19.640943 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efae4c7-8075-42af-b40b-7f5813d5d349 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b44c0cf2d8b34f3e81c59d19eedbdfcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:13:19.641542 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efae4c7-8075-42af-b40b-7f5813d5d349 service placement] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:13:19.641822 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efae4c7-8075-42af-b40b-7f5813d5d349 service placement] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:13:19.642094 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efae4c7-8075-42af-b40b-7f5813d5d349 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:13:19.643886 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-6efae4c7-8075-42af-b40b-7f5813d5d349 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:13:19.655610 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efae4c7-8075-42af-b40b-7f5813d5d349 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:13:19.657222 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efae4c7-8075-42af-b40b-7f5813d5d349 service placement] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:13:19.667002 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1457/2877] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:13:19 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:13:22.879536 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf6bfd1-a093-4a28-bf3d-458660fb928f None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:13:22.880032 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf6bfd1-a093-4a28-bf3d-458660fb928f None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:13:22.880243 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf6bfd1-a093-4a28-bf3d-458660fb928f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:13:22.901848 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-acf6bfd1-a093-4a28-bf3d-458660fb928f None None] MFA Rules not processed for user `f079aa6ed5594a4982172b51b93ac54f`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:13:22.903177 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-acf6bfd1-a093-4a28-bf3d-458660fb928f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:13:22.916230 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1421/2878] 10.222.0.27 () {58 vars in 1009 bytes} [Thu Aug 18 22:13:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:13:22.930392 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efae4c7-8075-42af-b40b-7f5813d5d349 service placement] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:13:22.942151 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efae4c7-8075-42af-b40b-7f5813d5d349 service placement] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:13:22.947123 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecda64d-f314-461a-bc8b-5dd11a3a4639 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae59e6dca304c949942ae769acedc74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:13:22.947727 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecda64d-f314-461a-bc8b-5dd11a3a4639 service swift] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:13:22.948014 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecda64d-f314-461a-bc8b-5dd11a3a4639 service swift] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:13:22.948288 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecda64d-f314-461a-bc8b-5dd11a3a4639 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:13:22.957879 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecda64d-f314-461a-bc8b-5dd11a3a4639 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:13:22.959498 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecda64d-f314-461a-bc8b-5dd11a3a4639 service swift] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:13:22.968571 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1458/2879] 10.222.0.27 () {60 vars in 1384 bytes} [Thu Aug 18 22:13:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 18 22:13:23.271294 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf6bfd1-a093-4a28-bf3d-458660fb928f None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:13:23.296585 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf6bfd1-a093-4a28-bf3d-458660fb928f None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:13:23.298660 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55c057c-78c3-44e9-9c28-4884318d0836 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a937971ad1a4b0c8697c764f214d446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:13:23.299546 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55c057c-78c3-44e9-9c28-4884318d0836 service neutron] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:13:23.300080 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55c057c-78c3-44e9-9c28-4884318d0836 service neutron] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:13:23.300664 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55c057c-78c3-44e9-9c28-4884318d0836 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:13:23.305054 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-d55c057c-78c3-44e9-9c28-4884318d0836 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:13:23.332056 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55c057c-78c3-44e9-9c28-4884318d0836 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:13:23.333974 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55c057c-78c3-44e9-9c28-4884318d0836 service neutron] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:13:23.343463 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1422/2880] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:13:23 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:13:32.964465 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=80 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:13:33.338966 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=35 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:13:36.200448 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecda64d-f314-461a-bc8b-5dd11a3a4639 service swift] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:13:36.202578 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-fecda64d-f314-461a-bc8b-5dd11a3a4639 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:13:36.277484 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecda64d-f314-461a-bc8b-5dd11a3a4639 service swift] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:13:36.284122 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e593a3-7658-4722-b7fd-69ad8720d032 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a39cd50340184779ac589bbcb7cac9aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:13:36.284776 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e593a3-7658-4722-b7fd-69ad8720d032 service nova] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:13:36.285062 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e593a3-7658-4722-b7fd-69ad8720d032 service nova] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:13:36.285336 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e593a3-7658-4722-b7fd-69ad8720d032 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:13:36.287201 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-49e593a3-7658-4722-b7fd-69ad8720d032 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:13:36.300830 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e593a3-7658-4722-b7fd-69ad8720d032 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:13:36.302516 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e593a3-7658-4722-b7fd-69ad8720d032 service nova] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:13:36.313685 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1459/2881] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:13:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:13:43.422785 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55c057c-78c3-44e9-9c28-4884318d0836 service neutron] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:13:43.434788 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55c057c-78c3-44e9-9c28-4884318d0836 service neutron] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:13:43.440390 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90add7d5-6dec-4798-a2dd-a210e658e963 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b44c0cf2d8b34f3e81c59d19eedbdfcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:13:43.442323 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90add7d5-6dec-4798-a2dd-a210e658e963 service placement] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:13:43.442323 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90add7d5-6dec-4798-a2dd-a210e658e963 service placement] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:13:43.442323 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90add7d5-6dec-4798-a2dd-a210e658e963 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:13:43.443326 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-90add7d5-6dec-4798-a2dd-a210e658e963 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:13:43.455337 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90add7d5-6dec-4798-a2dd-a210e658e963 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:13:43.456966 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90add7d5-6dec-4798-a2dd-a210e658e963 service placement] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:13:43.467066 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1423/2882] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:13:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:13:44.100329 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e593a3-7658-4722-b7fd-69ad8720d032 service nova] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:13:44.107226 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e593a3-7658-4722-b7fd-69ad8720d032 service nova] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:13:44.111285 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb25c0d-90b8-4fc7-ad22-b00ebb9ee5b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a937971ad1a4b0c8697c764f214d446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:13:44.112009 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb25c0d-90b8-4fc7-ad22-b00ebb9ee5b5 service neutron] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:13:44.112292 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb25c0d-90b8-4fc7-ad22-b00ebb9ee5b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:13:44.112568 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb25c0d-90b8-4fc7-ad22-b00ebb9ee5b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:13:44.122144 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb25c0d-90b8-4fc7-ad22-b00ebb9ee5b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:13:44.123616 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb25c0d-90b8-4fc7-ad22-b00ebb9ee5b5 service neutron] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:13:44.134443 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1460/2883] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:13:44 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:13:46.192385 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90add7d5-6dec-4798-a2dd-a210e658e963 service placement] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:13:46.205291 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90add7d5-6dec-4798-a2dd-a210e658e963 service placement] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:13:46.211723 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f2d885-bf22-42c0-a6d1-5a4122064296 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a39cd50340184779ac589bbcb7cac9aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:13:46.212372 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f2d885-bf22-42c0-a6d1-5a4122064296 service nova] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:13:46.212678 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f2d885-bf22-42c0-a6d1-5a4122064296 service nova] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:13:46.212954 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f2d885-bf22-42c0-a6d1-5a4122064296 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:13:46.214697 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-e0f2d885-bf22-42c0-a6d1-5a4122064296 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:13:46.227530 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f2d885-bf22-42c0-a6d1-5a4122064296 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:13:46.229131 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f2d885-bf22-42c0-a6d1-5a4122064296 service nova] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:13:46.240813 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1424/2884] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:13:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:13:54.129775 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=40 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:13:56.235868 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=12 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:15:11.970063 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdd6c4d-355b-4d55-98c6-e06cfa533aee None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:15:11.970607 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdd6c4d-355b-4d55-98c6-e06cfa533aee None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:15:11.970607 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdd6c4d-355b-4d55-98c6-e06cfa533aee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:15:11.992387 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-acdd6c4d-355b-4d55-98c6-e06cfa533aee None None] MFA Rules not processed for user `f079aa6ed5594a4982172b51b93ac54f`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:15:11.993657 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-acdd6c4d-355b-4d55-98c6-e06cfa533aee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:15:12.001499 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1461/2885] 10.222.0.27 () {58 vars in 967 bytes} [Thu Aug 18 22:15:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:15:12.042847 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f2d885-bf22-42c0-a6d1-5a4122064296 service nova] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:15:12.054886 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f2d885-bf22-42c0-a6d1-5a4122064296 service nova] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:15:12.059915 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29adfb28-6fd9-4b70-ae01-2367ecb75282 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae59e6dca304c949942ae769acedc74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:15:12.061199 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29adfb28-6fd9-4b70-ae01-2367ecb75282 service swift] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:15:12.061515 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29adfb28-6fd9-4b70-ae01-2367ecb75282 service swift] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:15:12.061784 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29adfb28-6fd9-4b70-ae01-2367ecb75282 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:15:12.069691 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29adfb28-6fd9-4b70-ae01-2367ecb75282 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:15:12.071252 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29adfb28-6fd9-4b70-ae01-2367ecb75282 service swift] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:15:12.079203 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1425/2886] 10.222.0.27 () {60 vars in 1384 bytes} [Thu Aug 18 22:15:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 18 22:15:20.181186 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdd6c4d-355b-4d55-98c6-e06cfa533aee None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:15:20.182670 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-acdd6c4d-355b-4d55-98c6-e06cfa533aee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:15:20.197954 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdd6c4d-355b-4d55-98c6-e06cfa533aee None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:15:20.202959 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8908e5aa-62a5-420a-9ad3-3c6e677ba8be service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b44c0cf2d8b34f3e81c59d19eedbdfcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:15:20.203634 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8908e5aa-62a5-420a-9ad3-3c6e677ba8be service placement] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:15:20.203978 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8908e5aa-62a5-420a-9ad3-3c6e677ba8be service placement] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:15:20.204257 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8908e5aa-62a5-420a-9ad3-3c6e677ba8be service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:15:20.206011 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-8908e5aa-62a5-420a-9ad3-3c6e677ba8be service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:15:20.218166 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8908e5aa-62a5-420a-9ad3-3c6e677ba8be service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:15:20.219758 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8908e5aa-62a5-420a-9ad3-3c6e677ba8be service placement] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:15:20.229989 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1462/2887] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:15:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:15:20.328805 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29adfb28-6fd9-4b70-ae01-2367ecb75282 service swift] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:15:20.392809 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29adfb28-6fd9-4b70-ae01-2367ecb75282 service swift] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:15:20.397477 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5ed5b4-d2e9-4c2e-825c-c8689a37da1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:15:20.398156 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5ed5b4-d2e9-4c2e-825c-c8689a37da1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:15:20.398422 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5ed5b4-d2e9-4c2e-825c-c8689a37da1e admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:15:20.398696 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5ed5b4-d2e9-4c2e-825c-c8689a37da1e admin admin] PATH_INFO: `/v3/users/4897f08a3b834ab1be0e8628ab50dc13` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:15:20.399801 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5ed5b4-d2e9-4c2e-825c-c8689a37da1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=4897f08a3b834ab1be0e8628ab50dc13)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:15:20.401722 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5ed5b4-d2e9-4c2e-825c-c8689a37da1e admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:15:20.585694 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-7a5ed5b4-d2e9-4c2e-825c-c8689a37da1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4897f08a3b834ab1be0e8628ab50dc13'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:15:20.593112 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-7a5ed5b4-d2e9-4c2e-825c-c8689a37da1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4897f08a3b834ab1be0e8628ab50dc13'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:15:20.593790 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-7a5ed5b4-d2e9-4c2e-825c-c8689a37da1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4897f08a3b834ab1be0e8628ab50dc13'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:15:20.594399 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-7a5ed5b4-d2e9-4c2e-825c-c8689a37da1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4897f08a3b834ab1be0e8628ab50dc13'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:15:20.606109 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-7a5ed5b4-d2e9-4c2e-825c-c8689a37da1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4897f08a3b834ab1be0e8628ab50dc13'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:15:20.690680 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1426/2888] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 18 22:15:20 2022] DELETE /identity/v3/users/4897f08a3b834ab1be0e8628ab50dc13 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:15:20.911987 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8908e5aa-62a5-420a-9ad3-3c6e677ba8be service placement] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:15:20.923758 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8908e5aa-62a5-420a-9ad3-3c6e677ba8be service placement] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:15:20.984781 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc5b788-fe0c-4cf5-87fa-b573e4e02cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:15:20.985420 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc5b788-fe0c-4cf5-87fa-b573e4e02cfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:15:20.985700 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc5b788-fe0c-4cf5-87fa-b573e4e02cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:15:20.985977 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc5b788-fe0c-4cf5-87fa-b573e4e02cfb admin admin] PATH_INFO: `/v3/projects/bc366ceca26c45b491bf7136c3e42a58` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:15:20.987100 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc5b788-fe0c-4cf5-87fa-b573e4e02cfb admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc366ceca26c45b491bf7136c3e42a58)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:15:20.989071 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc5b788-fe0c-4cf5-87fa-b573e4e02cfb admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:15:21.131873 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-afc5b788-fe0c-4cf5-87fa-b573e4e02cfb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc366ceca26c45b491bf7136c3e42a58', 'request_id': 'req-afc5b788-fe0c-4cf5-87fa-b573e4e02cfb'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:15:21.137265 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-afc5b788-fe0c-4cf5-87fa-b573e4e02cfb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc366ceca26c45b491bf7136c3e42a58', 'request_id': 'req-afc5b788-fe0c-4cf5-87fa-b573e4e02cfb'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:15:21.218799 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-afc5b788-fe0c-4cf5-87fa-b573e4e02cfb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc366ceca26c45b491bf7136c3e42a58', 'request_id': 'req-afc5b788-fe0c-4cf5-87fa-b573e4e02cfb'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:15:21.230257 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-afc5b788-fe0c-4cf5-87fa-b573e4e02cfb admin admin] The token cache is being invalidate because project bc366ceca26c45b491bf7136c3e42a58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88097) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 22:15:21.230548 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-afc5b788-fe0c-4cf5-87fa-b573e4e02cfb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:15:21.231219 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-afc5b788-fe0c-4cf5-87fa-b573e4e02cfb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:15:21.233836 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1463/2889] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 18 22:15:20 2022] DELETE /identity/v3/projects/bc366ceca26c45b491bf7136c3e42a58 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:15:21.240570 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5ed5b4-d2e9-4c2e-825c-c8689a37da1e admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:15:21.240570 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-7a5ed5b4-d2e9-4c2e-825c-c8689a37da1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:15:21.253017 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5ed5b4-d2e9-4c2e-825c-c8689a37da1e admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:15:21.312343 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdf9cdf-b738-43f3-939f-f71a9a04f75c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:15:21.313102 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdf9cdf-b738-43f3-939f-f71a9a04f75c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:15:21.313378 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdf9cdf-b738-43f3-939f-f71a9a04f75c admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:15:21.313648 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdf9cdf-b738-43f3-939f-f71a9a04f75c admin admin] PATH_INFO: `/v3/users/2eb1e52d433842aa80e9288ce8896878` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:15:21.314772 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdf9cdf-b738-43f3-939f-f71a9a04f75c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2eb1e52d433842aa80e9288ce8896878)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:15:21.316700 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdf9cdf-b738-43f3-939f-f71a9a04f75c admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:15:21.322070 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:15:21.481543 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-7cdf9cdf-b738-43f3-939f-f71a9a04f75c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2eb1e52d433842aa80e9288ce8896878'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:15:21.489125 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-7cdf9cdf-b738-43f3-939f-f71a9a04f75c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2eb1e52d433842aa80e9288ce8896878'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:15:21.489902 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-7cdf9cdf-b738-43f3-939f-f71a9a04f75c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2eb1e52d433842aa80e9288ce8896878'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:15:21.490567 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-7cdf9cdf-b738-43f3-939f-f71a9a04f75c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2eb1e52d433842aa80e9288ce8896878'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:15:21.502515 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-7cdf9cdf-b738-43f3-939f-f71a9a04f75c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2eb1e52d433842aa80e9288ce8896878'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:15:21.575701 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1427/2890] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 18 22:15:21 2022] DELETE /identity/v3/users/2eb1e52d433842aa80e9288ce8896878 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:15:21.825762 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc5b788-fe0c-4cf5-87fa-b573e4e02cfb admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:15:21.828128 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-afc5b788-fe0c-4cf5-87fa-b573e4e02cfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:15:21.843521 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc5b788-fe0c-4cf5-87fa-b573e4e02cfb admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:15:21.900901 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805dbc17-d321-471e-982b-a634f40f93b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:15:21.901540 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805dbc17-d321-471e-982b-a634f40f93b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:15:21.901822 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805dbc17-d321-471e-982b-a634f40f93b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:15:21.902098 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805dbc17-d321-471e-982b-a634f40f93b9 admin admin] PATH_INFO: `/v3/projects/8ce08c47a4f546d78c2b07b4208a65f3` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:15:21.903219 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805dbc17-d321-471e-982b-a634f40f93b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ce08c47a4f546d78c2b07b4208a65f3)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:15:21.906033 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805dbc17-d321-471e-982b-a634f40f93b9 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:15:21.918171 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:15:22.036567 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-805dbc17-d321-471e-982b-a634f40f93b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ce08c47a4f546d78c2b07b4208a65f3', 'request_id': 'req-805dbc17-d321-471e-982b-a634f40f93b9'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:15:22.042224 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-805dbc17-d321-471e-982b-a634f40f93b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ce08c47a4f546d78c2b07b4208a65f3', 'request_id': 'req-805dbc17-d321-471e-982b-a634f40f93b9'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:15:22.175970 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-805dbc17-d321-471e-982b-a634f40f93b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ce08c47a4f546d78c2b07b4208a65f3', 'request_id': 'req-805dbc17-d321-471e-982b-a634f40f93b9'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:15:22.188169 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-805dbc17-d321-471e-982b-a634f40f93b9 admin admin] The token cache is being invalidate because project 8ce08c47a4f546d78c2b07b4208a65f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88097) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 22:15:22.188459 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-805dbc17-d321-471e-982b-a634f40f93b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:15:22.189123 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-805dbc17-d321-471e-982b-a634f40f93b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:15:22.190606 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1464/2891] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 18 22:15:21 2022] DELETE /identity/v3/projects/8ce08c47a4f546d78c2b07b4208a65f3 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:15:22.195631 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86297001-2f0f-453b-b345-e0f564ba7de1 None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:15:22.195923 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86297001-2f0f-453b-b345-e0f564ba7de1 None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:15:22.196206 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86297001-2f0f-453b-b345-e0f564ba7de1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:15:22.216439 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-86297001-2f0f-453b-b345-e0f564ba7de1 None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:15:22.218475 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-86297001-2f0f-453b-b345-e0f564ba7de1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:15:22.276467 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1428/2892] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:15:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:15:22.285527 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431f28b6-eb99-4842-a32e-2b086784af4a None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:15:22.286019 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431f28b6-eb99-4842-a32e-2b086784af4a None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:15:22.286121 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431f28b6-eb99-4842-a32e-2b086784af4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:15:22.307924 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-431f28b6-eb99-4842-a32e-2b086784af4a None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:15:22.309171 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-431f28b6-eb99-4842-a32e-2b086784af4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:15:22.317085 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1465/2893] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:15:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:15:22.321249 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86297001-2f0f-453b-b345-e0f564ba7de1 None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:15:22.331415 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86297001-2f0f-453b-b345-e0f564ba7de1 None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:15:22.335945 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1132cf-a5fe-4ab7-b485-3e6667425875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:15:22.336534 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1132cf-a5fe-4ab7-b485-3e6667425875 admin admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:15:22.336843 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1132cf-a5fe-4ab7-b485-3e6667425875 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:15:22.337112 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1132cf-a5fe-4ab7-b485-3e6667425875 admin admin] PATH_INFO: `/v3/domains` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:15:22.337757 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1132cf-a5fe-4ab7-b485-3e6667425875 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 22:15:22.338054 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1132cf-a5fe-4ab7-b485-3e6667425875 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:15:22.339621 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1132cf-a5fe-4ab7-b485-3e6667425875 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:15:22.351403 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1429/2894] 10.222.0.27 () {58 vars in 1153 bytes} [Thu Aug 18 22:15:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 22:15:22.355621 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431f28b6-eb99-4842-a32e-2b086784af4a None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:15:22.365895 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431f28b6-eb99-4842-a32e-2b086784af4a None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:15:22.370630 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49485f94-4042-4e4e-9851-dc9b4c06d9b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:15:22.371225 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49485f94-4042-4e4e-9851-dc9b4c06d9b0 admin admin] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:15:22.371500 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49485f94-4042-4e4e-9851-dc9b4c06d9b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:15:22.371769 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49485f94-4042-4e4e-9851-dc9b4c06d9b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:15:22.372387 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49485f94-4042-4e4e-9851-dc9b4c06d9b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:15:22.374993 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49485f94-4042-4e4e-9851-dc9b4c06d9b0 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:15:22.489380 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1466/2895] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 18 22:15:22 2022] POST /identity/v3/projects => generated 373 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 22:15:22.493524 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1132cf-a5fe-4ab7-b485-3e6667425875 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:15:22.504422 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1132cf-a5fe-4ab7-b485-3e6667425875 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:15:22.558624 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443c3024-7e87-4a57-87d0-f9dfeb00bfd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:15:22.559218 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443c3024-7e87-4a57-87d0-f9dfeb00bfd7 admin admin] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:15:22.559495 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443c3024-7e87-4a57-87d0-f9dfeb00bfd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:15:22.559764 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443c3024-7e87-4a57-87d0-f9dfeb00bfd7 admin admin] PATH_INFO: `/v3/users` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:15:22.561095 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443c3024-7e87-4a57-87d0-f9dfeb00bfd7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:15:22.562980 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443c3024-7e87-4a57-87d0-f9dfeb00bfd7 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:15:22.641161 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1430/2896] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 18 22:15:22 2022] POST /identity/v3/users => generated 287 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 22:15:22.645192 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49485f94-4042-4e4e-9851-dc9b4c06d9b0 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:15:22.655601 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49485f94-4042-4e4e-9851-dc9b4c06d9b0 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:15:22.660323 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80bca68-a8df-4e14-8ccd-611543db7e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:15:22.660944 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80bca68-a8df-4e14-8ccd-611543db7e51 admin admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:15:22.661223 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80bca68-a8df-4e14-8ccd-611543db7e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:15:22.661496 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80bca68-a8df-4e14-8ccd-611543db7e51 admin admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:15:22.662154 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80bca68-a8df-4e14-8ccd-611543db7e51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:15:22.663786 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80bca68-a8df-4e14-8ccd-611543db7e51 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:15:22.674347 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1467/2897] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:15:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:15:22.678232 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443c3024-7e87-4a57-87d0-f9dfeb00bfd7 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:15:22.683617 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:15:22.690026 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443c3024-7e87-4a57-87d0-f9dfeb00bfd7 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:15:22.694868 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239a3ee4-13a0-4fc7-9109-fe54297e185c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:15:22.695527 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239a3ee4-13a0-4fc7-9109-fe54297e185c admin admin] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:15:22.695802 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239a3ee4-13a0-4fc7-9109-fe54297e185c admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:15:22.696075 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239a3ee4-13a0-4fc7-9109-fe54297e185c admin admin] PATH_INFO: `/v3/roles` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:15:22.696870 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239a3ee4-13a0-4fc7-9109-fe54297e185c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:15:22.698517 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239a3ee4-13a0-4fc7-9109-fe54297e185c admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:15:22.709507 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1431/2898] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:15:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:15:22.713572 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80bca68-a8df-4e14-8ccd-611543db7e51 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:15:22.724062 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80bca68-a8df-4e14-8ccd-611543db7e51 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:15:22.728829 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99500aa2-744a-4527-8c0c-e599a551e100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:15:22.729474 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99500aa2-744a-4527-8c0c-e599a551e100 admin admin] REQUEST_METHOD: `PUT` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:15:22.729760 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99500aa2-744a-4527-8c0c-e599a551e100 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:15:22.730035 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99500aa2-744a-4527-8c0c-e599a551e100 admin admin] PATH_INFO: `/v3/projects/d0fdc330f3284d98923f4609ce4e4043/users/087fad0e901c49ea96b70fdfa1ce9ad9/roles/de8f2438056f4af9879423f8a59e0e0b` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:15:22.745850 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99500aa2-744a-4527-8c0c-e599a551e100 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0fdc330f3284d98923f4609ce4e4043, user_id=087fad0e901c49ea96b70fdfa1ce9ad9, role_id=de8f2438056f4af9879423f8a59e0e0b)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:15:22.748048 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99500aa2-744a-4527-8c0c-e599a551e100 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:15:22.818741 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1468/2899] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 18 22:15:22 2022] PUT /identity/v3/projects/d0fdc330f3284d98923f4609ce4e4043/users/087fad0e901c49ea96b70fdfa1ce9ad9/roles/de8f2438056f4af9879423f8a59e0e0b => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 22:15:22.824038 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f91be0-a235-4aef-9423-afda2cdde63c None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:15:22.824318 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f91be0-a235-4aef-9423-afda2cdde63c None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:15:22.824614 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f91be0-a235-4aef-9423-afda2cdde63c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:15:22.844085 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-68f91be0-a235-4aef-9423-afda2cdde63c None None] MFA Rules not processed for user `b468708457d44a0a864439dd99359654`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:15:22.845305 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-68f91be0-a235-4aef-9423-afda2cdde63c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:15:22.906216 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1432/2900] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:15:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 22:15:22.915988 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99500aa2-744a-4527-8c0c-e599a551e100 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:15:22.917720 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-99500aa2-744a-4527-8c0c-e599a551e100 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:15:22.974352 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99500aa2-744a-4527-8c0c-e599a551e100 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:15:22.978057 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5229a54a-e109-477f-a218-72b3ba3dd724 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a937971ad1a4b0c8697c764f214d446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:15:22.978659 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5229a54a-e109-477f-a218-72b3ba3dd724 service neutron] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:15:22.978941 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5229a54a-e109-477f-a218-72b3ba3dd724 service neutron] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:15:22.979247 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5229a54a-e109-477f-a218-72b3ba3dd724 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:15:22.988633 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5229a54a-e109-477f-a218-72b3ba3dd724 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:15:22.990074 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5229a54a-e109-477f-a218-72b3ba3dd724 service neutron] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:15:23.000428 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1469/2901] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:15:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:15:28.366721 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8036d00-d04e-419f-bea1-2ca36afa771b None None] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:15:28.367297 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8036d00-d04e-419f-bea1-2ca36afa771b None None] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:15:28.367297 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8036d00-d04e-419f-bea1-2ca36afa771b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:15:28.400143 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.auth.core [None req-e8036d00-d04e-419f-bea1-2ca36afa771b None None] MFA Rules not processed for user `087fad0e901c49ea96b70fdfa1ce9ad9`. Rule list: `[]` (Enabled: `True`). {{(pid=88096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:15:28.401412 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-e8036d00-d04e-419f-bea1-2ca36afa771b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:15:28.472130 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1433/2902] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:15:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:15:28.476670 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5229a54a-e109-477f-a218-72b3ba3dd724 service neutron] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:15:28.486655 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5229a54a-e109-477f-a218-72b3ba3dd724 service neutron] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:15:28.491407 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79548be9-1c91-4be6-95c4-e0ab17997a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:15:28.492009 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79548be9-1c91-4be6-95c4-e0ab17997a07 admin admin] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:15:28.492284 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79548be9-1c91-4be6-95c4-e0ab17997a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:15:28.492552 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79548be9-1c91-4be6-95c4-e0ab17997a07 admin admin] PATH_INFO: `/v3/projects` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:15:28.493241 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79548be9-1c91-4be6-95c4-e0ab17997a07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:15:28.495169 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79548be9-1c91-4be6-95c4-e0ab17997a07 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:15:28.586717 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1470/2903] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 18 22:15:28 2022] POST /identity/v3/projects => generated 373 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 22:15:28.590925 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8036d00-d04e-419f-bea1-2ca36afa771b None None] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:15:28.603123 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8036d00-d04e-419f-bea1-2ca36afa771b None None] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:15:28.664417 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1880e71-d948-4f15-ab7c-ba697569773f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:15:28.665094 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1880e71-d948-4f15-ab7c-ba697569773f admin admin] REQUEST_METHOD: `POST` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:15:28.665411 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1880e71-d948-4f15-ab7c-ba697569773f admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:15:28.665688 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1880e71-d948-4f15-ab7c-ba697569773f admin admin] PATH_INFO: `/v3/users` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:15:28.666328 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1880e71-d948-4f15-ab7c-ba697569773f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:15:28.668277 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1880e71-d948-4f15-ab7c-ba697569773f admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:15:28.779576 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1434/2904] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 18 22:15:28 2022] POST /identity/v3/users => generated 293 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 22:15:28.783681 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79548be9-1c91-4be6-95c4-e0ab17997a07 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:15:28.794455 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79548be9-1c91-4be6-95c4-e0ab17997a07 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:15:28.799069 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc63c78-dde8-4d59-9e1a-f4cfb8ba7d56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:15:28.799666 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc63c78-dde8-4d59-9e1a-f4cfb8ba7d56 admin admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:15:28.799946 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc63c78-dde8-4d59-9e1a-f4cfb8ba7d56 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:15:28.800324 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc63c78-dde8-4d59-9e1a-f4cfb8ba7d56 admin admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:15:28.800961 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc63c78-dde8-4d59-9e1a-f4cfb8ba7d56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:15:28.802556 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc63c78-dde8-4d59-9e1a-f4cfb8ba7d56 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:15:28.813791 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1471/2905] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:15:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:15:28.817961 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1880e71-d948-4f15-ab7c-ba697569773f admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:15:28.829145 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1880e71-d948-4f15-ab7c-ba697569773f admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:15:28.833839 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cce9c42-708a-4dfc-9c71-5938b1245000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:15:28.834491 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cce9c42-708a-4dfc-9c71-5938b1245000 admin admin] REQUEST_METHOD: `PUT` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:15:28.834772 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cce9c42-708a-4dfc-9c71-5938b1245000 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:15:28.835047 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cce9c42-708a-4dfc-9c71-5938b1245000 admin admin] PATH_INFO: `/v3/projects/f12df1ae035749878a3036809222c140/users/83cd84a4500147dea0dcaed0b4f1cf6c/roles/0833202e2a3d47d1b6b3af57006641b1` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:15:28.843962 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:15:28.851087 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cce9c42-708a-4dfc-9c71-5938b1245000 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f12df1ae035749878a3036809222c140, user_id=83cd84a4500147dea0dcaed0b4f1cf6c, role_id=0833202e2a3d47d1b6b3af57006641b1)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:15:28.857257 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cce9c42-708a-4dfc-9c71-5938b1245000 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:15:28.927425 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1435/2906] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 18 22:15:28 2022] PUT /identity/v3/projects/f12df1ae035749878a3036809222c140/users/83cd84a4500147dea0dcaed0b4f1cf6c/roles/0833202e2a3d47d1b6b3af57006641b1 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 22:15:28.931370 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc63c78-dde8-4d59-9e1a-f4cfb8ba7d56 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:15:28.941874 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc63c78-dde8-4d59-9e1a-f4cfb8ba7d56 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:15:28.945447 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:15:28.998641 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45eb2c7-ba34-42c2-9ea2-06b08ad69976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:15:28.999933 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45eb2c7-ba34-42c2-9ea2-06b08ad69976 admin admin] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:15:29.000223 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45eb2c7-ba34-42c2-9ea2-06b08ad69976 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:15:29.000497 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45eb2c7-ba34-42c2-9ea2-06b08ad69976 admin admin] PATH_INFO: `/v3/roles` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:15:29.001177 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45eb2c7-ba34-42c2-9ea2-06b08ad69976 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:15:29.002779 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45eb2c7-ba34-42c2-9ea2-06b08ad69976 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:15:29.014193 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1472/2907] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 18 22:15:28 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 22:15:29.019023 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cce9c42-708a-4dfc-9c71-5938b1245000 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:15:29.029617 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cce9c42-708a-4dfc-9c71-5938b1245000 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:15:29.034881 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a664c36f-68ed-437b-a83b-048aabbe177c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:15:29.035560 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a664c36f-68ed-437b-a83b-048aabbe177c admin admin] REQUEST_METHOD: `PUT` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:15:29.035846 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a664c36f-68ed-437b-a83b-048aabbe177c admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:15:29.036120 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a664c36f-68ed-437b-a83b-048aabbe177c admin admin] PATH_INFO: `/v3/projects/f12df1ae035749878a3036809222c140/users/83cd84a4500147dea0dcaed0b4f1cf6c/roles/0833202e2a3d47d1b6b3af57006641b1` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:15:29.038133 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a664c36f-68ed-437b-a83b-048aabbe177c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f12df1ae035749878a3036809222c140, user_id=83cd84a4500147dea0dcaed0b4f1cf6c, role_id=0833202e2a3d47d1b6b3af57006641b1)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:15:29.040820 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a664c36f-68ed-437b-a83b-048aabbe177c admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:15:29.052017 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1436/2908] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 18 22:15:29 2022] PUT /identity/v3/projects/f12df1ae035749878a3036809222c140/users/83cd84a4500147dea0dcaed0b4f1cf6c/roles/0833202e2a3d47d1b6b3af57006641b1 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:15:34.602682 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5150cb0-490d-482c-8a7b-b6548eeae567 None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:15:34.603212 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5150cb0-490d-482c-8a7b-b6548eeae567 None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:15:34.603212 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5150cb0-490d-482c-8a7b-b6548eeae567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:15:34.635031 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-f5150cb0-490d-482c-8a7b-b6548eeae567 None None] MFA Rules not processed for user `83cd84a4500147dea0dcaed0b4f1cf6c`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:15:34.636419 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-f5150cb0-490d-482c-8a7b-b6548eeae567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:15:34.713568 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1473/2909] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:15:34 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:15:34.729489 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a664c36f-68ed-437b-a83b-048aabbe177c admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:15:34.731332 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-a664c36f-68ed-437b-a83b-048aabbe177c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:15:34.810754 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a664c36f-68ed-437b-a83b-048aabbe177c admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:15:34.817089 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506d501b-6a99-4863-9a5c-1c77e4f292d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a39cd50340184779ac589bbcb7cac9aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:15:34.817682 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506d501b-6a99-4863-9a5c-1c77e4f292d7 service nova] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:15:34.817961 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506d501b-6a99-4863-9a5c-1c77e4f292d7 service nova] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:15:34.818274 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506d501b-6a99-4863-9a5c-1c77e4f292d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:15:34.876960 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506d501b-6a99-4863-9a5c-1c77e4f292d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:15:34.878545 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506d501b-6a99-4863-9a5c-1c77e4f292d7 service nova] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:15:34.888025 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1437/2910] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:15:34 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:15:37.607088 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471adfb2-2f36-4a6a-9d06-74b57e39a42d None None] REQUEST_METHOD: `POST` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:15:37.607562 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471adfb2-2f36-4a6a-9d06-74b57e39a42d None None] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:15:37.607664 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471adfb2-2f36-4a6a-9d06-74b57e39a42d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:15:37.627884 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.auth.core [None req-471adfb2-2f36-4a6a-9d06-74b57e39a42d None None] MFA Rules not processed for user `087fad0e901c49ea96b70fdfa1ce9ad9`. Rule list: `[]` (Enabled: `True`). {{(pid=88097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 22:15:37.629098 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-471adfb2-2f36-4a6a-9d06-74b57e39a42d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:15:37.636471 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1474/2911] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 18 22:15:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 22:15:44.884014 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=66,keystone:INSERT=2 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:15:47.621950 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=63 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:15:51.224662 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506d501b-6a99-4863-9a5c-1c77e4f292d7 service nova] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:15:51.226071 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-506d501b-6a99-4863-9a5c-1c77e4f292d7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:15:51.285659 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506d501b-6a99-4863-9a5c-1c77e4f292d7 service nova] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:15:51.289475 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed78254a-c187-4876-a4ba-d324c6abe97b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22b6a7c36f8a4795a75271b8079821c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:15:51.290097 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed78254a-c187-4876-a4ba-d324c6abe97b service cinder] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:15:51.290379 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed78254a-c187-4876-a4ba-d324c6abe97b service cinder] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:15:51.290653 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed78254a-c187-4876-a4ba-d324c6abe97b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:15:51.292435 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-ed78254a-c187-4876-a4ba-d324c6abe97b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:15:51.307178 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed78254a-c187-4876-a4ba-d324c6abe97b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:15:51.308618 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed78254a-c187-4876-a4ba-d324c6abe97b service cinder] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:15:51.319910 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1438/2912] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:15:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:15:52.312357 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471adfb2-2f36-4a6a-9d06-74b57e39a42d None None] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:15:52.317500 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-471adfb2-2f36-4a6a-9d06-74b57e39a42d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:15:52.373249 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471adfb2-2f36-4a6a-9d06-74b57e39a42d None None] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:15:52.378668 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b624fdc-9ea9-47e2-a4ce-d26cb523d625 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a937971ad1a4b0c8697c764f214d446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:15:52.379296 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b624fdc-9ea9-47e2-a4ce-d26cb523d625 service neutron] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:15:52.379604 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b624fdc-9ea9-47e2-a4ce-d26cb523d625 service neutron] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:15:52.380002 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b624fdc-9ea9-47e2-a4ce-d26cb523d625 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:15:52.382066 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-0b624fdc-9ea9-47e2-a4ce-d26cb523d625 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:15:52.396522 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b624fdc-9ea9-47e2-a4ce-d26cb523d625 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:15:52.398123 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b624fdc-9ea9-47e2-a4ce-d26cb523d625 service neutron] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:15:52.409502 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1475/2913] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:15:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:16:01.314827 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=26 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:16:02.404364 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=26 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:16:05.443812 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed78254a-c187-4876-a4ba-d324c6abe97b service cinder] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:16:05.453097 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed78254a-c187-4876-a4ba-d324c6abe97b service cinder] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:16:05.456637 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed8732b-d25b-4cb1-a99b-f871ff09d1db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a937971ad1a4b0c8697c764f214d446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:16:05.457329 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed8732b-d25b-4cb1-a99b-f871ff09d1db service neutron] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:16:05.457604 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed8732b-d25b-4cb1-a99b-f871ff09d1db service neutron] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:16:05.458029 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed8732b-d25b-4cb1-a99b-f871ff09d1db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:16:05.467274 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed8732b-d25b-4cb1-a99b-f871ff09d1db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:16:05.468712 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed8732b-d25b-4cb1-a99b-f871ff09d1db service neutron] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:16:05.478725 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1439/2914] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:16:05 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:16:15.474521 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=6 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:18:10.864015 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b624fdc-9ea9-47e2-a4ce-d26cb523d625 service neutron] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:18:10.874000 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b624fdc-9ea9-47e2-a4ce-d26cb523d625 service neutron] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:18:10.876899 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3c76c4-6faa-4ad7-9892-d8405bfd8299 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a937971ad1a4b0c8697c764f214d446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:18:10.877524 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3c76c4-6faa-4ad7-9892-d8405bfd8299 service neutron] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:18:10.877803 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3c76c4-6faa-4ad7-9892-d8405bfd8299 service neutron] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:18:10.878077 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3c76c4-6faa-4ad7-9892-d8405bfd8299 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:18:10.879937 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-dd3c76c4-6faa-4ad7-9892-d8405bfd8299 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:18:10.890935 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3c76c4-6faa-4ad7-9892-d8405bfd8299 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:18:10.892373 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3c76c4-6faa-4ad7-9892-d8405bfd8299 service neutron] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:18:10.901201 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1476/2915] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:18:10 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:18:11.003642 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed8732b-d25b-4cb1-a99b-f871ff09d1db service neutron] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:18:11.013399 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed8732b-d25b-4cb1-a99b-f871ff09d1db service neutron] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:18:11.017019 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a22fa3-1304-4496-8dd8-d56604c52c04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a937971ad1a4b0c8697c764f214d446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:18:11.017635 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a22fa3-1304-4496-8dd8-d56604c52c04 service neutron] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:18:11.017913 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a22fa3-1304-4496-8dd8-d56604c52c04 service neutron] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:18:11.018184 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a22fa3-1304-4496-8dd8-d56604c52c04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:18:11.019961 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-10a22fa3-1304-4496-8dd8-d56604c52c04 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:18:11.033570 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a22fa3-1304-4496-8dd8-d56604c52c04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:18:11.034976 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a22fa3-1304-4496-8dd8-d56604c52c04 service neutron] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:18:11.046452 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1440/2916] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:18:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:18:20.896934 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=6 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:18:21.041748 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=6 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:18:44.834716 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3c76c4-6faa-4ad7-9892-d8405bfd8299 service neutron] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:18:44.854352 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3c76c4-6faa-4ad7-9892-d8405bfd8299 service neutron] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:18:44.858024 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f9341b-6fd1-4b5e-83e6-a0e72e1810b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a937971ad1a4b0c8697c764f214d446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:18:44.858619 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f9341b-6fd1-4b5e-83e6-a0e72e1810b5 service neutron] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:18:44.858899 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f9341b-6fd1-4b5e-83e6-a0e72e1810b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:18:44.859170 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f9341b-6fd1-4b5e-83e6-a0e72e1810b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:18:44.860912 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-16f9341b-6fd1-4b5e-83e6-a0e72e1810b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:18:44.889880 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f9341b-6fd1-4b5e-83e6-a0e72e1810b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:18:44.891309 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f9341b-6fd1-4b5e-83e6-a0e72e1810b5 service neutron] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:18:44.899371 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1477/2917] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:18:44 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:18:48.326555 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a22fa3-1304-4496-8dd8-d56604c52c04 service neutron] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:18:48.327947 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-10a22fa3-1304-4496-8dd8-d56604c52c04 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:18:48.461190 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a22fa3-1304-4496-8dd8-d56604c52c04 service neutron] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:18:48.466486 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ceabb9-7941-4621-b1c9-7e6bc90a5935 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b44c0cf2d8b34f3e81c59d19eedbdfcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:18:48.467077 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ceabb9-7941-4621-b1c9-7e6bc90a5935 service placement] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:18:48.467352 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ceabb9-7941-4621-b1c9-7e6bc90a5935 service placement] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:18:48.467619 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ceabb9-7941-4621-b1c9-7e6bc90a5935 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:18:48.469343 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-15ceabb9-7941-4621-b1c9-7e6bc90a5935 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:18:48.480616 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ceabb9-7941-4621-b1c9-7e6bc90a5935 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:18:48.482166 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ceabb9-7941-4621-b1c9-7e6bc90a5935 service placement] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:18:48.491809 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1441/2918] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:18:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:18:54.895623 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=19 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:18:58.487668 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=63 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:19:31.345360 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f9341b-6fd1-4b5e-83e6-a0e72e1810b5 service neutron] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:19:31.347066 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-16f9341b-6fd1-4b5e-83e6-a0e72e1810b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:19:31.367492 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f9341b-6fd1-4b5e-83e6-a0e72e1810b5 service neutron] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:19:31.373058 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4126f8dc-7a67-4b84-b207-f33308cc8d48 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a39cd50340184779ac589bbcb7cac9aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:19:31.373837 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4126f8dc-7a67-4b84-b207-f33308cc8d48 service nova] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:19:31.374114 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4126f8dc-7a67-4b84-b207-f33308cc8d48 service nova] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:19:31.374383 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4126f8dc-7a67-4b84-b207-f33308cc8d48 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:19:31.376115 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-4126f8dc-7a67-4b84-b207-f33308cc8d48 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:19:31.389986 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4126f8dc-7a67-4b84-b207-f33308cc8d48 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:19:31.391775 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4126f8dc-7a67-4b84-b207-f33308cc8d48 service nova] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:19:31.404561 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1478/2919] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:19:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:19:40.016179 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ceabb9-7941-4621-b1c9-7e6bc90a5935 service placement] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:19:40.035668 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ceabb9-7941-4621-b1c9-7e6bc90a5935 service placement] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:19:40.042546 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f44303-f0ad-41fc-96c7-2588226f90bf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b44c0cf2d8b34f3e81c59d19eedbdfcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:19:40.043444 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f44303-f0ad-41fc-96c7-2588226f90bf service placement] REQUEST_METHOD: `GET` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:19:40.043903 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f44303-f0ad-41fc-96c7-2588226f90bf service placement] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:19:40.044346 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f44303-f0ad-41fc-96c7-2588226f90bf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:19:40.046523 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-a4f44303-f0ad-41fc-96c7-2588226f90bf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:19:40.059643 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f44303-f0ad-41fc-96c7-2588226f90bf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:19:40.061399 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f44303-f0ad-41fc-96c7-2588226f90bf service placement] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:19:40.074684 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1442/2920] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:19:40 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:19:41.399366 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=6 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:19:43.744020 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4126f8dc-7a67-4b84-b207-f33308cc8d48 service nova] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:19:43.809886 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4126f8dc-7a67-4b84-b207-f33308cc8d48 service nova] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:19:43.814470 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdf8007-bbce-466b-859b-c601a31ae289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:19:43.815092 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdf8007-bbce-466b-859b-c601a31ae289 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:19:43.815370 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdf8007-bbce-466b-859b-c601a31ae289 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:19:43.815640 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdf8007-bbce-466b-859b-c601a31ae289 admin admin] PATH_INFO: `/v3/users/087fad0e901c49ea96b70fdfa1ce9ad9` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:19:43.816896 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdf8007-bbce-466b-859b-c601a31ae289 admin admin] RBAC: Authorizing `identity:delete_user(user_id=087fad0e901c49ea96b70fdfa1ce9ad9)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:19:43.818873 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdf8007-bbce-466b-859b-c601a31ae289 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:19:44.043783 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-cfdf8007-bbce-466b-859b-c601a31ae289 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '087fad0e901c49ea96b70fdfa1ce9ad9'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:19:44.052380 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-cfdf8007-bbce-466b-859b-c601a31ae289 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '087fad0e901c49ea96b70fdfa1ce9ad9'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:19:44.053173 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-cfdf8007-bbce-466b-859b-c601a31ae289 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '087fad0e901c49ea96b70fdfa1ce9ad9'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:19:44.068680 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-cfdf8007-bbce-466b-859b-c601a31ae289 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '087fad0e901c49ea96b70fdfa1ce9ad9'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:19:44.141189 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-cfdf8007-bbce-466b-859b-c601a31ae289 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '087fad0e901c49ea96b70fdfa1ce9ad9'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:19:44.148896 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1479/2921] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 18 22:19:43 2022] DELETE /identity/v3/users/087fad0e901c49ea96b70fdfa1ce9ad9 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:19:44.385597 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f44303-f0ad-41fc-96c7-2588226f90bf service placement] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:19:44.397039 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f44303-f0ad-41fc-96c7-2588226f90bf service placement] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:19:44.458677 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92ce2e7-aed4-4021-95af-b94e8686eb62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:19:44.459310 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92ce2e7-aed4-4021-95af-b94e8686eb62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:19:44.459592 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92ce2e7-aed4-4021-95af-b94e8686eb62 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:19:44.459869 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92ce2e7-aed4-4021-95af-b94e8686eb62 admin admin] PATH_INFO: `/v3/projects/d0fdc330f3284d98923f4609ce4e4043` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:19:44.461034 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92ce2e7-aed4-4021-95af-b94e8686eb62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0fdc330f3284d98923f4609ce4e4043)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:19:44.465851 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92ce2e7-aed4-4021-95af-b94e8686eb62 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:19:44.572099 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-b92ce2e7-aed4-4021-95af-b94e8686eb62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0fdc330f3284d98923f4609ce4e4043', 'request_id': 'req-b92ce2e7-aed4-4021-95af-b94e8686eb62'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:19:44.577520 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-b92ce2e7-aed4-4021-95af-b94e8686eb62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0fdc330f3284d98923f4609ce4e4043', 'request_id': 'req-b92ce2e7-aed4-4021-95af-b94e8686eb62'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:19:44.737760 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-b92ce2e7-aed4-4021-95af-b94e8686eb62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0fdc330f3284d98923f4609ce4e4043', 'request_id': 'req-b92ce2e7-aed4-4021-95af-b94e8686eb62'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:19:44.749386 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-b92ce2e7-aed4-4021-95af-b94e8686eb62 admin admin] The token cache is being invalidate because project d0fdc330f3284d98923f4609ce4e4043 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88096) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 22:19:44.749670 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-b92ce2e7-aed4-4021-95af-b94e8686eb62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:19:44.750308 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-b92ce2e7-aed4-4021-95af-b94e8686eb62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:19:44.751785 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1443/2922] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 18 22:19:44 2022] DELETE /identity/v3/projects/d0fdc330f3284d98923f4609ce4e4043 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:19:44.755878 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdf8007-bbce-466b-859b-c601a31ae289 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:19:44.757622 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-cfdf8007-bbce-466b-859b-c601a31ae289 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:19:44.771309 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdf8007-bbce-466b-859b-c601a31ae289 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:19:44.826175 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabe60a5-8ec4-4c63-bbec-7b9bf7eb1202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:19:44.826801 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabe60a5-8ec4-4c63-bbec-7b9bf7eb1202 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:19:44.827080 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabe60a5-8ec4-4c63-bbec-7b9bf7eb1202 admin admin] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:19:44.827353 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabe60a5-8ec4-4c63-bbec-7b9bf7eb1202 admin admin] PATH_INFO: `/v3/users/83cd84a4500147dea0dcaed0b4f1cf6c` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:19:44.828474 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabe60a5-8ec4-4c63-bbec-7b9bf7eb1202 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83cd84a4500147dea0dcaed0b4f1cf6c)` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:19:44.830424 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabe60a5-8ec4-4c63-bbec-7b9bf7eb1202 admin admin] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:19:44.852179 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:19:45.034365 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-dabe60a5-8ec4-4c63-bbec-7b9bf7eb1202 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83cd84a4500147dea0dcaed0b4f1cf6c'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:19:45.042211 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-dabe60a5-8ec4-4c63-bbec-7b9bf7eb1202 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83cd84a4500147dea0dcaed0b4f1cf6c'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:19:45.042902 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-dabe60a5-8ec4-4c63-bbec-7b9bf7eb1202 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83cd84a4500147dea0dcaed0b4f1cf6c'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:19:45.055470 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-dabe60a5-8ec4-4c63-bbec-7b9bf7eb1202 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83cd84a4500147dea0dcaed0b4f1cf6c'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:19:45.108892 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.notifications [None req-dabe60a5-8ec4-4c63-bbec-7b9bf7eb1202 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83cd84a4500147dea0dcaed0b4f1cf6c'} {{(pid=88097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:19:45.116025 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1480/2923] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 18 22:19:44 2022] DELETE /identity/v3/users/83cd84a4500147dea0dcaed0b4f1cf6c => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:19:45.346458 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92ce2e7-aed4-4021-95af-b94e8686eb62 admin admin] Authenticating user token {{(pid=88096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:19:45.346458 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.fernet_utils [None req-b92ce2e7-aed4-4021-95af-b94e8686eb62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:19:45.353947 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92ce2e7-aed4-4021-95af-b94e8686eb62 admin admin] Validating token access rules against request {{(pid=88096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:19:45.411769 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa670651-cbbd-427b-b330-96b7443769c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b468708457d44a0a864439dd99359654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c586edb6eda041a285eb97d5b15554f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:19:45.412428 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa670651-cbbd-427b-b330-96b7443769c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:19:45.412716 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa670651-cbbd-427b-b330-96b7443769c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:19:45.412995 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa670651-cbbd-427b-b330-96b7443769c5 admin admin] PATH_INFO: `/v3/projects/f12df1ae035749878a3036809222c140` {{(pid=88096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:19:45.414128 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa670651-cbbd-427b-b330-96b7443769c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f12df1ae035749878a3036809222c140)` {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:19:45.416055 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa670651-cbbd-427b-b330-96b7443769c5 admin admin] RBAC: Authorization granted {{(pid=88096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:19:45.437294 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:19:45.527009 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-fa670651-cbbd-427b-b330-96b7443769c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f12df1ae035749878a3036809222c140', 'request_id': 'req-fa670651-cbbd-427b-b330-96b7443769c5'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:19:45.532484 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-fa670651-cbbd-427b-b330-96b7443769c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f12df1ae035749878a3036809222c140', 'request_id': 'req-fa670651-cbbd-427b-b330-96b7443769c5'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:19:45.603697 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-fa670651-cbbd-427b-b330-96b7443769c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f12df1ae035749878a3036809222c140', 'request_id': 'req-fa670651-cbbd-427b-b330-96b7443769c5'} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:19:45.615528 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-fa670651-cbbd-427b-b330-96b7443769c5 admin admin] The token cache is being invalidate because project f12df1ae035749878a3036809222c140 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88096) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 22:19:45.618814 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-fa670651-cbbd-427b-b330-96b7443769c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:19:45.618814 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG keystone.notifications [None req-fa670651-cbbd-427b-b330-96b7443769c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 22:19:45.618814 dv-cinder-853678-3-smb devstack@keystone.service[88096]: [pid: 88096|app: 0|req: 1444/2924] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 18 22:19:45 2022] DELETE /identity/v3/projects/f12df1ae035749878a3036809222c140 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 22:19:55.111428 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:DELETE=7,keystone:SELECT=20,keystone:INSERT=1 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:19:55.612216 dv-cinder-853678-3-smb devstack@keystone.service[88096]: DEBUG dbcounter [-] [88096] Writing DB stats keystone:SELECT=16,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:23:50.287696 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabe60a5-8ec4-4c63-bbec-7b9bf7eb1202 admin admin] Authenticating user token {{(pid=88097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 22:23:50.289173 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-dabe60a5-8ec4-4c63-bbec-7b9bf7eb1202 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:23:50.357805 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabe60a5-8ec4-4c63-bbec-7b9bf7eb1202 admin admin] Validating token access rules against request {{(pid=88097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 22:23:50.421040 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c419f4a8-f1d7-4862-8390-f169b2e607f3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b44c0cf2d8b34f3e81c59d19eedbdfcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b54801b90484d689034f838f85fc0a4', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 22:23:50.421645 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c419f4a8-f1d7-4862-8390-f169b2e607f3 service placement] REQUEST_METHOD: `GET` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 22:23:50.421953 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c419f4a8-f1d7-4862-8390-f169b2e607f3 service placement] SCRIPT_NAME: `/identity` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 22:23:50.422230 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c419f4a8-f1d7-4862-8390-f169b2e607f3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 22:23:50.423947 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.fernet_utils [None req-c419f4a8-f1d7-4862-8390-f169b2e607f3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 22:23:50.435626 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c419f4a8-f1d7-4862-8390-f169b2e607f3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 22:23:50.437233 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c419f4a8-f1d7-4862-8390-f169b2e607f3 service placement] RBAC: Authorization granted {{(pid=88097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 22:23:50.447604 dv-cinder-853678-3-smb devstack@keystone.service[88097]: [pid: 88097|app: 0|req: 1481/2925] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 18 22:23:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 22:24:00.443376 dv-cinder-853678-3-smb devstack@keystone.service[88097]: DEBUG dbcounter [-] [88097] Writing DB stats keystone:SELECT=58 {{(pid=88097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}